[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:09:26.175273 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:34079
I20260709 13:09:26.177254 26038 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:09:26.178581 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.198415 26045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.198740 26044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.199051 26047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.200723 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:27.419165 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:27.419543 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:27.419799 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602567419770 us; error 0 us; skew 500 ppm
I20260709 13:09:27.420781 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:27.428691 26038 webserver.cc:533] Webserver started at http://127.25.109.190:33205/ using document root <none> and password file <none>
I20260709 13:09:27.429797 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:27.430126 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:27.430678 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:27.437510 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "3eb533964fb8458ba0af169a7542aff1"
format_stamp: "Formatted at 2026-07-09 13:09:27 on dist-test-slave-zhdc"
I20260709 13:09:27.446841 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:27.454216 26053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:27.455590 26038 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:09:27.456023 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "3eb533964fb8458ba0af169a7542aff1"
format_stamp: "Formatted at 2026-07-09 13:09:27 on dist-test-slave-zhdc"
I20260709 13:09:27.456434 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:27.515796 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:27.517668 26038 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:09:27.518298 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:27.604913 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:34079
I20260709 13:09:27.604993 26104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:34079 every 8 connection(s)
I20260709 13:09:27.614264 26105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:27.638705 26105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: Bootstrap starting.
I20260709 13:09:27.645553 26105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.647819 26105 log.cc:826] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: Log is configured to *not* fsync() on all Append() calls
I20260709 13:09:27.653293 26105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: No bootstrap required, opened a new log
I20260709 13:09:27.675998 26105 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER }
I20260709 13:09:27.676688 26105 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.676898 26105 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eb533964fb8458ba0af169a7542aff1, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.677942 26105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER }
I20260709 13:09:27.678552 26105 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:27.678835 26105 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:27.679148 26105 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.683653 26105 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER }
I20260709 13:09:27.684514 26105 leader_election.cc:304] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eb533964fb8458ba0af169a7542aff1; no voters: 
I20260709 13:09:27.686664 26105 leader_election.cc:290] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:27.687110 26108 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.690343 26108 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 1 LEADER]: Becoming Leader. State: Replica: 3eb533964fb8458ba0af169a7542aff1, State: Running, Role: LEADER
I20260709 13:09:27.691432 26108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER }
I20260709 13:09:27.692593 26105 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:27.706619 26109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eb533964fb8458ba0af169a7542aff1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER } }
I20260709 13:09:27.707535 26109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:27.709847 26110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eb533964fb8458ba0af169a7542aff1. Latest consensus state: current_term: 1 leader_uuid: "3eb533964fb8458ba0af169a7542aff1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eb533964fb8458ba0af169a7542aff1" member_type: VOTER } }
I20260709 13:09:27.710752 26110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:27.711294 26118 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:27.724756 26118 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:27.727632 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:27.745658 26118 catalog_manager.cc:1383] Generated new cluster ID: cbef4fcb45de425f8b6687702b7fb712
I20260709 13:09:27.746031 26118 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:27.780979 26118 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:27.783504 26118 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:27.810189 26118 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: Generated new TSK 0
I20260709 13:09:27.811759 26118 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:27.859555 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:27.869652 26127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:27.873070 26128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:27.876092 26130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:27.876298 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:27.877172 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:27.877399 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:27.877612 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602567877565 us; error 0 us; skew 500 ppm
I20260709 13:09:27.878295 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:27.883208 26038 webserver.cc:533] Webserver started at http://127.25.109.129:40761/ using document root <none> and password file <none>
I20260709 13:09:27.883790 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:27.883996 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:27.884317 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:27.885587 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "0b33edf68fa349a6998824635f987b74"
format_stamp: "Formatted at 2026-07-09 13:09:27 on dist-test-slave-zhdc"
I20260709 13:09:27.891899 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:09:27.896754 26135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:27.897671 26038 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:27.897981 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "0b33edf68fa349a6998824635f987b74"
format_stamp: "Formatted at 2026-07-09 13:09:27 on dist-test-slave-zhdc"
I20260709 13:09:27.898357 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:27.926736 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:27.928280 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:27.931547 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:27.936821 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:27.937111 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:27.937466 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:27.937626 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.062108 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:41533
I20260709 13:09:28.062220 26197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:41533 every 8 connection(s)
I20260709 13:09:28.070358 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:28.081010 26202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:28.090641 26203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:28.095294 26205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:28.096078 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:28.097090 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:28.097337 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:28.097548 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602568097502 us; error 0 us; skew 500 ppm
I20260709 13:09:28.098264 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:28.101626 26038 webserver.cc:533] Webserver started at http://127.25.109.130:46631/ using document root <none> and password file <none>
I20260709 13:09:28.102412 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:28.102684 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:28.103055 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:28.104720 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
format_stamp: "Formatted at 2026-07-09 13:09:28 on dist-test-slave-zhdc"
I20260709 13:09:28.107686 26198 heartbeater.cc:344] Connected to a master server at 127.25.109.190:34079
I20260709 13:09:28.108210 26198 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:28.109614 26198 heartbeater.cc:507] Master 127.25.109.190:34079 requested a full tablet report, sending...
I20260709 13:09:28.112430 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.005s
I20260709 13:09:28.113912 26070 ts_manager.cc:194] Registered new tserver with Master: 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533)
I20260709 13:09:28.117515 26070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46204
I20260709 13:09:28.120613 26210 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.121647 26038 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.002s	sys 0.000s
I20260709 13:09:28.122018 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
format_stamp: "Formatted at 2026-07-09 13:09:28 on dist-test-slave-zhdc"
I20260709 13:09:28.122426 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:28.142938 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:28.144472 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:28.147385 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:28.150694 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:28.150889 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.151258 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:28.151458 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.261091 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:33585
I20260709 13:09:28.261246 26272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:33585 every 8 connection(s)
I20260709 13:09:28.268837 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:28.278324 26276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:28.285111 26273 heartbeater.cc:344] Connected to a master server at 127.25.109.190:34079
I20260709 13:09:28.285588 26273 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:28.285674 26277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:28.286644 26273 heartbeater.cc:507] Master 127.25.109.190:34079 requested a full tablet report, sending...
I20260709 13:09:28.289676 26070 ts_manager.cc:194] Registered new tserver with Master: 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:28.292284 26070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46218
W20260709 13:09:28.294736 26279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:28.296041 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:28.296973 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:28.297194 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:28.297381 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602568297354 us; error 0 us; skew 500 ppm
I20260709 13:09:28.297950 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:28.300910 26038 webserver.cc:533] Webserver started at http://127.25.109.131:45821/ using document root <none> and password file <none>
I20260709 13:09:28.301434 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:28.301652 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:28.301957 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:28.303146 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "eb94504b61ff46f29a0b2a0b092a003a"
format_stamp: "Formatted at 2026-07-09 13:09:28 on dist-test-slave-zhdc"
I20260709 13:09:28.308341 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:09:28.312182 26284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.313060 26038 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:28.313365 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "eb94504b61ff46f29a0b2a0b092a003a"
format_stamp: "Formatted at 2026-07-09 13:09:28 on dist-test-slave-zhdc"
I20260709 13:09:28.313651 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:28.325006 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:28.326543 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:28.328049 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:28.330734 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:28.330984 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.331240 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:28.331424 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:28.436167 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:44687
I20260709 13:09:28.436259 26346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:44687 every 8 connection(s)
I20260709 13:09:28.458612 26347 heartbeater.cc:344] Connected to a master server at 127.25.109.190:34079
I20260709 13:09:28.459118 26347 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:28.460038 26347 heartbeater.cc:507] Master 127.25.109.190:34079 requested a full tablet report, sending...
I20260709 13:09:28.462360 26070 ts_manager.cc:194] Registered new tserver with Master: eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:28.462896 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019884277s
I20260709 13:09:28.464298 26070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46230
I20260709 13:09:28.524102 26070 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46246:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:28.529060 26070 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:28.652675 26312 tablet_service.cc:1511] Processing CreateTablet for tablet 84d446fefe504403a71198481e52d8f9 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:28.652667 26311 tablet_service.cc:1511] Processing CreateTablet for tablet e33b601169d44d23b2ff90275bd5f978 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:28.654698 26310 tablet_service.cc:1511] Processing CreateTablet for tablet a0c16a807a3b43338fc69ae78fc21ed8 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:28.656394 26312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d446fefe504403a71198481e52d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.657130 26310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c16a807a3b43338fc69ae78fc21ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.662626 26307 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:28.663408 26308 tablet_service.cc:1511] Processing CreateTablet for tablet af435c3b50444ac78ecac69a69866b84 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:28.664258 26307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.661173 26309 tablet_service.cc:1511] Processing CreateTablet for tablet 866231f7085a44b2b57f1fff9c4f83d1 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:28.665617 26309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866231f7085a44b2b57f1fff9c4f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.666812 26306 tablet_service.cc:1511] Processing CreateTablet for tablet 222bfe4c7cd3473ea8a1dcf191f36100 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:28.668265 26306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222bfe4c7cd3473ea8a1dcf191f36100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.670459 26308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af435c3b50444ac78ecac69a69866b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.674526 26311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33b601169d44d23b2ff90275bd5f978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.688151 26162 tablet_service.cc:1511] Processing CreateTablet for tablet e33b601169d44d23b2ff90275bd5f978 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:28.684391 26305 tablet_service.cc:1511] Processing CreateTablet for tablet 458da3585fa3444bb39d7ce1912cdc8e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:28.695266 26161 tablet_service.cc:1511] Processing CreateTablet for tablet a0c16a807a3b43338fc69ae78fc21ed8 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:28.693917 26162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33b601169d44d23b2ff90275bd5f978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.692162 26163 tablet_service.cc:1511] Processing CreateTablet for tablet 84d446fefe504403a71198481e52d8f9 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:28.692682 26304 tablet_service.cc:1511] Processing CreateTablet for tablet 517bc1bc97f4417c8154eb831711c62e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:28.710361 26161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c16a807a3b43338fc69ae78fc21ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.718215 26305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458da3585fa3444bb39d7ce1912cdc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.725466 26159 tablet_service.cc:1511] Processing CreateTablet for tablet af435c3b50444ac78ecac69a69866b84 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:28.730814 26163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d446fefe504403a71198481e52d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.734659 26237 tablet_service.cc:1511] Processing CreateTablet for tablet e33b601169d44d23b2ff90275bd5f978 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:28.722757 26158 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:28.745297 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af435c3b50444ac78ecac69a69866b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.740895 26236 tablet_service.cc:1511] Processing CreateTablet for tablet a0c16a807a3b43338fc69ae78fc21ed8 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:28.739234 26304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517bc1bc97f4417c8154eb831711c62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.726698 26160 tablet_service.cc:1511] Processing CreateTablet for tablet 866231f7085a44b2b57f1fff9c4f83d1 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 13:09:28.747352 26117 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:28.747205 26235 tablet_service.cc:1511] Processing CreateTablet for tablet 866231f7085a44b2b57f1fff9c4f83d1 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:28.738732 26157 tablet_service.cc:1511] Processing CreateTablet for tablet 222bfe4c7cd3473ea8a1dcf191f36100 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:28.742815 26156 tablet_service.cc:1511] Processing CreateTablet for tablet 458da3585fa3444bb39d7ce1912cdc8e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:28.749867 26235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866231f7085a44b2b57f1fff9c4f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.744374 26155 tablet_service.cc:1511] Processing CreateTablet for tablet 517bc1bc97f4417c8154eb831711c62e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:28.749965 26238 tablet_service.cc:1511] Processing CreateTablet for tablet 84d446fefe504403a71198481e52d8f9 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:28.762626 26158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.754979 26234 tablet_service.cc:1511] Processing CreateTablet for tablet af435c3b50444ac78ecac69a69866b84 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:28.767589 26232 tablet_service.cc:1511] Processing CreateTablet for tablet 222bfe4c7cd3473ea8a1dcf191f36100 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:28.773554 26160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866231f7085a44b2b57f1fff9c4f83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.769120 26233 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71 (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:28.782418 26237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33b601169d44d23b2ff90275bd5f978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.784106 26232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222bfe4c7cd3473ea8a1dcf191f36100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.787681 26231 tablet_service.cc:1511] Processing CreateTablet for tablet 458da3585fa3444bb39d7ce1912cdc8e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:28.789965 26230 tablet_service.cc:1511] Processing CreateTablet for tablet 517bc1bc97f4417c8154eb831711c62e (DEFAULT_TABLE table=test-workload [id=bd9a66d7b33c4712a08ff1084e3dff0e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:28.802809 26157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222bfe4c7cd3473ea8a1dcf191f36100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.814090 26155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517bc1bc97f4417c8154eb831711c62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.817349 26156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458da3585fa3444bb39d7ce1912cdc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.816263 26234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af435c3b50444ac78ecac69a69866b84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.871635 26236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c16a807a3b43338fc69ae78fc21ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.875926 26238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d446fefe504403a71198481e52d8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.892124 26230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517bc1bc97f4417c8154eb831711c62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.899515 26231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458da3585fa3444bb39d7ce1912cdc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:28.904054 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed64bc0d2c4cbb83dc5607a9e0ca71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:29.028872 26365 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.062953 26366 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.079926 26365 tablet_bootstrap.cc:654] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.092190 26367 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.116596 26366 tablet_bootstrap.cc:654] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.122361 26198 heartbeater.cc:499] Master 127.25.109.190:34079 was elected leader, sending a full tablet report...
I20260709 13:09:29.132972 26365 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.133520 26365 ts_tablet_manager.cc:1403] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.000s
I20260709 13:09:29.136834 26365 raft_consensus.cc:359] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.137650 26365 raft_consensus.cc:385] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.137951 26365 raft_consensus.cc:740] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.138772 26365 consensus_queue.cc:260] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.140823 26367 tablet_bootstrap.cc:654] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.142290 26366 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.144451 26366 ts_tablet_manager.cc:1403] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.006s
I20260709 13:09:29.143669 26347 heartbeater.cc:499] Master 127.25.109.190:34079 was elected leader, sending a full tablet report...
I20260709 13:09:29.148111 26366 raft_consensus.cc:359] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.148880 26366 raft_consensus.cc:385] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.149175 26366 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.151582 26365 ts_tablet_manager.cc:1434] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:09:29.152719 26365 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.149894 26366 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.164661 26365 tablet_bootstrap.cc:654] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.165922 26366 ts_tablet_manager.cc:1434] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:09:29.166749 26273 heartbeater.cc:499] Master 127.25.109.190:34079 was elected leader, sending a full tablet report...
I20260709 13:09:29.166996 26366 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.164727 26367 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.169580 26367 ts_tablet_manager.cc:1403] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.012s
I20260709 13:09:29.172780 26367 raft_consensus.cc:359] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.173575 26367 raft_consensus.cc:385] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.173871 26367 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.179214 26366 tablet_bootstrap.cc:654] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.178763 26367 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.181193 26365 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.181886 26365 ts_tablet_manager.cc:1403] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:09:29.185729 26365 raft_consensus.cc:359] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.186766 26365 raft_consensus.cc:385] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.187253 26365 raft_consensus.cc:740] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.188493 26365 consensus_queue.cc:260] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.197279 26367 ts_tablet_manager.cc:1434] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:09:29.198556 26365 ts_tablet_manager.cc:1434] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:29.200663 26365 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
W20260709 13:09:29.198619 26348 tablet.cc:2406] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:29.208139 26365 tablet_bootstrap.cc:654] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.199633 26367 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.214830 26366 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.215456 26366 ts_tablet_manager.cc:1403] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.014s
I20260709 13:09:29.216881 26367 tablet_bootstrap.cc:654] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.218494 26366 raft_consensus.cc:359] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.220588 26366 raft_consensus.cc:385] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.220892 26366 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.221683 26366 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.226624 26366 ts_tablet_manager.cc:1434] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:09:29.227690 26366 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.234645 26367 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.235190 26367 ts_tablet_manager.cc:1403] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.001s
I20260709 13:09:29.238188 26367 raft_consensus.cc:359] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.238909 26367 raft_consensus.cc:385] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.239204 26367 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.239907 26367 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.246724 26366 tablet_bootstrap.cc:654] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.242000 26367 ts_tablet_manager.cc:1434] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:29.251312 26367 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.258662 26367 tablet_bootstrap.cc:654] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.260265 26365 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.260932 26365 ts_tablet_manager.cc:1403] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.025s
I20260709 13:09:29.265434 26366 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.265019 26365 raft_consensus.cc:359] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.265882 26366 ts_tablet_manager.cc:1403] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.014s
I20260709 13:09:29.266263 26365 raft_consensus.cc:385] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.266770 26365 raft_consensus.cc:740] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.267904 26365 consensus_queue.cc:260] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.270795 26366 raft_consensus.cc:359] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.271682 26366 raft_consensus.cc:385] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.272145 26366 raft_consensus.cc:740] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.276432 26365 ts_tablet_manager.cc:1434] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:29.276424 26366 consensus_queue.cc:260] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.279088 26365 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.279383 26366 ts_tablet_manager.cc:1434] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:09:29.280640 26366 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.287106 26365 tablet_bootstrap.cc:654] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.288374 26366 tablet_bootstrap.cc:654] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.290541 26370 raft_consensus.cc:493] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.291215 26370 raft_consensus.cc:515] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.295791 26370 leader_election.cc:290] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.309484 26367 tablet_bootstrap.cc:492] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.312794 26366 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.313701 26366 ts_tablet_manager.cc:1403] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 13:09:29.313791 26365 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.315279 26365 ts_tablet_manager.cc:1403] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.014s
I20260709 13:09:29.315891 26367 ts_tablet_manager.cc:1403] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.011s
I20260709 13:09:29.317564 26374 raft_consensus.cc:493] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.317430 26366 raft_consensus.cc:359] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.318440 26366 raft_consensus.cc:385] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.318109 26374 raft_consensus.cc:515] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.318248 26365 raft_consensus.cc:359] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.319015 26365 raft_consensus.cc:385] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.319303 26365 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.320067 26365 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.321163 26374 leader_election.cc:290] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.321694 26366 raft_consensus.cc:740] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.323251 26366 consensus_queue.cc:260] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.323468 26367 raft_consensus.cc:359] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.326118 26366 ts_tablet_manager.cc:1434] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:09:29.327179 26366 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.333979 26365 ts_tablet_manager.cc:1434] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:09:29.340816 26365 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.341545 26366 tablet_bootstrap.cc:654] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.324352 26367 raft_consensus.cc:385] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.350208 26367 raft_consensus.cc:740] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.351197 26365 tablet_bootstrap.cc:654] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.354408 26367 consensus_queue.cc:260] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.355785 26173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.357200 26367 ts_tablet_manager.cc:1434] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 13:09:29.356993 26173 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:29.358278 26367 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.359273 26285 leader_election.cc:304] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.360253 26370 raft_consensus.cc:2804] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.360702 26370 raft_consensus.cc:493] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.355665 26366 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.361141 26370 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.366750 26366 ts_tablet_manager.cc:1403] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.009s
I20260709 13:09:29.370731 26366 raft_consensus.cc:359] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.371891 26366 raft_consensus.cc:385] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.372072 26367 tablet_bootstrap.cc:654] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.372370 26366 raft_consensus.cc:740] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.373328 26366 consensus_queue.cc:260] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.375241 26370 raft_consensus.cc:515] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.379205 26173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:29.379786 26173 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.380293 26370 leader_election.cc:290] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.385821 26366 ts_tablet_manager.cc:1434] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:09:29.387879 26173 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:29.389405 26285 leader_election.cc:304] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.390338 26370 raft_consensus.cc:2804] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.392508 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.395174 26370 raft_consensus.cc:697] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:29.396502 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.397013 26370 consensus_queue.cc:237] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.397367 26248 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:29.398682 26366 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.399811 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:29.400660 26248 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.407227 26366 tablet_bootstrap.cc:654] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:29.409878 26137 leader_election.cc:343] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.413247 26070 catalog_manager.cc:5697] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 0 to 1, leader changed from <none> to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 1 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.418642 26372 raft_consensus.cc:493] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.419224 26372 raft_consensus.cc:515] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.422677 26372 leader_election.cc:290] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.418615 26365 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.426293 26367 tablet_bootstrap.cc:492] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.426442 26365 ts_tablet_manager.cc:1403] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.023s
I20260709 13:09:29.427104 26367 ts_tablet_manager.cc:1403] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.026s
I20260709 13:09:29.429908 26365 raft_consensus.cc:359] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.430830 26365 raft_consensus.cc:385] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.430783 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.431259 26365 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.431676 26322 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 0.
I20260709 13:09:29.432180 26365 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.433543 26136 leader_election.cc:304] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:29.434521 26374 raft_consensus.cc:2804] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.434718 26365 ts_tablet_manager.cc:1434] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:29.435021 26374 raft_consensus.cc:493] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.435488 26374 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.436383 26365 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.437423 26248 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:29.443775 26365 tablet_bootstrap.cc:654] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.449827 26367 raft_consensus.cc:359] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.451536 26367 raft_consensus.cc:385] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.451833 26367 raft_consensus.cc:740] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.453996 26366 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.454597 26366 ts_tablet_manager.cc:1403] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.010s
I20260709 13:09:29.454190 26367 consensus_queue.cc:260] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.462571 26366 raft_consensus.cc:359] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.463301 26370 raft_consensus.cc:493] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.463373 26366 raft_consensus.cc:385] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.463838 26366 raft_consensus.cc:740] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.463877 26370 raft_consensus.cc:515] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.464907 26366 consensus_queue.cc:260] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.466303 26370 leader_election.cc:290] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.467247 26173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.467921 26173 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:29.468997 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.469626 26248 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:29.470778 26285 leader_election.cc:304] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.471568 26370 raft_consensus.cc:2804] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.471956 26370 raft_consensus.cc:493] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.472311 26370 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.476132 26366 ts_tablet_manager.cc:1434] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:29.480796 26370 raft_consensus.cc:515] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.484853 26366 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.487602 26400 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.488222 26400 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.490940 26400 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.445434 26374 raft_consensus.cc:515] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.492054 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.492265 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.499874 26366 tablet_bootstrap.cc:654] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.510860 26173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:29.512626 26173 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.509027 26370 leader_election.cc:290] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.517494 26374 leader_election.cc:290] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
W20260709 13:09:29.517797 26137 leader_election.cc:343] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.517252 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:29.525974 26247 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:29.528729 26136 leader_election.cc:343] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.527894 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:29.529196 26136 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b33edf68fa349a6998824635f987b74; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:29.532228 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:29.533361 26322 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:29.534248 26137 leader_election.cc:343] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.538196 26399 raft_consensus.cc:2749] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.562688 26367 ts_tablet_manager.cc:1434] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.135s	user 0.023s	sys 0.001s
I20260709 13:09:29.566798 26367 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.568540 26173 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:29.572829 26370 raft_consensus.cc:493] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.573428 26370 raft_consensus.cc:515] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.577277 26370 leader_election.cc:290] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.578812 26322 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 1.
I20260709 13:09:29.581588 26285 leader_election.cc:304] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.582192 26365 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.582022 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.582675 26365 ts_tablet_manager.cc:1403] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.147s	user 0.042s	sys 0.033s
I20260709 13:09:29.580324 26372 raft_consensus.cc:493] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.582986 26136 leader_election.cc:304] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:29.583680 26247 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:29.584159 26399 raft_consensus.cc:2804] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.583453 26372 raft_consensus.cc:515] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.585135 26399 raft_consensus.cc:697] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
W20260709 13:09:29.585553 26286 leader_election.cc:343] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.586799 26372 leader_election.cc:290] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.586375 26399 consensus_queue.cc:237] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.588410 26372 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.588976 26367 tablet_bootstrap.cc:654] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.588866 26372 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.585330 26370 raft_consensus.cc:2804] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.590699 26370 raft_consensus.cc:697] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:29.591576 26370 consensus_queue.cc:237] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.593230 26173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.593560 26372 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.596694 26365 raft_consensus.cc:359] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.597534 26365 raft_consensus.cc:385] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.600119 26365 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.601624 26171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
W20260709 13:09:29.602380 26285 leader_election.cc:343] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.603425 26366 tablet_bootstrap.cc:492] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.603170 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.602133 26365 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.604218 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.604542 26366 ts_tablet_manager.cc:1403] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.009s
I20260709 13:09:29.605399 26285 leader_election.cc:304] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb94504b61ff46f29a0b2a0b092a003a; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.610970 26393 raft_consensus.cc:2749] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:29.612403 26211 leader_election.cc:343] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.615641 26365 ts_tablet_manager.cc:1434] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.007s
W20260709 13:09:29.615736 26211 leader_election.cc:343] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.617182 26365 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
W20260709 13:09:29.617096 26211 leader_election.cc:343] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.629443 26070 catalog_manager.cc:5697] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.636654 26366 raft_consensus.cc:359] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.643918 26366 raft_consensus.cc:385] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.645480 26366 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.649276 26365 tablet_bootstrap.cc:654] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.650043 26367 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.650619 26367 ts_tablet_manager.cc:1403] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.011s
I20260709 13:09:29.657667 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.652484 26366 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.672327 26406 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.710770 26211 leader_election.cc:343] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.658104 26367 raft_consensus.cc:359] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.711741 26367 raft_consensus.cc:385] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.665107 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.712446 26367 raft_consensus.cc:740] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.711643 26211 leader_election.cc:304] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb; no voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:29.713286 26367 consensus_queue.cc:260] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.715022 26365 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.715562 26365 ts_tablet_manager.cc:1403] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.017s
I20260709 13:09:29.675930 26069 catalog_manager.cc:5697] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 0 to 1, leader changed from <none> to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 1 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.718943 26399 raft_consensus.cc:493] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.661886 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.719766 26372 raft_consensus.cc:2749] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.719755 26365 raft_consensus.cc:359] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.721243 26366 ts_tablet_manager.cc:1434] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.114s	user 0.017s	sys 0.010s
I20260709 13:09:29.725312 26399 raft_consensus.cc:515] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.725899 26365 raft_consensus.cc:385] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.726302 26365 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.723448 26367 ts_tablet_manager.cc:1434] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 13:09:29.727313 26366 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.728302 26399 leader_election.cc:290] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.727401 26365 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.729099 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.729581 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.729851 26247 raft_consensus.cc:2468] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 0.
I20260709 13:09:29.711480 26406 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.730871 26321 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 0.
W20260709 13:09:29.731106 26136 leader_election.cc:343] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.731933 26365 ts_tablet_manager.cc:1434] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:29.731974 26137 leader_election.cc:304] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:29.733286 26365 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.734179 26399 raft_consensus.cc:2804] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.734714 26399 raft_consensus.cc:493] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.735148 26399 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.735562 26211 leader_election.cc:304] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.736915 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.737576 26367 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
W20260709 13:09:29.738250 26285 leader_election.cc:343] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.733419 26320 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 0.
I20260709 13:09:29.741199 26410 raft_consensus.cc:2804] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.741675 26410 raft_consensus.cc:493] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.746208 26410 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.746246 26406 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:29.741215 26211 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.751223 26372 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.751989 26372 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.750665 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:29.752465 26372 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:29.749842 26117 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:29.756520 26365 tablet_bootstrap.cc:654] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.758440 26366 tablet_bootstrap.cc:654] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.763666 26399 raft_consensus.cc:515] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.765002 26372 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.769928 26247 raft_consensus.cc:2393] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb94504b61ff46f29a0b2a0b092a003a in current term 1: Already voted for candidate 00e7cdcc3d394db99ef6ece47daa7beb in this term.
I20260709 13:09:29.771521 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
W20260709 13:09:29.772980 26211 leader_election.cc:343] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.774426 26372 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.774283 26286 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb94504b61ff46f29a0b2a0b092a003a; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.775522 26399 leader_election.cc:290] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.776454 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:29.776571 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:29.777048 26320 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.777149 26247 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.777415 26367 tablet_bootstrap.cc:654] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.777477 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
W20260709 13:09:29.786808 26136 leader_election.cc:343] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.788394 26410 raft_consensus.cc:515] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.792871 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
W20260709 13:09:29.794534 26211 leader_election.cc:343] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.797106 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:29.797698 26321 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.799355 26410 leader_election.cc:290] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.807003 26321 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 1.
I20260709 13:09:29.809165 26211 leader_election.cc:304] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.812454 26410 raft_consensus.cc:2804] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.814102 26410 raft_consensus.cc:697] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:29.815097 26410 consensus_queue.cc:237] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.816915 26247 raft_consensus.cc:2468] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 1.
I20260709 13:09:29.818221 26366 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.818234 26137 leader_election.cc:304] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:29.818723 26366 ts_tablet_manager.cc:1403] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.032s
I20260709 13:09:29.819267 26399 raft_consensus.cc:2804] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.819768 26399 raft_consensus.cc:697] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:29.820643 26399 consensus_queue.cc:237] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.821431 26367 tablet_bootstrap.cc:492] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.821942 26367 ts_tablet_manager.cc:1403] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.000s
I20260709 13:09:29.825889 26365 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.826373 26365 ts_tablet_manager.cc:1403] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.008s
I20260709 13:09:29.829319 26367 raft_consensus.cc:359] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.830111 26367 raft_consensus.cc:385] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.829919 26366 raft_consensus.cc:359] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.830448 26367 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.830690 26366 raft_consensus.cc:385] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.830971 26366 raft_consensus.cc:740] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.831418 26365 raft_consensus.cc:359] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.832165 26365 raft_consensus.cc:385] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.832463 26365 raft_consensus.cc:740] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.832494 26366 consensus_queue.cc:260] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.833283 26365 consensus_queue.cc:260] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.834478 26320 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 1.
I20260709 13:09:29.835107 26366 ts_tablet_manager.cc:1434] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:29.835016 26406 raft_consensus.cc:2749] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.835824 26211 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.836136 26366 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: Bootstrap starting.
I20260709 13:09:29.836742 26372 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.838901 26365 ts_tablet_manager.cc:1434] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:29.840550 26367 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.842648 26365 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: Bootstrap starting.
I20260709 13:09:29.843528 26367 ts_tablet_manager.cc:1434] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:29.844485 26367 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.846251 26070 catalog_manager.cc:5697] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 1 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.849601 26365 tablet_bootstrap.cc:654] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.852016 26410 raft_consensus.cc:493] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.852624 26410 raft_consensus.cc:515] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.855602 26069 catalog_manager.cc:5697] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.860378 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.860704 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.861374 26320 raft_consensus.cc:2468] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 0.
I20260709 13:09:29.862123 26410 leader_election.cc:290] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.863633 26211 leader_election.cc:304] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.864571 26410 raft_consensus.cc:2804] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:29.864800 26211 leader_election.cc:343] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.864995 26410 raft_consensus.cc:493] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.869513 26410 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.871825 26367 tablet_bootstrap.cc:654] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.876938 26365 tablet_bootstrap.cc:492] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: No bootstrap required, opened a new log
I20260709 13:09:29.877481 26365 ts_tablet_manager.cc:1403] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.009s
I20260709 13:09:29.878021 26372 raft_consensus.cc:697] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:29.879969 26372 consensus_queue.cc:237] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.880920 26365 raft_consensus.cc:359] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.881449 26365 raft_consensus.cc:385] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.881623 26365 raft_consensus.cc:740] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.882151 26365 consensus_queue.cc:260] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.884547 26365 ts_tablet_manager.cc:1434] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:29.884625 26366 tablet_bootstrap.cc:654] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.885975 26416 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.888597 26416 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.891641 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:29.892293 26320 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 0.
I20260709 13:09:29.893510 26211 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.893795 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:29.894495 26172 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 0.
I20260709 13:09:29.895601 26416 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533)
I20260709 13:09:29.896260 26416 raft_consensus.cc:2804] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.896651 26416 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.897048 26416 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.909606 26410 raft_consensus.cc:515] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.913800 26366 tablet_bootstrap.cc:492] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: No bootstrap required, opened a new log
I20260709 13:09:29.914377 26366 ts_tablet_manager.cc:1403] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.000s
I20260709 13:09:29.914275 26416 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:29.915408 26410 leader_election.cc:290] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:29.916818 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:29.916819 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:29.918723 26320 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.919306 26416 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Requested vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533)
W20260709 13:09:29.920141 26211 leader_election.cc:343] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.920406 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:29.920974 26321 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.921357 26366 raft_consensus.cc:359] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.922042 26366 raft_consensus.cc:385] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.923346 26366 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.924109 26366 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.924877 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:29.925613 26172 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.926520 26367 tablet_bootstrap.cc:492] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:29.927099 26367 ts_tablet_manager.cc:1403] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.014s
I20260709 13:09:29.928637 26406 consensus_queue.cc:1048] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.929622 26069 catalog_manager.cc:5697] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 1 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.931452 26366 ts_tablet_manager.cc:1434] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:29.932590 26367 raft_consensus.cc:359] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.933286 26367 raft_consensus.cc:385] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.933837 26367 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.934707 26367 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.936841 26367 ts_tablet_manager.cc:1434] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:29.937814 26367 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:29.937594 26406 consensus_queue.cc:1048] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.942588 26320 raft_consensus.cc:2468] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 1.
I20260709 13:09:29.943848 26211 leader_election.cc:304] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 0b33edf68fa349a6998824635f987b74
I20260709 13:09:29.944689 26416 raft_consensus.cc:2804] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.945246 26416 raft_consensus.cc:697] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:29.946465 26416 consensus_queue.cc:237] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:29.950934 26367 tablet_bootstrap.cc:654] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.952710 26321 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 1.
I20260709 13:09:29.965324 26211 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:29.964485 26172 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 1.
I20260709 13:09:29.969030 26416 raft_consensus.cc:2804] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.975275 26416 raft_consensus.cc:697] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:29.979102 26068 catalog_manager.cc:5697] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 1 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.983922 26248 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.976205 26416 consensus_queue.cc:237] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:30.005687 26399 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.015362 26367 tablet_bootstrap.cc:492] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:30.015904 26367 ts_tablet_manager.cc:1403] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.012s
I20260709 13:09:30.021572 26367 raft_consensus.cc:359] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.022332 26367 raft_consensus.cc:385] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.022595 26367 raft_consensus.cc:740] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.018420 26399 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:30.023373 26367 consensus_queue.cc:260] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.025656 26367 ts_tablet_manager.cc:1434] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:30.026584 26367 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: Bootstrap starting.
I20260709 13:09:30.027951 26370 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.048882 26367 tablet_bootstrap.cc:654] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.069258 26070 catalog_manager.cc:5697] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 1 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.093945 26367 tablet_bootstrap.cc:492] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: No bootstrap required, opened a new log
I20260709 13:09:30.094549 26367 ts_tablet_manager.cc:1403] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.012s
I20260709 13:09:30.097772 26367 raft_consensus.cc:359] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.098482 26367 raft_consensus.cc:385] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.098762 26367 raft_consensus.cc:740] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.099977 26367 consensus_queue.cc:260] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.102583 26393 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.103825 26367 ts_tablet_manager.cc:1434] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:30.137293 26393 raft_consensus.cc:493] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.137840 26393 raft_consensus.cc:515] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.139873 26393 leader_election.cc:290] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:30.141062 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:30.141067 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:30.142127 26247 raft_consensus.cc:2393] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb94504b61ff46f29a0b2a0b092a003a in current term 1: Already voted for candidate 0b33edf68fa349a6998824635f987b74 in this term.
I20260709 13:09:30.143105 26286 leader_election.cc:304] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb94504b61ff46f29a0b2a0b092a003a; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74
I20260709 13:09:30.143779 26393 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.149199 26393 raft_consensus.cc:2749] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.161389 26393 raft_consensus.cc:493] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.161959 26393 raft_consensus.cc:515] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.163869 26393 leader_election.cc:290] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:30.165091 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:30.165211 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74" is_pre_election: true
I20260709 13:09:30.165740 26247 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:30.165866 26170 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 0.
I20260709 13:09:30.166780 26286 leader_election.cc:304] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.167474 26393 raft_consensus.cc:2804] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.167858 26393 raft_consensus.cc:493] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.168151 26393 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.173413 26393 raft_consensus.cc:515] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.175247 26393 leader_election.cc:290] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:30.176222 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:30.176314 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.176769 26170 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.176908 26247 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.181998 26170 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:30.183240 26285 leader_election.cc:304] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.183976 26393 raft_consensus.cc:2804] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.184000 26247 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 1.
I20260709 13:09:30.184486 26393 raft_consensus.cc:697] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:30.185963 26393 consensus_queue.cc:237] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.194401 26070 catalog_manager.cc:5697] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 0 to 1, leader changed from <none> to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 1 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.227845 26374 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.228436 26374 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.230436 26374 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.231460 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:30.231561 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:30.232447 26320 raft_consensus.cc:2393] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b33edf68fa349a6998824635f987b74 in current term 1: Already voted for candidate 00e7cdcc3d394db99ef6ece47daa7beb in this term.
I20260709 13:09:30.233740 26136 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b33edf68fa349a6998824635f987b74; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:30.234630 26374 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.238124 26410 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.240953 26374 raft_consensus.cc:2749] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.250520 26170 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.259024 26420 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.288239 26374 consensus_queue.cc:1048] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.302814 26400 consensus_queue.cc:1048] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.364317 26400 raft_consensus.cc:493] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.364915 26400 raft_consensus.cc:515] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.367698 26400 leader_election.cc:290] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.368167 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" is_pre_election: true
I20260709 13:09:30.368309 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a" is_pre_election: true
I20260709 13:09:30.369143 26320 raft_consensus.cc:2393] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b33edf68fa349a6998824635f987b74 in current term 1: Already voted for candidate 00e7cdcc3d394db99ef6ece47daa7beb in this term.
I20260709 13:09:30.370321 26136 leader_election.cc:304] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b33edf68fa349a6998824635f987b74; no voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:30.371062 26400 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.379385 26400 raft_consensus.cc:2749] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.384364 26420 consensus_queue.cc:1048] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.400549 26420 consensus_queue.cc:1048] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.430521 26420 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.445827 26416 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.452772 26247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59914
I20260709 13:09:30.453608 26247 raft_consensus.cc:606] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:30.455778 26416 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.461423 26247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59914
I20260709 13:09:30.464077 26247 raft_consensus.cc:606] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:30.470259 26247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59914
I20260709 13:09:30.471258 26247 raft_consensus.cc:606] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:30.497324 26320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:50786
I20260709 13:09:30.497939 26320 raft_consensus.cc:606] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:30.502236 26420 raft_consensus.cc:993] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.502691 26420 raft_consensus.cc:1081] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.505589 26170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:30.508838 26170 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.509264 26170 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.513459 26420 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.520826 26170 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:30.550345 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:30.550345 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.551312 26320 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.551359 26247 raft_consensus.cc:3055] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.551903 26247 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:30.552778 26247 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:30.553813 26170 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Requested vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:30.554479 26247 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.559131 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:34966
I20260709 13:09:30.559780 26170 raft_consensus.cc:606] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:30.560647 26247 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.562289 26137 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:30.563127 26400 raft_consensus.cc:2804] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.563633 26400 raft_consensus.cc:697] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:30.564502 26400 consensus_queue.cc:237] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:30.564960 26320 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.570922 26320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:50786
I20260709 13:09:30.571719 26320 raft_consensus.cc:606] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:30.574534 26070 catalog_manager.cc:5697] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 1 to 2, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.578604 26320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:50786
I20260709 13:09:30.579236 26320 raft_consensus.cc:606] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:30.588725 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:34966
I20260709 13:09:30.589289 26170 raft_consensus.cc:606] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Received request to transfer leadership to TS eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:30.675503 26370 raft_consensus.cc:993] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.676031 26370 raft_consensus.cc:1081] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.677839 26170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34950
I20260709 13:09:30.678458 26170 raft_consensus.cc:493] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.678860 26170 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.686475 26170 raft_consensus.cc:515] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.688690 26170 leader_election.cc:290] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.689863 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.689910 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:30.690670 26247 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.690724 26320 raft_consensus.cc:3055] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.691218 26320 raft_consensus.cc:740] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:30.692080 26320 consensus_queue.cc:260] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.693360 26320 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.698352 26247 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.699764 26137 leader_election.cc:304] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:30.700616 26320 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.700657 26400 raft_consensus.cc:2804] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.701252 26400 raft_consensus.cc:697] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:30.702157 26400 consensus_queue.cc:237] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.708643 26416 raft_consensus.cc:993] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.709162 26416 raft_consensus.cc:1081] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.711064 26170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:30.711786 26170 raft_consensus.cc:493] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.711071 26067 catalog_manager.cc:5697] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 1 to 2, leader changed from eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.712148 26170 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.719528 26170 raft_consensus.cc:515] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.721740 26170 leader_election.cc:290] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.722972 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.723575 26247 raft_consensus.cc:3055] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.723891 26247 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:30.724747 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:30.724709 26247 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.725255 26320 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.726045 26247 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.731307 26320 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.732918 26136 leader_election.cc:304] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.733099 26247 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.733841 26400 raft_consensus.cc:2804] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.734462 26400 raft_consensus.cc:697] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:30.735183 26400 consensus_queue.cc:237] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.743290 26067 catalog_manager.cc:5697] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 1 to 2, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.797698 26450 consensus_queue.cc:1048] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.805197 26370 raft_consensus.cc:993] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:30.805687 26370 raft_consensus.cc:1081] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:30.814110 26450 consensus_queue.cc:1048] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.818746 26247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59886
I20260709 13:09:30.819365 26247 raft_consensus.cc:493] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.819741 26247 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.832039 26247 raft_consensus.cc:515] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.836530 26320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:30.837157 26320 raft_consensus.cc:3055] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.837519 26320 raft_consensus.cc:740] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:30.837567 26247 leader_election.cc:290] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.838495 26320 consensus_queue.cc:260] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.839502 26320 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.844766 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed64bc0d2c4cbb83dc5607a9e0ca71" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:30.845396 26172 raft_consensus.cc:3060] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.846987 26399 raft_consensus.cc:993] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: : Instructing follower eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:30.847424 26399 raft_consensus.cc:1081] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Signalling peer eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:30.849074 26321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:50768
I20260709 13:09:30.849606 26321 raft_consensus.cc:493] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.849956 26321 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.852288 26320 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:30.853253 26172 raft_consensus.cc:2468] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:30.853619 26211 leader_election.cc:304] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.855190 26416 raft_consensus.cc:2804] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.855674 26416 raft_consensus.cc:697] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:30.856541 26416 consensus_queue.cc:237] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.864028 26321 raft_consensus.cc:515] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.866101 26070 catalog_manager.cc:5697] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 1 to 2, leader changed from eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 2 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.866868 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:30.867226 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517bc1bc97f4417c8154eb831711c62e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.867731 26172 raft_consensus.cc:3055] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.868201 26321 leader_election.cc:290] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 2 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:30.868268 26172 raft_consensus.cc:740] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:30.867760 26247 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.869383 26172 consensus_queue.cc:260] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.872047 26172 raft_consensus.cc:3060] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.879791 26247 raft_consensus.cc:2468] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 2.
I20260709 13:09:30.879786 26172 raft_consensus.cc:2468] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 2.
I20260709 13:09:30.881282 26285 leader_election.cc:304] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.882197 26450 raft_consensus.cc:2804] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.882771 26450 raft_consensus.cc:697] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 2 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:30.883553 26450 consensus_queue.cc:237] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.888548 26420 raft_consensus.cc:993] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.889060 26420 raft_consensus.cc:1081] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:30.891530 26170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:30.892139 26170 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.892491 26170 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.893851 26067 catalog_manager.cc:5697] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 1 to 2, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 2 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.900030 26170 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.903174 26170 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:30.903491 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:30.904117 26321 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.904431 26247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:30.905028 26247 raft_consensus.cc:3055] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:30.905352 26247 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:30.906193 26247 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.907480 26247 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:30.911638 26321 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.912783 26136 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:30.913726 26399 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:30.914266 26399 raft_consensus.cc:697] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:30.915235 26399 consensus_queue.cc:237] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:30.920531 26247 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 2.
I20260709 13:09:30.923470 26067 catalog_manager.cc:5697] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 1 to 2, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.992741 26321 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:30.994370 26399 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.005278 26247 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.007902 26455 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.021206 26399 raft_consensus.cc:993] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:31.021692 26400 raft_consensus.cc:1081] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:31.023321 26247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:09:31.023905 26247 raft_consensus.cc:493] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.024289 26247 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.031481 26247 raft_consensus.cc:515] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.033546 26247 leader_election.cc:290] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:31.034529 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:31.034868 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:31.035189 26170 raft_consensus.cc:3055] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.035513 26321 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.035601 26170 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:31.036465 26170 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.037408 26170 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.042832 26170 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:31.042768 26321 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:31.044147 26211 leader_election.cc:304] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:31.045096 26416 raft_consensus.cc:2804] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.045571 26416 raft_consensus.cc:697] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:31.046434 26416 consensus_queue.cc:237] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.055012 26067 catalog_manager.cc:5697] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 1 to 2, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 2 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.095026 26321 raft_consensus.cc:1275] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.096654 26400 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.108633 26247 raft_consensus.cc:1275] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.114094 26455 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:31.149962 26370 raft_consensus.cc:993] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:31.150496 26450 raft_consensus.cc:1081] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:31.152117 26247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59886
I20260709 13:09:31.152772 26247 raft_consensus.cc:493] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.153115 26247 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.160049 26247 raft_consensus.cc:515] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.162307 26247 leader_election.cc:290] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:31.163322 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:31.163704 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:31.163961 26170 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.164315 26321 raft_consensus.cc:3055] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:31.164651 26321 raft_consensus.cc:740] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:31.165445 26321 consensus_queue.cc:260] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.166728 26321 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:31.169597 26170 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:31.170763 26211 leader_election.cc:304] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:31.171597 26416 raft_consensus.cc:2804] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:31.172031 26416 raft_consensus.cc:697] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:31.172751 26416 consensus_queue.cc:237] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:31.173092 26321 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 2.
I20260709 13:09:31.179651 26070 catalog_manager.cc:5697] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 1 to 2, leader changed from eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 2 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.309041 26321 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.310689 26400 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.311260 26247 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.312683 26400 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.318835 26320 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.322026 26455 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.324259 26321 raft_consensus.cc:1275] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.329953 26246 raft_consensus.cc:1275] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.330641 26420 consensus_queue.cc:1048] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.331883 26450 consensus_queue.cc:1048] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.342639 26246 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.344995 26400 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:31.352417 26170 raft_consensus.cc:1275] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.354276 26420 consensus_queue.cc:1048] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:31.371829 26170 raft_consensus.cc:1275] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.374145 26370 consensus_queue.cc:1048] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.523447 26322 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.524921 26420 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.533677 26170 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.535961 26420 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.594949 26322 raft_consensus.cc:1275] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.596374 26420 consensus_queue.cc:1048] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:31.605229 26170 raft_consensus.cc:1275] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:31.606788 26410 consensus_queue.cc:1048] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:33.621274 26038 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:09:33.622303 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.655321 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:34974
I20260709 13:09:33.656263 26170 raft_consensus.cc:606] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Received request to transfer leadership to TS eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:33.673034 26246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:33.673614 26246 raft_consensus.cc:606] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Received request to transfer leadership to TS eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:33.675100 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:33.675822 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:33.761606 26416 raft_consensus.cc:993] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:33.762183 26479 raft_consensus.cc:1081] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Signalling peer eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:33.763725 26322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:09:33.764286 26322 raft_consensus.cc:493] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.764624 26322 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.769762 26322 raft_consensus.cc:515] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:33.772043 26322 leader_election.cc:290] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 3 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:33.772969 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:33.773475 26170 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.773370 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:33.773895 26246 raft_consensus.cc:3055] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:33.774253 26246 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:33.774979 26246 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:33.776011 26246 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.778002 26170 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 3.
I20260709 13:09:33.779081 26285 leader_election.cc:304] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:33.779811 26473 raft_consensus.cc:2804] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:33.781052 26473 raft_consensus.cc:697] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:33.781554 26246 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 3.
I20260709 13:09:33.781865 26473 consensus_queue.cc:237] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:33.790817 26069 catalog_manager.cc:5697] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 2 to 3, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 3 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.114642 26461 raft_consensus.cc:993] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: : Instructing follower eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:34.115135 26486 raft_consensus.cc:1081] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Signalling peer eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:34.116901 26322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:50768
I20260709 13:09:34.117396 26322 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.117661 26322 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.122645 26322 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.124477 26322 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 3 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:34.125386 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:34.125629 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:34.125983 26170 raft_consensus.cc:3055] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:34.126248 26246 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.126354 26170 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:34.127243 26170 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.128269 26170 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.132284 26246 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 3.
I20260709 13:09:34.133430 26286 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:34.134122 26170 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 3.
I20260709 13:09:34.135988 26473 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:34.136510 26473 raft_consensus.cc:697] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:34.137414 26473 consensus_queue.cc:237] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.145712 26069 catalog_manager.cc:5697] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 2 to 3, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 3 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.172356 26246 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.174182 26473 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.185349 26170 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.186888 26473 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.528355 26246 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.529716 26473 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.538436 26170 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.539917 26473 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.676791 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.687579 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:34966
I20260709 13:09:34.688102 26170 raft_consensus.cc:606] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:34.692857 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:34966
I20260709 13:09:34.693292 26170 raft_consensus.cc:606] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:34.697990 26322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:50786
I20260709 13:09:34.698583 26322 raft_consensus.cc:606] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:34.703217 26170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:34966
I20260709 13:09:34.703711 26170 raft_consensus.cc:606] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:34.708186 26322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
mode: GRACEFUL
new_leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:50786
I20260709 13:09:34.708765 26322 raft_consensus.cc:606] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Received request to transfer leadership to TS 00e7cdcc3d394db99ef6ece47daa7beb
I20260709 13:09:34.861855 26486 raft_consensus.cc:993] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:34.862352 26496 raft_consensus.cc:1081] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:34.863876 26246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:09:34.864339 26246 raft_consensus.cc:493] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.864607 26246 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.870191 26246 raft_consensus.cc:515] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.872231 26246 leader_election.cc:290] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:34.872864 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:34.873245 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866231f7085a44b2b57f1fff9c4f83d1" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:34.873461 26170 raft_consensus.cc:3055] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:34.873752 26170 raft_consensus.cc:740] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:34.873826 26322 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.874593 26170 consensus_queue.cc:260] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.875749 26170 raft_consensus.cc:3060] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.880705 26322 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:34.882277 26211 leader_election.cc:304] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:34.882560 26170 raft_consensus.cc:2468] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:34.883092 26479 raft_consensus.cc:2804] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:34.884416 26479 raft_consensus.cc:697] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:34.885309 26479 consensus_queue.cc:237] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.892635 26067 catalog_manager.cc:5697] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 2 to 3, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 3 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.903878 26486 raft_consensus.cc:993] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:34.904379 26496 raft_consensus.cc:1081] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:34.905714 26248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:09:34.906263 26248 raft_consensus.cc:493] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.906585 26248 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.911772 26248 raft_consensus.cc:515] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.913640 26248 leader_election.cc:290] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:34.914664 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:34.914891 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:34.915194 26172 raft_consensus.cc:3055] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:34.915509 26172 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:34.915546 26322 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.916316 26172 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.917281 26172 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.920907 26322 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:34.921892 26211 leader_election.cc:304] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:34.922238 26172 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:34.922705 26479 raft_consensus.cc:2804] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:34.923215 26479 raft_consensus.cc:697] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:34.924080 26479 consensus_queue.cc:237] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:34.931543 26067 catalog_manager.cc:5697] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 2 to 3, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 3 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.068670 26494 raft_consensus.cc:993] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.069181 26473 raft_consensus.cc:1081] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.070789 26248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59886
I20260709 13:09:35.071329 26248 raft_consensus.cc:493] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.071679 26248 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.077137 26248 raft_consensus.cc:515] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.078902 26248 leader_election.cc:290] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 4 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:35.079674 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:35.079917 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af435c3b50444ac78ecac69a69866b84" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:35.080299 26172 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.080461 26322 raft_consensus.cc:3055] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:35.080842 26322 raft_consensus.cc:740] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:35.081606 26322 consensus_queue.cc:260] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.082830 26322 raft_consensus.cc:3060] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.085651 26486 raft_consensus.cc:993] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.086156 26496 raft_consensus.cc:1081] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.087276 26172 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 4.
I20260709 13:09:35.087914 26248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59898
I20260709 13:09:35.088502 26248 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.088415 26211 leader_election.cc:304] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:35.088907 26322 raft_consensus.cc:2468] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 4.
I20260709 13:09:35.088925 26248 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.089300 26479 raft_consensus.cc:2804] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.090566 26479 raft_consensus.cc:697] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:35.091243 26479 consensus_queue.cc:237] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.094664 26248 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:35.096853 26248 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Requested vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533)
I20260709 13:09:35.097388 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:35.097890 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:35.098086 26322 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.098491 26172 raft_consensus.cc:3055] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:35.098822 26172 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:35.098953 26067 catalog_manager.cc:5697] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 3 to 4, leader changed from eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 4 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.099712 26172 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:35.101601 26172 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.103451 26473 raft_consensus.cc:993] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: : Instructing follower 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.103883 26473 raft_consensus.cc:1081] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Signalling peer 00e7cdcc3d394db99ef6ece47daa7beb to start an election
I20260709 13:09:35.105427 26248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
 from {username='slave'} at 127.0.0.1:59886
I20260709 13:09:35.106063 26248 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.106520 26248 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.110131 26322 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:35.110457 26172 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 3.
I20260709 13:09:35.111214 26211 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:35.112012 26479 raft_consensus.cc:2804] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.112504 26479 raft_consensus.cc:697] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:35.113204 26248 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.113231 26479 consensus_queue.cc:237] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:35.115795 26248 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 4 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:35.116482 26172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:35.116940 26322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:35.117126 26172 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.117549 26322 raft_consensus.cc:3055] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:35.117878 26322 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:35.118723 26322 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.119956 26322 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.124354 26172 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 4.
I20260709 13:09:35.125770 26211 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e7cdcc3d394db99ef6ece47daa7beb, 0b33edf68fa349a6998824635f987b74; no voters: 
I20260709 13:09:35.126813 26497 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:35.127312 26497 raft_consensus.cc:697] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Becoming Leader. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:35.127574 26322 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e7cdcc3d394db99ef6ece47daa7beb in term 4.
I20260709 13:09:35.128296 26497 consensus_queue.cc:237] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:35.129808 26067 catalog_manager.cc:5697] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 2 to 3, leader changed from 0b33edf68fa349a6998824635f987b74 (127.25.109.129) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 3 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.141604 26067 catalog_manager.cc:5697] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb reported cstate change: term changed from 3 to 4, leader changed from eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131) to 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130). New cstate: current_term: 4 leader_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.320030 26172 raft_consensus.cc:1275] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.321317 26497 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.332039 26322 raft_consensus.cc:1275] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.334818 26498 consensus_queue.cc:1048] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.335062 26322 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.337636 26497 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.348861 26172 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.350384 26497 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.480726 26172 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.482157 26497 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:35.494468 26321 raft_consensus.cc:1275] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.496134 26497 consensus_queue.cc:1048] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:35.558688 26170 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.558688 26321 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.560307 26497 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:35.560626 26513 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:35.572129 26322 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:35.573637 26497 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:35.581774 26170 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Refusing update from remote peer 00e7cdcc3d394db99ef6ece47daa7beb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:35.583489 26497 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:37.721676 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.729789 26248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:37.730638 26248 raft_consensus.cc:606] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:37.733565 26248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:37.734104 26248 raft_consensus.cc:606] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Received request to transfer leadership to TS eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:37.736418 26248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:37.736893 26248 raft_consensus.cc:606] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:37.739174 26248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:37.739640 26248 raft_consensus.cc:606] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Received request to transfer leadership to TS 0b33edf68fa349a6998824635f987b74
I20260709 13:09:37.741719 26248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
mode: GRACEFUL
new_leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:59916
I20260709 13:09:37.742182 26248 raft_consensus.cc:606] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Received request to transfer leadership to TS eb94504b61ff46f29a0b2a0b092a003a
I20260709 13:09:37.743183 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:37.743643 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.941128 26513 raft_consensus.cc:993] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:37.941829 26521 raft_consensus.cc:1081] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Signalling peer eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:37.943414 26321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:09:37.943886 26321 raft_consensus.cc:493] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.944177 26321 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.950028 26321 raft_consensus.cc:515] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:37.952165 26321 leader_election.cc:290] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 4 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:37.953357 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:37.953364 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33b601169d44d23b2ff90275bd5f978" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:37.954242 26170 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.954283 26248 raft_consensus.cc:3055] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:37.954677 26248 raft_consensus.cc:740] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:37.955477 26248 consensus_queue.cc:260] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:37.956591 26248 raft_consensus.cc:3060] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.959404 26170 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 4.
I20260709 13:09:37.960719 26285 leader_election.cc:304] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:37.961615 26494 raft_consensus.cc:2804] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.962278 26248 raft_consensus.cc:2468] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 4.
I20260709 13:09:37.962808 26494 raft_consensus.cc:697] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 4 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:37.963924 26494 consensus_queue.cc:237] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:37.971311 26069 catalog_manager.cc:5697] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 3 to 4, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 4 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.075387 26513 raft_consensus.cc:993] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:38.075963 26521 raft_consensus.cc:1081] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Signalling peer eb94504b61ff46f29a0b2a0b092a003a to start an election
I20260709 13:09:38.077587 26321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e"
dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
 from {username='slave'} at 127.0.0.1:50776
I20260709 13:09:38.078192 26321 raft_consensus.cc:493] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.078469 26321 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.083796 26321 raft_consensus.cc:515] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.085275 26321 leader_election.cc:290] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 2 election: Requested vote from peers 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:38.086231 26170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b33edf68fa349a6998824635f987b74"
I20260709 13:09:38.086398 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "458da3585fa3444bb39d7ce1912cdc8e" candidate_uuid: "eb94504b61ff46f29a0b2a0b092a003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:38.086875 26170 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.087005 26248 raft_consensus.cc:3055] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.087407 26248 raft_consensus.cc:740] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:38.088268 26248 consensus_queue.cc:260] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.089332 26513 raft_consensus.cc:993] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.089697 26248 raft_consensus.cc:3060] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.089807 26521 raft_consensus.cc:1081] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.091749 26172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:38.092353 26172 raft_consensus.cc:493] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.092710 26172 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.093487 26170 raft_consensus.cc:2468] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 2.
I20260709 13:09:38.094488 26285 leader_election.cc:304] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:38.095316 26494 raft_consensus.cc:2804] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.095847 26494 raft_consensus.cc:697] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 2 LEADER]: Becoming Leader. State: Replica: eb94504b61ff46f29a0b2a0b092a003a, State: Running, Role: LEADER
I20260709 13:09:38.096772 26494 consensus_queue.cc:237] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.097702 26248 raft_consensus.cc:2468] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb94504b61ff46f29a0b2a0b092a003a in term 2.
I20260709 13:09:38.100622 26172 raft_consensus.cc:515] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.103144 26172 leader_election.cc:290] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 5 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:38.104285 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:38.104440 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c16a807a3b43338fc69ae78fc21ed8" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:38.105048 26321 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.105036 26248 raft_consensus.cc:3055] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:38.105614 26248 raft_consensus.cc:740] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:38.106264 26069 catalog_manager.cc:5697] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a reported cstate change: term changed from 1 to 2, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131). New cstate: current_term: 2 leader_uuid: "eb94504b61ff46f29a0b2a0b092a003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.106626 26248 consensus_queue.cc:260] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.108186 26248 raft_consensus.cc:3060] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.113046 26321 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 5.
I20260709 13:09:38.114728 26136 leader_election.cc:304] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:38.116742 26529 raft_consensus.cc:2804] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:38.118158 26529 raft_consensus.cc:697] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 5 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:38.118294 26248 raft_consensus.cc:2468] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 5.
I20260709 13:09:38.119032 26529 consensus_queue.cc:237] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.126595 26069 catalog_manager.cc:5697] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 4 to 5, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 5 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.280158 26513 raft_consensus.cc:993] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.280637 26521 raft_consensus.cc:1081] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.282132 26172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:38.282590 26172 raft_consensus.cc:493] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.282846 26172 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.288414 26172 raft_consensus.cc:515] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.289373 26513 raft_consensus.cc:993] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: : Instructing follower 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.289856 26521 raft_consensus.cc:1081] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Signalling peer 0b33edf68fa349a6998824635f987b74 to start an election
I20260709 13:09:38.291031 26172 leader_election.cc:290] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 3 election: Requested vote from peers 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585), eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687)
I20260709 13:09:38.291520 26170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d446fefe504403a71198481e52d8f9"
dest_uuid: "0b33edf68fa349a6998824635f987b74"
 from {username='slave'} at 127.0.0.1:34960
I20260709 13:09:38.291605 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:38.292028 26170 raft_consensus.cc:493] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.291249 26248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222bfe4c7cd3473ea8a1dcf191f36100" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:38.292295 26321 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.292564 26170 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.292687 26248 raft_consensus.cc:3055] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.293026 26248 raft_consensus.cc:740] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:38.294117 26248 consensus_queue.cc:260] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.295341 26248 raft_consensus.cc:3060] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.297879 26321 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 3.
I20260709 13:09:38.298960 26136 leader_election.cc:304] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:38.299242 26170 raft_consensus.cc:515] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:38.299819 26529 raft_consensus.cc:2804] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.300374 26529 raft_consensus.cc:697] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:38.301261 26529 consensus_queue.cc:237] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } }
I20260709 13:09:38.302004 26248 raft_consensus.cc:2468] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 3.
I20260709 13:09:38.302250 26321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb94504b61ff46f29a0b2a0b092a003a"
I20260709 13:09:38.302691 26246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d446fefe504403a71198481e52d8f9" candidate_uuid: "0b33edf68fa349a6998824635f987b74" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00e7cdcc3d394db99ef6ece47daa7beb"
I20260709 13:09:38.302984 26321 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.303325 26246 raft_consensus.cc:3055] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:38.303675 26246 raft_consensus.cc:740] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00e7cdcc3d394db99ef6ece47daa7beb, State: Running, Role: LEADER
I20260709 13:09:38.303854 26170 leader_election.cc:290] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 4 election: Requested vote from peers eb94504b61ff46f29a0b2a0b092a003a (127.25.109.131:44687), 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130:33585)
I20260709 13:09:38.304549 26246 consensus_queue.cc:260] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:38.305742 26246 raft_consensus.cc:3060] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.308842 26321 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 4.
I20260709 13:09:38.310207 26136 leader_election.cc:304] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b33edf68fa349a6998824635f987b74, eb94504b61ff46f29a0b2a0b092a003a; no voters: 
I20260709 13:09:38.311088 26529 raft_consensus.cc:2804] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:38.311569 26529 raft_consensus.cc:697] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 4 LEADER]: Becoming Leader. State: Replica: 0b33edf68fa349a6998824635f987b74, State: Running, Role: LEADER
I20260709 13:09:38.311962 26069 catalog_manager.cc:5697] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 2 to 3, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 3 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.312526 26529 consensus_queue.cc:237] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } }
I20260709 13:09:38.313486 26246 raft_consensus.cc:2468] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b33edf68fa349a6998824635f987b74 in term 4.
I20260709 13:09:38.325049 26069 catalog_manager.cc:5697] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 reported cstate change: term changed from 3 to 4, leader changed from 00e7cdcc3d394db99ef6ece47daa7beb (127.25.109.130) to 0b33edf68fa349a6998824635f987b74 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "0b33edf68fa349a6998824635f987b74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.389480 26246 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:38.391059 26494 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:38.403592 26170 raft_consensus.cc:1275] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:38.405671 26536 consensus_queue.cc:1048] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:38.569644 26321 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 5 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:38.571017 26529 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:38.572909 26170 raft_consensus.cc:1275] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.574496 26494 consensus_queue.cc:1048] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b33edf68fa349a6998824635f987b74" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 41533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.575415 26246 raft_consensus.cc:1275] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Refusing update from remote peer eb94504b61ff46f29a0b2a0b092a003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.577632 26494 consensus_queue.cc:1048] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.581836 26248 raft_consensus.cc:1275] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 5 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:38.583472 26530 consensus_queue.cc:1048] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:38.695976 26321 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:38.697445 26541 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb94504b61ff46f29a0b2a0b092a003a" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:38.707105 26248 raft_consensus.cc:1275] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Refusing update from remote peer 0b33edf68fa349a6998824635f987b74: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:38.709388 26530 consensus_queue.cc:1048] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e7cdcc3d394db99ef6ece47daa7beb" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:38.744618 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.750423 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
W20260709 13:09:38.754495 26211 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:38.760360 26211 consensus_peers.cc:597] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb -> Peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Couldn't send request to peer 0b33edf68fa349a6998824635f987b74. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.783145 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:38.784116 26038 tablet_replica.cc:333] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.784960 26038 raft_consensus.cc:2243] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.785588 26038 raft_consensus.cc:2272] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.788304 26038 tablet_replica.cc:333] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.788859 26038 raft_consensus.cc:2243] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.789304 26038 raft_consensus.cc:2272] T e33b601169d44d23b2ff90275bd5f978 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.792037 26038 tablet_replica.cc:333] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.792589 26038 raft_consensus.cc:2243] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.793401 26038 raft_consensus.cc:2272] T a0c16a807a3b43338fc69ae78fc21ed8 P 0b33edf68fa349a6998824635f987b74 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.795691 26038 tablet_replica.cc:333] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.796401 26038 raft_consensus.cc:2243] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.797180 26038 raft_consensus.cc:2272] T 84d446fefe504403a71198481e52d8f9 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.799171 26038 tablet_replica.cc:333] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.799767 26038 raft_consensus.cc:2243] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.800230 26038 raft_consensus.cc:2272] T 517bc1bc97f4417c8154eb831711c62e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.802256 26038 tablet_replica.cc:333] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.802731 26038 raft_consensus.cc:2243] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.803151 26038 raft_consensus.cc:2272] T 866231f7085a44b2b57f1fff9c4f83d1 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.804719 26038 tablet_replica.cc:333] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.805220 26038 raft_consensus.cc:2243] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.805619 26038 raft_consensus.cc:2272] T 458da3585fa3444bb39d7ce1912cdc8e P 0b33edf68fa349a6998824635f987b74 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.807588 26038 tablet_replica.cc:333] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.808099 26038 raft_consensus.cc:2243] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.808678 26038 pending_rounds.cc:70] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Trying to abort 1 pending ops.
I20260709 13:09:38.809041 26038 pending_rounds.cc:77] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636160731951104 op_type: NO_OP noop_request { }
I20260709 13:09:38.809428 26038 raft_consensus.cc:2889] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:38.809734 26038 raft_consensus.cc:2272] T 222bfe4c7cd3473ea8a1dcf191f36100 P 0b33edf68fa349a6998824635f987b74 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.811746 26038 tablet_replica.cc:333] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74: stopping tablet replica
I20260709 13:09:38.812242 26038 raft_consensus.cc:2243] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.812772 26038 raft_consensus.cc:2272] T af435c3b50444ac78ecac69a69866b84 P 0b33edf68fa349a6998824635f987b74 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.915838 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
I20260709 13:09:38.937413 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
I20260709 13:09:38.962354 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:38.963222 26038 tablet_replica.cc:333] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.964208 26038 raft_consensus.cc:2243] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.965358 26038 raft_consensus.cc:2272] T af435c3b50444ac78ecac69a69866b84 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.968091 26038 tablet_replica.cc:333] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.968837 26038 raft_consensus.cc:2243] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.970002 26038 raft_consensus.cc:2272] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.972019 26038 tablet_replica.cc:333] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.972606 26038 raft_consensus.cc:2243] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.973047 26038 raft_consensus.cc:2272] T 458da3585fa3444bb39d7ce1912cdc8e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.975992 26038 tablet_replica.cc:333] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.976646 26038 raft_consensus.cc:2243] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.977129 26038 raft_consensus.cc:2272] T 222bfe4c7cd3473ea8a1dcf191f36100 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:38.978530 26285 consensus_peers.cc:597] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a -> Peer 0b33edf68fa349a6998824635f987b74 (127.25.109.129:41533): Couldn't send request to peer 0b33edf68fa349a6998824635f987b74. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:41533: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.979537 26038 tablet_replica.cc:333] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.980091 26038 raft_consensus.cc:2243] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.980461 26038 raft_consensus.cc:2272] T 84d446fefe504403a71198481e52d8f9 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.982455 26038 tablet_replica.cc:333] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.982975 26038 raft_consensus.cc:2243] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.983438 26038 raft_consensus.cc:2272] T 517bc1bc97f4417c8154eb831711c62e P 00e7cdcc3d394db99ef6ece47daa7beb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.985088 26038 tablet_replica.cc:333] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.985544 26038 raft_consensus.cc:2243] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:38.986428 26038 raft_consensus.cc:2272] T 866231f7085a44b2b57f1fff9c4f83d1 P 00e7cdcc3d394db99ef6ece47daa7beb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.988121 26038 tablet_replica.cc:333] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.988591 26038 raft_consensus.cc:2243] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.988997 26038 raft_consensus.cc:2272] T a0c16a807a3b43338fc69ae78fc21ed8 P 00e7cdcc3d394db99ef6ece47daa7beb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:38.991106 26038 tablet_replica.cc:333] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb: stopping tablet replica
I20260709 13:09:38.991565 26038 raft_consensus.cc:2243] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:38.991964 26038 raft_consensus.cc:2272] T e33b601169d44d23b2ff90275bd5f978 P 00e7cdcc3d394db99ef6ece47daa7beb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.012360 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
I20260709 13:09:39.031080 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
I20260709 13:09:39.053740 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:39.054611 26038 tablet_replica.cc:333] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.055601 26038 raft_consensus.cc:2243] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.056126 26038 raft_consensus.cc:2272] T b4ed64bc0d2c4cbb83dc5607a9e0ca71 P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.057946 26038 tablet_replica.cc:333] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.058518 26038 raft_consensus.cc:2243] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:39.059284 26038 raft_consensus.cc:2272] T e33b601169d44d23b2ff90275bd5f978 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.061882 26038 tablet_replica.cc:333] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.062493 26038 raft_consensus.cc:2243] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.062883 26038 raft_consensus.cc:2272] T af435c3b50444ac78ecac69a69866b84 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.064565 26038 tablet_replica.cc:333] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.065021 26038 raft_consensus.cc:2243] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.065407 26038 raft_consensus.cc:2272] T 222bfe4c7cd3473ea8a1dcf191f36100 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.067320 26038 tablet_replica.cc:333] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.067767 26038 raft_consensus.cc:2243] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:39.068450 26038 raft_consensus.cc:2272] T 458da3585fa3444bb39d7ce1912cdc8e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.070531 26038 tablet_replica.cc:333] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.070984 26038 raft_consensus.cc:2243] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.071365 26038 raft_consensus.cc:2272] T a0c16a807a3b43338fc69ae78fc21ed8 P eb94504b61ff46f29a0b2a0b092a003a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.073423 26038 tablet_replica.cc:333] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.073941 26038 raft_consensus.cc:2243] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:39.074780 26038 raft_consensus.cc:2272] T 517bc1bc97f4417c8154eb831711c62e P eb94504b61ff46f29a0b2a0b092a003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.076428 26038 tablet_replica.cc:333] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.076890 26038 raft_consensus.cc:2243] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.077327 26038 raft_consensus.cc:2272] T 84d446fefe504403a71198481e52d8f9 P eb94504b61ff46f29a0b2a0b092a003a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.079223 26038 tablet_replica.cc:333] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a: stopping tablet replica
I20260709 13:09:39.079725 26038 raft_consensus.cc:2243] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:39.080200 26038 raft_consensus.cc:2272] T 866231f7085a44b2b57f1fff9c4f83d1 P eb94504b61ff46f29a0b2a0b092a003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.108176 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:09:39.126897 26038 master.cc:562] Master@127.25.109.190:34079 shutting down...
I20260709 13:09:39.286008 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:39.286816 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:39.287199 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3eb533964fb8458ba0af169a7542aff1: stopping tablet replica
I20260709 13:09:39.307782 26038 master.cc:584] Master@127.25.109.190:34079 shutdown complete.
00e7cdcc3d394db99ef6ece47daa7beb  4
0b33edf68fa349a6998824635f987b74  4
eb94504b61ff46f29a0b2a0b092a003a  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13180 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:09:39.352372 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:35751
I20260709 13:09:39.353703 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.360379 26551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.360966 26550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.361053 26553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.361620 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:39.362610 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.362826 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.363032 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602579363012 us; error 0 us; skew 500 ppm
I20260709 13:09:39.363574 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.366165 26038 webserver.cc:533] Webserver started at http://127.25.109.190:44263/ using document root <none> and password file <none>
I20260709 13:09:39.366775 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.366998 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.367306 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.368510 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "f5c3927ff179423cbd5b2504d1fc27e8"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.373123 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:09:39.376520 26558 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.377408 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:39.377660 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "f5c3927ff179423cbd5b2504d1fc27e8"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.377907 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.396921 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.398447 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.441033 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:35751
I20260709 13:09:39.441123 26609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:35751 every 8 connection(s)
I20260709 13:09:39.445762 26610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:39.456264 26610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8: Bootstrap starting.
I20260709 13:09:39.461378 26610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:39.466019 26610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8: No bootstrap required, opened a new log
I20260709 13:09:39.468327 26610 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER }
I20260709 13:09:39.468768 26610 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:39.469007 26610 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c3927ff179423cbd5b2504d1fc27e8, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.469622 26610 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER }
I20260709 13:09:39.470130 26610 raft_consensus.cc:399] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:39.470366 26610 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:39.470643 26610 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:39.475142 26610 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER }
I20260709 13:09:39.475683 26610 leader_election.cc:304] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5c3927ff179423cbd5b2504d1fc27e8; no voters: 
I20260709 13:09:39.476881 26610 leader_election.cc:290] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:39.477339 26613 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:39.478823 26613 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 1 LEADER]: Becoming Leader. State: Replica: f5c3927ff179423cbd5b2504d1fc27e8, State: Running, Role: LEADER
I20260709 13:09:39.479460 26613 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER }
I20260709 13:09:39.480086 26610 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:39.484202 26614 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER } }
I20260709 13:09:39.484766 26614 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:39.486075 26615 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5c3927ff179423cbd5b2504d1fc27e8. Latest consensus state: current_term: 1 leader_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c3927ff179423cbd5b2504d1fc27e8" member_type: VOTER } }
I20260709 13:09:39.486646 26615 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:39.488039 26620 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:39.496681 26620 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:39.497776 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:39.505859 26620 catalog_manager.cc:1383] Generated new cluster ID: 9f3283e030d14563bbccf3f602f20fcf
I20260709 13:09:39.506234 26620 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:39.518884 26620 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:39.520205 26620 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:39.534201 26620 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8: Generated new TSK 0
I20260709 13:09:39.534839 26620 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:39.564564 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.571194 26631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.572402 26632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.574528 26038 server_base.cc:1061] running on GCE node
W20260709 13:09:39.575052 26634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.575919 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.576153 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.576332 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602579576293 us; error 0 us; skew 500 ppm
I20260709 13:09:39.576887 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.579383 26038 webserver.cc:533] Webserver started at http://127.25.109.129:33401/ using document root <none> and password file <none>
I20260709 13:09:39.580000 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.580260 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.580569 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.581884 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "046c6c360b2343a380f2deef798afb4f"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.586575 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:39.590023 26639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.590924 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:39.591217 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "046c6c360b2343a380f2deef798afb4f"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.591531 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.613816 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.615316 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.616968 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.619446 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.619676 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.619918 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.620136 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.664258 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:34981
I20260709 13:09:39.664359 26701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:34981 every 8 connection(s)
I20260709 13:09:39.669701 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.677032 26706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.678696 26707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.682344 26038 server_base.cc:1061] running on GCE node
W20260709 13:09:39.682214 26709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.683966 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:39.684262 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.684489 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602579684465 us; error 0 us; skew 500 ppm
I20260709 13:09:39.685075 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.687938 26702 heartbeater.cc:344] Connected to a master server at 127.25.109.190:35751
I20260709 13:09:39.688122 26038 webserver.cc:533] Webserver started at http://127.25.109.130:37479/ using document root <none> and password file <none>
I20260709 13:09:39.688344 26702 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.688774 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.689019 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.689271 26702 heartbeater.cc:507] Master 127.25.109.190:35751 requested a full tablet report, sending...
I20260709 13:09:39.689309 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.691244 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "03081ad4fd0045f6b871faeef2b8ace0"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.691927 26575 ts_manager.cc:194] Registered new tserver with Master: 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981)
I20260709 13:09:39.694602 26575 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60578
I20260709 13:09:39.697746 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:39.701243 26714 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.702128 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:39.702427 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "03081ad4fd0045f6b871faeef2b8ace0"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.702782 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.721256 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.722718 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.724287 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.726676 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.726955 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.727216 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.727393 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.770260 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:43833
I20260709 13:09:39.770370 26776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:43833 every 8 connection(s)
I20260709 13:09:39.775334 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:39.783376 26780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:39.784253 26781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.786761 26038 server_base.cc:1061] running on GCE node
W20260709 13:09:39.786968 26783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:39.788517 26777 heartbeater.cc:344] Connected to a master server at 127.25.109.190:35751
I20260709 13:09:39.788810 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:39.788923 26777 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:39.789098 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:39.789331 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602579789310 us; error 0 us; skew 500 ppm
I20260709 13:09:39.789943 26777 heartbeater.cc:507] Master 127.25.109.190:35751 requested a full tablet report, sending...
I20260709 13:09:39.790161 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:39.792555 26575 ts_manager.cc:194] Registered new tserver with Master: 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:39.793030 26038 webserver.cc:533] Webserver started at http://127.25.109.131:43689/ using document root <none> and password file <none>
I20260709 13:09:39.793659 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:39.793876 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:39.794215 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:39.794312 26575 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60586
I20260709 13:09:39.795713 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "c4bd782d54644072b2d9d8508688f416"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.800318 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:39.803717 26788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.804648 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:39.804903 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "c4bd782d54644072b2d9d8508688f416"
format_stamp: "Formatted at 2026-07-09 13:09:39 on dist-test-slave-zhdc"
I20260709 13:09:39.805169 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:39.819832 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:39.821115 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:39.822690 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:39.825055 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:39.825235 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.825532 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:39.825698 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:39.869639 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:45269
I20260709 13:09:39.869746 26850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:45269 every 8 connection(s)
I20260709 13:09:39.884639 26851 heartbeater.cc:344] Connected to a master server at 127.25.109.190:35751
I20260709 13:09:39.885043 26851 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:39.885869 26851 heartbeater.cc:507] Master 127.25.109.190:35751 requested a full tablet report, sending...
I20260709 13:09:39.887845 26575 ts_manager.cc:194] Registered new tserver with Master: c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:39.888643 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015535766s
I20260709 13:09:39.889288 26575 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60594
I20260709 13:09:39.915099 26575 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60598:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:39.918282 26575 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:40.005987 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 2765c4610c6a406ba8cc6243db77a837 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:40.006770 26741 tablet_service.cc:1511] Processing CreateTablet for tablet 58bd8f8d10294a4985cf1eb920edf872 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:40.007700 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2765c4610c6a406ba8cc6243db77a837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.008348 26741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bd8f8d10294a4985cf1eb920edf872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.009187 26740 tablet_service.cc:1511] Processing CreateTablet for tablet db31770e8a404036be5d7439d4fb93b8 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:40.010938 26740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31770e8a404036be5d7439d4fb93b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.016849 26739 tablet_service.cc:1511] Processing CreateTablet for tablet b8711af7272a496f8f539685ff348541 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:40.018316 26739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8711af7272a496f8f539685ff348541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.030211 26667 tablet_service.cc:1511] Processing CreateTablet for tablet 2765c4610c6a406ba8cc6243db77a837 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:40.031764 26667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2765c4610c6a406ba8cc6243db77a837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.036603 26665 tablet_service.cc:1511] Processing CreateTablet for tablet db31770e8a404036be5d7439d4fb93b8 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:40.038192 26665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31770e8a404036be5d7439d4fb93b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.038251 26666 tablet_service.cc:1511] Processing CreateTablet for tablet 58bd8f8d10294a4985cf1eb920edf872 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:40.039742 26666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bd8f8d10294a4985cf1eb920edf872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.040082 26866 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.042799 26664 tablet_service.cc:1511] Processing CreateTablet for tablet b8711af7272a496f8f539685ff348541 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:40.044425 26664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8711af7272a496f8f539685ff348541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.047505 26866 tablet_bootstrap.cc:654] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.047636 26816 tablet_service.cc:1511] Processing CreateTablet for tablet 2765c4610c6a406ba8cc6243db77a837 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:40.049162 26816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2765c4610c6a406ba8cc6243db77a837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.053114 26815 tablet_service.cc:1511] Processing CreateTablet for tablet 58bd8f8d10294a4985cf1eb920edf872 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:40.055871 26814 tablet_service.cc:1511] Processing CreateTablet for tablet db31770e8a404036be5d7439d4fb93b8 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:40.057677 26814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db31770e8a404036be5d7439d4fb93b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.059221 26813 tablet_service.cc:1511] Processing CreateTablet for tablet b8711af7272a496f8f539685ff348541 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:40.060598 26813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8711af7272a496f8f539685ff348541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.060739 26866 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.061254 26866 ts_tablet_manager.cc:1403] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:09:40.062516 26815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bd8f8d10294a4985cf1eb920edf872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.064365 26866 raft_consensus.cc:359] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.065373 26866 raft_consensus.cc:385] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.065757 26866 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.066675 26868 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.066699 26866 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.075371 26868 tablet_bootstrap.cc:654] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.084626 26665 tablet_service.cc:1511] Processing CreateTablet for tablet 6341a852fe514d5b93574407d9eafd3f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:40.086681 26665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6341a852fe514d5b93574407d9eafd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.088057 26740 tablet_service.cc:1511] Processing CreateTablet for tablet 6341a852fe514d5b93574407d9eafd3f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:40.090346 26812 tablet_service.cc:1511] Processing CreateTablet for tablet 6341a852fe514d5b93574407d9eafd3f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:40.090852 26666 tablet_service.cc:1511] Processing CreateTablet for tablet f15d8e6c0ee7487da59fa61a94784bd6 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:40.091735 26812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6341a852fe514d5b93574407d9eafd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.092104 26666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15d8e6c0ee7487da59fa61a94784bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.090880 26740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6341a852fe514d5b93574407d9eafd3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.108744 26741 tablet_service.cc:1511] Processing CreateTablet for tablet f15d8e6c0ee7487da59fa61a94784bd6 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:40.110268 26741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15d8e6c0ee7487da59fa61a94784bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.111976 26811 tablet_service.cc:1511] Processing CreateTablet for tablet f15d8e6c0ee7487da59fa61a94784bd6 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:40.113415 26811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15d8e6c0ee7487da59fa61a94784bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.123202 26663 tablet_service.cc:1511] Processing CreateTablet for tablet 374c55d6cf6249fc8a38f46a3cd61d5f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:40.124784 26663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374c55d6cf6249fc8a38f46a3cd61d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.127242 26810 tablet_service.cc:1511] Processing CreateTablet for tablet 374c55d6cf6249fc8a38f46a3cd61d5f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:40.128765 26810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374c55d6cf6249fc8a38f46a3cd61d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.129673 26666 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:40.131119 26666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.138689 26868 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.139273 26868 ts_tablet_manager.cc:1403] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.016s
I20260709 13:09:40.139156 26739 tablet_service.cc:1511] Processing CreateTablet for tablet 374c55d6cf6249fc8a38f46a3cd61d5f (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:40.140609 26739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374c55d6cf6249fc8a38f46a3cd61d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.142674 26868 raft_consensus.cc:359] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.143433 26868 raft_consensus.cc:385] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.143725 26868 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.144850 26868 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.153692 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:40.155619 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.159624 26866 ts_tablet_manager.cc:1434] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.098s	user 0.020s	sys 0.021s
I20260709 13:09:40.159351 26809 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:40.162658 26664 tablet_service.cc:1511] Processing CreateTablet for tablet 01e68698e9bc482cbe99d96b4967a595 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:40.167865 26809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed4a61056fd4a06a8c1f77c1791fe4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.164140 26738 tablet_service.cc:1511] Processing CreateTablet for tablet 01e68698e9bc482cbe99d96b4967a595 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:40.169183 26738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e68698e9bc482cbe99d96b4967a595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.167934 26664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e68698e9bc482cbe99d96b4967a595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.175767 26777 heartbeater.cc:499] Master 127.25.109.190:35751 was elected leader, sending a full tablet report...
I20260709 13:09:40.193223 26702 heartbeater.cc:499] Master 127.25.109.190:35751 was elected leader, sending a full tablet report...
I20260709 13:09:40.193427 26866 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.195539 26868 ts_tablet_manager.cc:1434] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:09:40.203083 26868 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.210697 26868 tablet_bootstrap.cc:654] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.232880 26872 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.240581 26663 tablet_service.cc:1511] Processing CreateTablet for tablet 35b0ea8a4805493a800a8104df7cad90 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:40.242717 26866 tablet_bootstrap.cc:654] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.243245 26809 tablet_service.cc:1511] Processing CreateTablet for tablet 01e68698e9bc482cbe99d96b4967a595 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:40.245491 26742 tablet_service.cc:1511] Processing CreateTablet for tablet 35b0ea8a4805493a800a8104df7cad90 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:40.245877 26809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e68698e9bc482cbe99d96b4967a595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.246368 26872 tablet_bootstrap.cc:654] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.245883 26663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b0ea8a4805493a800a8104df7cad90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.246924 26742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b0ea8a4805493a800a8104df7cad90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.256039 26811 tablet_service.cc:1511] Processing CreateTablet for tablet 35b0ea8a4805493a800a8104df7cad90 (DEFAULT_TABLE table=test-workload [id=df261d9f6e2c494aae0b9b4c219a8bb0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:40.257424 26811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b0ea8a4805493a800a8104df7cad90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:40.268570 26868 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.269135 26868 ts_tablet_manager.cc:1403] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.017s
I20260709 13:09:40.271428 26872 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.271905 26872 ts_tablet_manager.cc:1403] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.004s
I20260709 13:09:40.272521 26868 raft_consensus.cc:359] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.273277 26868 raft_consensus.cc:385] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.273519 26868 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.274340 26868 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.274729 26872 raft_consensus.cc:359] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.275709 26872 raft_consensus.cc:385] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.276103 26872 raft_consensus.cc:740] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.277024 26872 consensus_queue.cc:260] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.277714 26866 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.278270 26866 ts_tablet_manager.cc:1403] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.001s
I20260709 13:09:40.278734 26868 ts_tablet_manager.cc:1434] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:40.279902 26868 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.281515 26866 raft_consensus.cc:359] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.282341 26866 raft_consensus.cc:385] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.282706 26866 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.283699 26866 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.286080 26866 ts_tablet_manager.cc:1434] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:40.287061 26866 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.287312 26868 tablet_bootstrap.cc:654] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.295400 26866 tablet_bootstrap.cc:654] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.299950 26868 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.300773 26868 ts_tablet_manager.cc:1403] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:09:40.306339 26851 heartbeater.cc:499] Master 127.25.109.190:35751 was elected leader, sending a full tablet report...
I20260709 13:09:40.306962 26872 ts_tablet_manager.cc:1434] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.035s	user 0.027s	sys 0.008s
I20260709 13:09:40.306970 26868 raft_consensus.cc:359] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.308121 26872 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.308301 26868 raft_consensus.cc:385] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.308732 26868 raft_consensus.cc:740] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.309927 26868 consensus_queue.cc:260] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.315373 26872 tablet_bootstrap.cc:654] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.315661 26868 ts_tablet_manager.cc:1434] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:40.317169 26868 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.320479 26866 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.321106 26866 ts_tablet_manager.cc:1403] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.021s
I20260709 13:09:40.324939 26868 tablet_bootstrap.cc:654] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.327603 26872 tablet_bootstrap.cc:492] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.324440 26866 raft_consensus.cc:359] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.328183 26872 ts_tablet_manager.cc:1403] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.006s
I20260709 13:09:40.328449 26866 raft_consensus.cc:385] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.328853 26866 raft_consensus.cc:740] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.329820 26866 consensus_queue.cc:260] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.331712 26872 raft_consensus.cc:359] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.332216 26866 ts_tablet_manager.cc:1434] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.005s
I20260709 13:09:40.332654 26872 raft_consensus.cc:385] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.333119 26872 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.333736 26866 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.334012 26872 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.336457 26872 ts_tablet_manager.cc:1434] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:09:40.337456 26872 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.337877 26868 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.338439 26868 ts_tablet_manager.cc:1403] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 13:09:40.341121 26866 tablet_bootstrap.cc:654] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.341840 26868 raft_consensus.cc:359] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.342731 26868 raft_consensus.cc:385] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.343065 26868 raft_consensus.cc:740] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.344024 26868 consensus_queue.cc:260] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.344671 26872 tablet_bootstrap.cc:654] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.346560 26868 ts_tablet_manager.cc:1434] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:40.347739 26868 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.356516 26868 tablet_bootstrap.cc:654] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.357030 26872 tablet_bootstrap.cc:492] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.357622 26872 ts_tablet_manager.cc:1403] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:09:40.356601 26866 tablet_bootstrap.cc:492] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.358955 26866 ts_tablet_manager.cc:1403] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:09:40.361605 26872 raft_consensus.cc:359] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.363014 26872 raft_consensus.cc:385] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.363515 26872 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.364496 26872 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.362232 26866 raft_consensus.cc:359] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.366271 26866 raft_consensus.cc:385] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.366648 26866 raft_consensus.cc:740] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.366781 26868 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.367461 26868 ts_tablet_manager.cc:1403] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 13:09:40.367491 26872 ts_tablet_manager.cc:1434] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:40.367630 26866 consensus_queue.cc:260] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.368742 26872 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.373687 26866 ts_tablet_manager.cc:1434] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:09:40.374845 26868 raft_consensus.cc:359] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.375799 26868 raft_consensus.cc:385] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.376174 26868 raft_consensus.cc:740] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.376379 26866 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.377053 26868 consensus_queue.cc:260] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.378103 26872 tablet_bootstrap.cc:654] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.381989 26868 ts_tablet_manager.cc:1434] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:40.383181 26868 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.384245 26866 tablet_bootstrap.cc:654] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.391666 26872 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.392405 26872 ts_tablet_manager.cc:1403] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.002s
I20260709 13:09:40.394196 26868 tablet_bootstrap.cc:654] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.395886 26872 raft_consensus.cc:359] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.396730 26872 raft_consensus.cc:385] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.397053 26872 raft_consensus.cc:740] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.398322 26872 consensus_queue.cc:260] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.401520 26866 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.402136 26866 ts_tablet_manager.cc:1403] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.011s
I20260709 13:09:40.402390 26872 ts_tablet_manager.cc:1434] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:09:40.403502 26872 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.406358 26876 raft_consensus.cc:493] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.405853 26866 raft_consensus.cc:359] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.406579 26868 tablet_bootstrap.cc:492] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.408814 26868 ts_tablet_manager.cc:1403] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:09:40.408425 26876 raft_consensus.cc:515] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.409814 26869 raft_consensus.cc:493] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.410806 26869 raft_consensus.cc:515] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.415306 26872 tablet_bootstrap.cc:654] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.417024 26869 leader_election.cc:290] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.424497 26876 leader_election.cc:290] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981)
I20260709 13:09:40.427129 26868 raft_consensus.cc:359] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.428027 26872 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.428134 26868 raft_consensus.cc:385] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.428645 26872 ts_tablet_manager.cc:1403] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.002s
I20260709 13:09:40.428617 26868 raft_consensus.cc:740] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.430763 26866 raft_consensus.cc:385] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.431171 26866 raft_consensus.cc:740] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.432072 26869 raft_consensus.cc:493] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.432576 26869 raft_consensus.cc:515] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.432758 26866 consensus_queue.cc:260] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.429714 26868 consensus_queue.cc:260] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.435189 26869 leader_election.cc:290] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.432112 26872 raft_consensus.cc:359] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.436904 26872 raft_consensus.cc:385] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.437242 26872 raft_consensus.cc:740] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.438373 26868 ts_tablet_manager.cc:1434] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:09:40.438086 26872 consensus_queue.cc:260] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.441640 26872 ts_tablet_manager.cc:1434] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:09:40.442891 26872 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.444191 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.445083 26676 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.446790 26715 leader_election.cc:304] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.447844 26869 raft_consensus.cc:2804] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.448218 26869 raft_consensus.cc:493] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.448602 26869 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.444150 26868 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.444097 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.451725 26677 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.454799 26715 leader_election.cc:304] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.458781 26868 tablet_bootstrap.cc:654] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.458551 26869 raft_consensus.cc:515] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.462523 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.463380 26677 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.474857 26869 leader_election.cc:290] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.475867 26869 raft_consensus.cc:2804] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.476329 26869 raft_consensus.cc:493] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.476783 26869 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.480765 26677 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.483294 26715 leader_election.cc:304] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
W20260709 13:09:40.490700 26623 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:40.495474 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.496492 26826 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.499071 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.499691 26826 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.501124 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.502815 26872 tablet_bootstrap.cc:654] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.501653 26826 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.505878 26868 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.506492 26868 ts_tablet_manager.cc:1403] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.003s
I20260709 13:09:40.508697 26871 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.509411 26871 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.510468 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:40.511343 26752 raft_consensus.cc:2393] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4bd782d54644072b2d9d8508688f416 in current term 1: Already voted for candidate 03081ad4fd0045f6b871faeef2b8ace0 in this term.
I20260709 13:09:40.511541 26826 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.512535 26868 raft_consensus.cc:359] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.514534 26868 raft_consensus.cc:385] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.514911 26868 raft_consensus.cc:740] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.515410 26893 raft_consensus.cc:2804] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.515827 26868 consensus_queue.cc:260] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.516330 26876 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.516832 26876 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.519449 26876 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:40.521512 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:40.522466 26752 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 0.
I20260709 13:09:40.523389 26871 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.523871 26869 raft_consensus.cc:515] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.524349 26792 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:40.525480 26876 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.525959 26876 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.526448 26876 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.516541 26866 ts_tablet_manager.cc:1434] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.114s	user 0.025s	sys 0.041s
I20260709 13:09:40.538542 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.539081 26866 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.539394 26676 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 0.
W20260709 13:09:40.537209 26715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:34981, user_credentials={real_user=slave}} blocked reactor thread for 54037.6us
I20260709 13:09:40.513855 26895 raft_consensus.cc:493] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.542428 26895 raft_consensus.cc:515] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.544484 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.545328 26677 raft_consensus.cc:2393] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4bd782d54644072b2d9d8508688f416 in current term 1: Already voted for candidate 03081ad4fd0045f6b871faeef2b8ace0 in this term.
I20260709 13:09:40.546694 26866 tablet_bootstrap.cc:654] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.547145 26789 leader_election.cc:304] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4bd782d54644072b2d9d8508688f416; no voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:40.550602 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.551268 26826 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.551599 26869 leader_election.cc:290] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.553752 26899 raft_consensus.cc:2749] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.554831 26895 leader_election.cc:290] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.555188 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.555871 26676 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.557417 26866 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.557945 26866 ts_tablet_manager.cc:1403] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 13:09:40.558557 26876 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.562893 26876 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:40.562826 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:40.563591 26752 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.563899 26676 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.564388 26868 ts_tablet_manager.cc:1434] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.037s
I20260709 13:09:40.565109 26715 leader_election.cc:304] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.566838 26716 leader_election.cc:304] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:40.567358 26901 raft_consensus.cc:2804] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.567785 26895 raft_consensus.cc:2804] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.567895 26901 raft_consensus.cc:697] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:40.568181 26895 raft_consensus.cc:493] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.568640 26895 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.568874 26901 consensus_queue.cc:237] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.570779 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.571449 26677 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.561270 26866 raft_consensus.cc:359] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.570192 26893 raft_consensus.cc:697] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:40.580286 26893 consensus_queue.cc:237] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.581969 26752 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 1.
I20260709 13:09:40.582511 26866 raft_consensus.cc:385] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.582908 26866 raft_consensus.cc:740] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.576736 26868 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.584481 26792 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:40.587340 26876 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.587491 26866 consensus_queue.cc:260] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.588609 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.589264 26677 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.589857 26866 ts_tablet_manager.cc:1434] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 13:09:40.591012 26866 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.587913 26876 raft_consensus.cc:697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:40.593331 26876 consensus_queue.cc:237] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.586954 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.598680 26826 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.599566 26868 tablet_bootstrap.cc:654] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.607529 26866 tablet_bootstrap.cc:654] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.605561 26895 raft_consensus.cc:515] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.613837 26677 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 1.
I20260709 13:09:40.620282 26826 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.642400 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:40.643608 26752 raft_consensus.cc:2393] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 046c6c360b2343a380f2deef798afb4f in current term 1: Already voted for candidate c4bd782d54644072b2d9d8508688f416 in this term.
I20260709 13:09:40.642958 26572 catalog_manager.cc:5697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.645232 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.645834 26677 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.668592 26893 raft_consensus.cc:493] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.669159 26893 raft_consensus.cc:515] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.670331 26866 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.670895 26866 ts_tablet_manager.cc:1403] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.018s
I20260709 13:09:40.676848 26893 leader_election.cc:290] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.678301 26824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.678521 26573 catalog_manager.cc:5697] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.655290 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.681424 26641 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f; no voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416
I20260709 13:09:40.682737 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.683378 26826 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:40.683495 26716 leader_election.cc:343] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.682889 26898 raft_consensus.cc:2749] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:40.687036 26866 raft_consensus.cc:359] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.687512 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.687817 26866 raft_consensus.cc:385] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.688149 26676 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.689465 26715 leader_election.cc:304] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: c4bd782d54644072b2d9d8508688f416
I20260709 13:09:40.688138 26866 raft_consensus.cc:740] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.692188 26893 raft_consensus.cc:2804] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.649456 26895 leader_election.cc:290] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.692641 26893 raft_consensus.cc:493] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.693869 26893 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.693869 26866 consensus_queue.cc:260] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.696293 26898 raft_consensus.cc:493] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.696782 26898 raft_consensus.cc:515] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.698520 26866 ts_tablet_manager.cc:1434] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:09:40.699395 26898 leader_election.cc:290] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.699928 26876 raft_consensus.cc:493] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.700397 26876 raft_consensus.cc:515] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.702813 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6341a852fe514d5b93574407d9eafd3f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.703223 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6341a852fe514d5b93574407d9eafd3f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:40.703646 26876 leader_election.cc:290] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:40.701804 26866 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.703850 26752 raft_consensus.cc:2468] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 0.
W20260709 13:09:40.706344 26641 leader_election.cc:343] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.706807 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.707742 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:40.708362 26752 raft_consensus.cc:2468] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 0.
W20260709 13:09:40.708468 26789 leader_election.cc:343] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.709635 26792 leader_election.cc:304] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:40.710304 26643 leader_election.cc:304] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: c4bd782d54644072b2d9d8508688f416
I20260709 13:09:40.710850 26876 raft_consensus.cc:2804] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.711858 26876 raft_consensus.cc:493] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.712118 26898 raft_consensus.cc:2804] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.712423 26876 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.712697 26898 raft_consensus.cc:493] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.713526 26898 raft_consensus.cc:3060] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.717338 26872 tablet_bootstrap.cc:492] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.718137 26872 ts_tablet_manager.cc:1403] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.276s	user 0.036s	sys 0.039s
I20260709 13:09:40.721472 26677 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.733285 26866 tablet_bootstrap.cc:654] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.734905 26876 raft_consensus.cc:515] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.735555 26715 leader_election.cc:304] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.736667 26895 raft_consensus.cc:2804] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.737185 26895 raft_consensus.cc:697] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:40.738045 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.738080 26895 consensus_queue.cc:237] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.745820 26868 tablet_bootstrap.cc:492] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.746325 26868 ts_tablet_manager.cc:1403] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.177s	user 0.034s	sys 0.011s
I20260709 13:09:40.748359 26868 raft_consensus.cc:359] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.748872 26868 raft_consensus.cc:385] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.749154 26868 raft_consensus.cc:740] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
W20260709 13:09:40.742395 26789 leader_election.cc:343] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.749898 26868 consensus_queue.cc:260] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.750598 26893 raft_consensus.cc:515] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.752204 26868 ts_tablet_manager.cc:1434] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:40.754271 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.752952 26893 leader_election.cc:290] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.753890 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.756088 26677 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.756201 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:40.756889 26752 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.755427 26876 leader_election.cc:290] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:40.761525 26866 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
W20260709 13:09:40.762871 26716 leader_election.cc:343] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.763875 26677 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.764154 26866 ts_tablet_manager.cc:1403] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.007s
I20260709 13:09:40.765121 26715 leader_election.cc:304] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: c4bd782d54644072b2d9d8508688f416
I20260709 13:09:40.755362 26868 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.768546 26893 raft_consensus.cc:2804] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.769053 26893 raft_consensus.cc:697] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:40.771273 26866 raft_consensus.cc:359] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.772014 26866 raft_consensus.cc:385] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.772280 26866 raft_consensus.cc:740] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.773062 26866 consensus_queue.cc:260] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.769907 26893 consensus_queue.cc:237] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.775662 26866 ts_tablet_manager.cc:1434] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:09:40.777171 26866 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.767055 26752 raft_consensus.cc:2468] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 1.
I20260709 13:09:40.787994 26866 tablet_bootstrap.cc:654] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.749859 26872 raft_consensus.cc:359] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.790784 26872 raft_consensus.cc:385] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.791234 26872 raft_consensus.cc:740] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.792866 26872 consensus_queue.cc:260] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.796371 26872 ts_tablet_manager.cc:1434] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:09:40.797824 26826 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.801445 26792 leader_election.cc:304] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:40.802655 26876 raft_consensus.cc:2804] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.803177 26876 raft_consensus.cc:697] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:40.802909 26898 raft_consensus.cc:515] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.804066 26876 consensus_queue.cc:237] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.807678 26898 leader_election.cc:290] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.808079 26872 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.811043 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6341a852fe514d5b93574407d9eafd3f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.811094 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6341a852fe514d5b93574407d9eafd3f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:40.811672 26826 raft_consensus.cc:3060] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.811784 26752 raft_consensus.cc:3060] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.818641 26868 tablet_bootstrap.cc:654] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.821985 26872 tablet_bootstrap.cc:654] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.821892 26826 raft_consensus.cc:2468] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 1.
I20260709 13:09:40.828307 26866 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.829031 26866 ts_tablet_manager.cc:1403] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.011s
I20260709 13:09:40.828848 26641 leader_election.cc:304] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:40.831224 26898 raft_consensus.cc:2804] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:40.831852 26898 raft_consensus.cc:697] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 1 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:40.832733 26898 consensus_queue.cc:237] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.843315 26752 raft_consensus.cc:2468] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 1.
I20260709 13:09:40.844609 26866 raft_consensus.cc:359] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.845541 26866 raft_consensus.cc:385] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.845896 26866 raft_consensus.cc:740] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.847936 26866 consensus_queue.cc:260] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.849547 26872 tablet_bootstrap.cc:492] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.850335 26872 ts_tablet_manager.cc:1403] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.009s
I20260709 13:09:40.851336 26866 ts_tablet_manager.cc:1434] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:09:40.852646 26866 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: Bootstrap starting.
I20260709 13:09:40.854833 26872 raft_consensus.cc:359] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.858351 26868 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.861656 26868 ts_tablet_manager.cc:1403] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.001s
I20260709 13:09:40.861462 26872 raft_consensus.cc:385] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.864701 26872 raft_consensus.cc:740] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.865700 26872 consensus_queue.cc:260] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.868484 26872 ts_tablet_manager.cc:1434] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:09:40.869611 26872 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.869309 26868 raft_consensus.cc:359] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.870115 26868 raft_consensus.cc:385] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.870469 26868 raft_consensus.cc:740] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.871318 26868 consensus_queue.cc:260] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.873700 26868 ts_tablet_manager.cc:1434] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:09:40.874759 26868 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: Bootstrap starting.
I20260709 13:09:40.875587 26893 raft_consensus.cc:493] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.876106 26893 raft_consensus.cc:515] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.879372 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.880052 26677 raft_consensus.cc:2468] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.880300 26866 tablet_bootstrap.cc:654] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.880733 26872 tablet_bootstrap.cc:654] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.880849 26893 leader_election.cc:290] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.882383 26715 leader_election.cc:304] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.876135 26572 catalog_manager.cc:5697] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.882391 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
W20260709 13:09:40.884747 26716 leader_election.cc:343] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.884030 26572 catalog_manager.cc:5697] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.885774 26893 raft_consensus.cc:2804] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.886242 26893 raft_consensus.cc:493] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.886735 26893 raft_consensus.cc:3060] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.886166 26572 catalog_manager.cc:5697] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.888831 26575 catalog_manager.cc:5697] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 1 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.890179 26868 tablet_bootstrap.cc:654] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.896370 26893 raft_consensus.cc:515] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.900455 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:40.900947 26868 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: No bootstrap required, opened a new log
I20260709 13:09:40.901451 26868 ts_tablet_manager.cc:1403] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 13:09:40.901297 26677 raft_consensus.cc:3060] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:40.902287 26893 leader_election.cc:290] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.912348 26677 raft_consensus.cc:2468] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:40.901763 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:40.913828 26715 leader_election.cc:304] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.914842 26893 raft_consensus.cc:2804] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:40.915441 26716 leader_election.cc:343] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:40.915573 26893 raft_consensus.cc:697] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:40.916724 26893 consensus_queue.cc:237] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.932245 26573 catalog_manager.cc:5697] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.935150 26575 catalog_manager.cc:5697] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.957124 26868 raft_consensus.cc:359] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.957995 26868 raft_consensus.cc:385] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.958328 26868 raft_consensus.cc:740] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.959488 26872 tablet_bootstrap.cc:492] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.959299 26868 consensus_queue.cc:260] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.959956 26872 ts_tablet_manager.cc:1403] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.041s
I20260709 13:09:40.960598 26866 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: No bootstrap required, opened a new log
I20260709 13:09:40.961020 26866 ts_tablet_manager.cc:1403] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.039s
I20260709 13:09:40.962978 26872 raft_consensus.cc:359] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.963649 26872 raft_consensus.cc:385] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.963356 26866 raft_consensus.cc:359] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.963922 26872 raft_consensus.cc:740] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.964072 26866 raft_consensus.cc:385] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.964244 26868 ts_tablet_manager.cc:1434] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:09:40.964406 26866 raft_consensus.cc:740] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.964651 26872 consensus_queue.cc:260] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.965252 26866 consensus_queue.cc:260] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.966663 26872 ts_tablet_manager.cc:1434] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:40.967758 26872 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.972450 26866 ts_tablet_manager.cc:1434] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:40.974447 26872 tablet_bootstrap.cc:654] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.979830 26872 tablet_bootstrap.cc:492] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:40.980348 26872 ts_tablet_manager.cc:1403] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:09:40.982713 26872 raft_consensus.cc:359] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.983389 26872 raft_consensus.cc:385] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:40.983619 26872 raft_consensus.cc:740] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.984194 26872 consensus_queue.cc:260] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.985724 26872 ts_tablet_manager.cc:1434] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:40.987079 26872 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: Bootstrap starting.
I20260709 13:09:40.990675 26893 raft_consensus.cc:493] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.991194 26893 raft_consensus.cc:515] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:40.991732 26872 tablet_bootstrap.cc:654] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:40.994307 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:40.994963 26677 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.995223 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:40.995857 26826 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:40.996313 26715 leader_election.cc:304] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:40.997256 26895 raft_consensus.cc:2804] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:40.997320 26893 leader_election.cc:290] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:40.997707 26895 raft_consensus.cc:493] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.998081 26895 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.000557 26872 tablet_bootstrap.cc:492] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: No bootstrap required, opened a new log
I20260709 13:09:41.000981 26872 ts_tablet_manager.cc:1403] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:09:41.003188 26872 raft_consensus.cc:359] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.003695 26872 raft_consensus.cc:385] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:41.003945 26872 raft_consensus.cc:740] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.003757 26895 raft_consensus.cc:515] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.004739 26872 consensus_queue.cc:260] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.006661 26872 ts_tablet_manager.cc:1434] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:41.007364 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:41.007387 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.008040 26677 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.008123 26826 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.009752 26895 leader_election.cc:290] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.012217 26895 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.015086 26826 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:41.016245 26716 leader_election.cc:304] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.016367 26677 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:41.017228 26893 raft_consensus.cc:2804] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.017727 26893 raft_consensus.cc:697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.018754 26893 consensus_queue.cc:237] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.028276 26895 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.029544 26876 raft_consensus.cc:493] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.030154 26876 raft_consensus.cc:515] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.031087 26575 catalog_manager.cc:5697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.032884 26876 leader_election.cc:290] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:41.035386 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:41.036226 26676 raft_consensus.cc:2393] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4bd782d54644072b2d9d8508688f416 in current term 1: Already voted for candidate 03081ad4fd0045f6b871faeef2b8ace0 in this term.
I20260709 13:09:41.037047 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:41.043380 26789 leader_election.cc:304] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4bd782d54644072b2d9d8508688f416; no voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.044278 26893 raft_consensus.cc:493] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.044390 26876 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.044880 26893 raft_consensus.cc:515] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.047327 26893 leader_election.cc:290] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.049002 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:41.049726 26677 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:41.052353 26876 raft_consensus.cc:2749] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.049005 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:41.053602 26715 leader_election.cc:304] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:41.054333 26825 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 0.
I20260709 13:09:41.054534 26893 raft_consensus.cc:2804] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:41.055089 26893 raft_consensus.cc:493] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.055502 26893 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.060355 26895 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.062659 26893 raft_consensus.cc:515] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.065824 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:41.066130 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.066463 26676 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.066721 26825 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.067421 26893 leader_election.cc:290] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.074025 26893 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.075958 26825 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:41.078964 26716 leader_election.cc:304] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.080202 26893 raft_consensus.cc:2804] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:41.082291 26676 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 1.
I20260709 13:09:41.086647 26893 raft_consensus.cc:697] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.087608 26893 consensus_queue.cc:237] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.095981 26574 catalog_manager.cc:5697] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.106992 26876 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.119256 26899 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.152820 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:41.153445 26752 raft_consensus.cc:606] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.167057 26826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:09:41.167642 26826 raft_consensus.cc:606] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.171293 26893 consensus_queue.cc:1048] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.173359 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:41.173938 26752 raft_consensus.cc:606] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.179832 26752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8711af7272a496f8f539685ff348541"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:41.180477 26752 raft_consensus.cc:606] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.186021 26869 consensus_queue.cc:1048] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.196458 26895 raft_consensus.cc:993] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.196928 26869 raft_consensus.cc:1081] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.198779 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8711af7272a496f8f539685ff348541"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:41.199406 26676 raft_consensus.cc:493] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.199805 26676 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.199915 26826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
mode: GRACEFUL
new_leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:09:41.200584 26826 raft_consensus.cc:606] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Received request to transfer leadership to TS 03081ad4fd0045f6b871faeef2b8ace0
I20260709 13:09:41.206357 26676 raft_consensus.cc:515] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.209064 26676 leader_election.cc:290] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.209417 26752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:41.209709 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8711af7272a496f8f539685ff348541" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.210039 26752 raft_consensus.cc:3055] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.210374 26826 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.210605 26752 raft_consensus.cc:740] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.211406 26752 consensus_queue.cc:260] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.212651 26752 raft_consensus.cc:3060] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.218567 26826 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.218920 26752 raft_consensus.cc:2468] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.219693 26641 leader_election.cc:304] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.220453 26898 raft_consensus.cc:2804] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.220922 26898 raft_consensus.cc:697] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:41.221731 26898 consensus_queue.cc:237] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.222167 26871 consensus_queue.cc:1048] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.224195 26751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:41.224812 26751 raft_consensus.cc:606] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS c4bd782d54644072b2d9d8508688f416
I20260709 13:09:41.226264 26898 raft_consensus.cc:493] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.226742 26898 raft_consensus.cc:515] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.228188 26937 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.229727 26750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:41.230443 26750 raft_consensus.cc:2393] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 046c6c360b2343a380f2deef798afb4f in current term 1: Already voted for candidate c4bd782d54644072b2d9d8508688f416 in this term.
I20260709 13:09:41.231752 26898 leader_election.cc:290] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.231794 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4bd782d54644072b2d9d8508688f416" is_pre_election: true
I20260709 13:09:41.233518 26641 leader_election.cc:304] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f; no voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416
I20260709 13:09:41.235258 26898 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.237450 26574 catalog_manager.cc:5697] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.243367 26898 raft_consensus.cc:2749] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.263867 26876 raft_consensus.cc:993] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: : Instructing follower 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:41.263628 26898 consensus_queue.cc:1048] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.264405 26876 raft_consensus.cc:1081] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Signalling peer 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:41.266873 26876 raft_consensus.cc:493] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.267416 26876 raft_consensus.cc:515] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.269544 26749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:56860
I20260709 13:09:41.270880 26749 raft_consensus.cc:493] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.271283 26749 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.271483 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "046c6c360b2343a380f2deef798afb4f" is_pre_election: true
I20260709 13:09:41.272370 26676 raft_consensus.cc:2393] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4bd782d54644072b2d9d8508688f416 in current term 1: Already voted for candidate 03081ad4fd0045f6b871faeef2b8ace0 in this term.
I20260709 13:09:41.277333 26937 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.279734 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e68698e9bc482cbe99d96b4967a595" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0" is_pre_election: true
I20260709 13:09:41.278589 26876 leader_election.cc:290] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:41.281513 26792 leader_election.cc:304] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4bd782d54644072b2d9d8508688f416; no voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.282015 26749 raft_consensus.cc:515] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.285382 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:41.286257 26937 raft_consensus.cc:3060] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:41.289235 26825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.289949 26825 raft_consensus.cc:3055] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.290297 26825 raft_consensus.cc:740] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:41.291220 26825 consensus_queue.cc:260] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.292225 26825 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.297402 26937 raft_consensus.cc:2749] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:41.298369 26749 leader_election.cc:290] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 2 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.302899 26825 raft_consensus.cc:2468] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 2.
I20260709 13:09:41.304359 26716 leader_election.cc:304] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:41.305222 26869 raft_consensus.cc:2804] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.305775 26869 raft_consensus.cc:697] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.307785 26869 consensus_queue.cc:237] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.315876 26573 catalog_manager.cc:5697] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 1 to 2, leader changed from c4bd782d54644072b2d9d8508688f416 (127.25.109.131) to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.350809 26869 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.361596 26893 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:41.432682 26893 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.443619 26869 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.468230 26901 raft_consensus.cc:993] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.468904 26869 raft_consensus.cc:1081] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.469096 26895 consensus_queue.cc:1048] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.470475 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:41.471052 26676 raft_consensus.cc:493] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.471415 26676 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.474330 26895 consensus_queue.cc:1048] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.479274 26676 raft_consensus.cc:515] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.482692 26676 leader_election.cc:290] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.484277 26824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.484874 26824 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.482754 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:41.491102 26749 raft_consensus.cc:3055] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.491456 26749 raft_consensus.cc:740] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.492309 26749 consensus_queue.cc:260] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.493328 26749 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.501060 26824 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.501972 26826 raft_consensus.cc:1240] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Rejecting Update request from peer 03081ad4fd0045f6b871faeef2b8ace0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:41.502421 26641 leader_election.cc:304] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.505399 26898 raft_consensus.cc:2804] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.505883 26898 raft_consensus.cc:697] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:41.506733 26898 consensus_queue.cc:237] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.504329 26749 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.518672 26575 catalog_manager.cc:5697] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.519299 26869 consensus_queue.cc:1048] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.527007 26869 raft_consensus.cc:993] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:41.527535 26869 raft_consensus.cc:1081] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:41.528911 26869 consensus_queue.cc:1048] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.529438 26824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:41996
I20260709 13:09:41.530107 26824 raft_consensus.cc:493] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.530484 26824 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.537716 26824 raft_consensus.cc:515] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.538785 26826 raft_consensus.cc:1240] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Rejecting Update request from peer 03081ad4fd0045f6b871faeef2b8ace0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:41.541225 26677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:41.541538 26895 consensus_queue.cc:1059] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:41.541862 26677 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.542382 26869 raft_consensus.cc:3055] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.542734 26869 raft_consensus.cc:740] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.543593 26869 consensus_queue.cc:260] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.544728 26869 raft_consensus.cc:3060] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.547749 26824 leader_election.cc:290] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 2 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:41.547995 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b0ea8a4805493a800a8104df7cad90" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:41.549602 26677 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 2.
I20260709 13:09:41.550771 26789 leader_election.cc:304] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.551625 26937 raft_consensus.cc:2804] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.552135 26937 raft_consensus.cc:697] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:41.552968 26937 consensus_queue.cc:237] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.558218 26749 raft_consensus.cc:2468] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 2.
I20260709 13:09:41.561115 26575 catalog_manager.cc:5697] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.586002 26901 raft_consensus.cc:993] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.586556 26869 raft_consensus.cc:1081] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.588037 26677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:41.588601 26677 raft_consensus.cc:493] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.588987 26677 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.594624 26677 raft_consensus.cc:515] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.596436 26677 leader_election.cc:290] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.597250 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:41.597487 26824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.597854 26749 raft_consensus.cc:3055] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.598176 26824 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.598229 26749 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:41.599099 26749 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.600049 26749 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.603364 26824 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.604439 26641 leader_election.cc:304] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:41.605265 26898 raft_consensus.cc:2804] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.605374 26749 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.605858 26898 raft_consensus.cc:697] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:41.606789 26898 consensus_queue.cc:237] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.613230 26575 catalog_manager.cc:5697] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.620600 26749 raft_consensus.cc:1275] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.621990 26898 consensus_queue.cc:1048] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.629531 26824 raft_consensus.cc:1275] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.631009 26871 consensus_queue.cc:1048] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.656878 26937 raft_consensus.cc:993] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.657436 26936 raft_consensus.cc:1081] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:41.659123 26677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52062
I20260709 13:09:41.659713 26677 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:41.660085 26677 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.665292 26677 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.667454 26677 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:41.668360 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:41.668581 26824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:41.669020 26749 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.669092 26824 raft_consensus.cc:3055] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:41.669447 26824 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:41.670173 26824 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.671125 26824 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.674363 26749 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.675563 26643 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:41.676373 26871 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.676790 26871 raft_consensus.cc:697] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:41.676793 26824 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:41.677789 26871 consensus_queue.cc:237] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:41.684512 26573 catalog_manager.cc:5697] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from c4bd782d54644072b2d9d8508688f416 (127.25.109.131) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.771287 26824 raft_consensus.cc:1275] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.772773 26869 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.780347 26677 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.788244 26677 raft_consensus.cc:1275] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.789776 26895 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.943444 26824 raft_consensus.cc:1275] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.944936 26871 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.955832 26749 raft_consensus.cc:1275] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.957376 26946 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.090175 26824 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.091497 26946 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.100107 26749 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.101558 26946 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.115154 26749 raft_consensus.cc:1275] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.116511 26936 consensus_queue.cc:1048] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.125646 26677 raft_consensus.cc:1275] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.127722 26876 consensus_queue.cc:1048] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.216653 26749 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.217891 26946 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.226742 26824 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.228248 26946 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:44.257759 26038 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:09:44.258606 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.275537 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:44.276146 26676 raft_consensus.cc:606] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Received request to transfer leadership to TS c4bd782d54644072b2d9d8508688f416
I20260709 13:09:44.278513 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:44.278999 26676 raft_consensus.cc:606] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Received request to transfer leadership to TS c4bd782d54644072b2d9d8508688f416
I20260709 13:09:44.280016 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:44.280537 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:44.335758 26898 raft_consensus.cc:993] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: : Instructing follower c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:44.336328 26898 raft_consensus.cc:1081] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Signalling peer c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:44.338124 26826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:09:44.338747 26826 raft_consensus.cc:493] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.339167 26826 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.345047 26826 raft_consensus.cc:515] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.347270 26826 leader_election.cc:290] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:44.348032 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:44.348754 26676 raft_consensus.cc:3055] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.348904 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:44.349066 26676 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:44.349565 26749 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.349965 26676 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.351047 26676 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.355002 26749 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:44.356413 26676 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:44.356352 26792 leader_election.cc:304] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:44.357450 26936 raft_consensus.cc:2804] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.358584 26936 raft_consensus.cc:697] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:44.359309 26936 consensus_queue.cc:237] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.366358 26575 catalog_manager.cc:5697] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 2 to 3, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.651178 26965 raft_consensus.cc:993] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: : Instructing follower c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:44.651664 26898 raft_consensus.cc:1081] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Signalling peer c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:44.653175 26826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:09:44.653640 26826 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.653895 26826 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.659276 26826 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.661134 26826 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:44.662199 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:44.662595 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:44.662776 26676 raft_consensus.cc:3055] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.663144 26749 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.663166 26676 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:44.664053 26676 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.665022 26676 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.668659 26749 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:44.669739 26792 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:44.670114 26676 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:44.670526 26936 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.671012 26936 raft_consensus.cc:697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:44.671859 26936 consensus_queue.cc:237] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:44.679533 26575 catalog_manager.cc:5697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 2 to 3, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.847347 26749 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.848873 26936 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.859565 26676 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.864362 26975 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:45.106544 26749 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:45.107903 26975 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:45.117798 26676 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:45.119725 26977 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:45.281463 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.296030 26826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:09:45.296697 26826 raft_consensus.cc:606] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:45.301646 26826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:42022
I20260709 13:09:45.302222 26826 raft_consensus.cc:606] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:45.312323 26751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:45.312920 26751 raft_consensus.cc:606] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:45.317385 26751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:45.317961 26751 raft_consensus.cc:606] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:45.322420 26751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
mode: GRACEFUL
new_leader_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:56870
I20260709 13:09:45.322950 26751 raft_consensus.cc:606] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Received request to transfer leadership to TS 046c6c360b2343a380f2deef798afb4f
I20260709 13:09:45.398370 26966 raft_consensus.cc:993] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.398903 26977 raft_consensus.cc:1081] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.400584 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52062
I20260709 13:09:45.401209 26676 raft_consensus.cc:493] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.401621 26676 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.407545 26676 raft_consensus.cc:515] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.409235 26676 leader_election.cc:290] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 4 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:45.409986 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:45.410260 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db31770e8a404036be5d7439d4fb93b8" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:45.410669 26751 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.410827 26826 raft_consensus.cc:3055] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:45.411175 26826 raft_consensus.cc:740] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:45.412053 26826 consensus_queue.cc:260] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.413360 26826 raft_consensus.cc:3060] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.418184 26751 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 4.
I20260709 13:09:45.419493 26643 leader_election.cc:304] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:45.420212 26898 raft_consensus.cc:2804] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.420382 26826 raft_consensus.cc:2468] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 4.
I20260709 13:09:45.421234 26898 raft_consensus.cc:697] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:45.422178 26898 consensus_queue.cc:237] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.427208 26895 raft_consensus.cc:993] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.427654 26980 raft_consensus.cc:1081] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.429109 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:45.428627 26575 catalog_manager.cc:5697] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 3 to 4, leader changed from c4bd782d54644072b2d9d8508688f416 (127.25.109.131) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 4 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.429654 26676 raft_consensus.cc:493] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.430019 26676 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.436601 26676 raft_consensus.cc:515] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.439682 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:45.440291 26751 raft_consensus.cc:3055] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.440160 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:45.440595 26751 raft_consensus.cc:740] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:45.440791 26826 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.441090 26676 leader_election.cc:290] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:45.441445 26751 consensus_queue.cc:260] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.442698 26751 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.447855 26826 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:45.449122 26641 leader_election.cc:304] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:45.449395 26751 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:45.449856 26898 raft_consensus.cc:2804] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.450423 26898 raft_consensus.cc:697] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:45.451220 26898 consensus_queue.cc:237] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.458573 26575 catalog_manager.cc:5697] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.607599 26975 raft_consensus.cc:993] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.608076 26977 raft_consensus.cc:1081] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.609647 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52062
I20260709 13:09:45.610250 26676 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.610603 26676 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.615649 26676 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.617622 26676 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 4 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:45.618408 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:45.618774 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:45.619009 26751 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.619292 26826 raft_consensus.cc:3055] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:45.619587 26826 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:45.620324 26826 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.621500 26826 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:45.626348 26751 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 4.
I20260709 13:09:45.627651 26643 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, 046c6c360b2343a380f2deef798afb4f; no voters: 
I20260709 13:09:45.628481 26898 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.628541 26826 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 4.
I20260709 13:09:45.629015 26898 raft_consensus.cc:697] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:45.629900 26898 consensus_queue.cc:237] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.635915 26575 catalog_manager.cc:5697] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 3 to 4, leader changed from c4bd782d54644072b2d9d8508688f416 (127.25.109.131) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 4 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.648093 26895 raft_consensus.cc:993] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.648559 26980 raft_consensus.cc:1081] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.649893 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:45.650377 26676 raft_consensus.cc:493] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.650624 26676 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:45.655197 26676 raft_consensus.cc:515] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.656545 26676 leader_election.cc:290] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 3 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:45.657467 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:45.657637 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374c55d6cf6249fc8a38f46a3cd61d5f" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:45.658033 26751 raft_consensus.cc:3055] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:45.658198 26826 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:45.658447 26751 raft_consensus.cc:740] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:45.659264 26751 consensus_queue.cc:260] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.660248 26751 raft_consensus.cc:3060] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:45.663117 26826 raft_consensus.cc:2468] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 3.
I20260709 13:09:45.664158 26641 leader_election.cc:304] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:45.664960 26898 raft_consensus.cc:2804] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:45.665401 26898 raft_consensus.cc:697] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 3 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:45.665668 26751 raft_consensus.cc:2468] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 3.
I20260709 13:09:45.666260 26898 consensus_queue.cc:237] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.673247 26575 catalog_manager.cc:5697] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 2 to 3, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 3 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.721670 26895 raft_consensus.cc:993] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: : Instructing follower 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.722222 26980 raft_consensus.cc:1081] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Signalling peer 046c6c360b2343a380f2deef798afb4f to start an election
I20260709 13:09:45.723646 26676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:45.724088 26676 raft_consensus.cc:493] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.724318 26676 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.728925 26676 raft_consensus.cc:515] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.730412 26676 leader_election.cc:290] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Requested vote from peers 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:45.731349 26751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:45.731534 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "046c6c360b2343a380f2deef798afb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:45.731987 26751 raft_consensus.cc:3055] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.732107 26826 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.732360 26751 raft_consensus.cc:740] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:45.733143 26751 consensus_queue.cc:260] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.734275 26751 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.737793 26826 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:45.738967 26641 leader_election.cc:304] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 046c6c360b2343a380f2deef798afb4f, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:45.739876 26898 raft_consensus.cc:2804] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.741209 26898 raft_consensus.cc:697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Leader. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:45.742156 26751 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 046c6c360b2343a380f2deef798afb4f in term 2.
I20260709 13:09:45.742142 26898 consensus_queue.cc:237] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:45.750190 26575 catalog_manager.cc:5697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f reported cstate change: term changed from 1 to 2, leader changed from 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130) to 046c6c360b2343a380f2deef798afb4f (127.25.109.129). New cstate: current_term: 2 leader_uuid: "046c6c360b2343a380f2deef798afb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.872954 26751 raft_consensus.cc:1275] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:45.874241 26898 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:45.887004 26826 raft_consensus.cc:1275] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:45.888356 26993 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:45.913300 26751 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:45.914537 26993 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:45.923583 26826 raft_consensus.cc:1275] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:45.925490 26898 consensus_queue.cc:1048] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:46.054025 26826 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:46.055259 26898 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:46.063362 26751 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:46.064842 26993 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:46.197607 26751 raft_consensus.cc:1275] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.199229 26993 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.204427 26826 raft_consensus.cc:1275] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.206034 26983 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.210896 26824 raft_consensus.cc:1275] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:46.217329 26898 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:46.227998 26751 raft_consensus.cc:1275] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Refusing update from remote peer 046c6c360b2343a380f2deef798afb4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:46.229436 26999 consensus_queue.cc:1048] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.330919 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.339531 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:48.340431 26676 raft_consensus.cc:606] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Received request to transfer leadership to TS 03081ad4fd0045f6b871faeef2b8ace0
I20260709 13:09:48.343281 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:48.343796 26676 raft_consensus.cc:606] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Received request to transfer leadership to TS c4bd782d54644072b2d9d8508688f416
I20260709 13:09:48.346020 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:48.346510 26676 raft_consensus.cc:606] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Received request to transfer leadership to TS c4bd782d54644072b2d9d8508688f416
I20260709 13:09:48.348686 26676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6"
dest_uuid: "046c6c360b2343a380f2deef798afb4f"
mode: GRACEFUL
new_leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:52086
I20260709 13:09:48.349134 26676 raft_consensus.cc:606] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Received request to transfer leadership to TS 03081ad4fd0045f6b871faeef2b8ace0
I20260709 13:09:48.350225 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:48.350754 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:48.353601 26898 raft_consensus.cc:993] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: : Instructing follower c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:48.354175 26999 raft_consensus.cc:1081] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Signalling peer c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:48.355806 26824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:09:48.356362 26824 raft_consensus.cc:493] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.356712 26824 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.363095 26824 raft_consensus.cc:515] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.365073 26824 leader_election.cc:290] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 5 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:48.366438 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:48.367062 26749 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.367214 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bd8f8d10294a4985cf1eb920edf872" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:48.367797 26676 raft_consensus.cc:3055] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:48.368104 26676 raft_consensus.cc:740] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:48.368986 26676 consensus_queue.cc:260] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.370397 26676 raft_consensus.cc:3060] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.374763 26749 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 5.
I20260709 13:09:48.376042 26792 leader_election.cc:304] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:48.376926 26977 raft_consensus.cc:2804] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:48.377385 26676 raft_consensus.cc:2468] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 5.
I20260709 13:09:48.378230 26977 raft_consensus.cc:697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 5 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:48.379385 26977 consensus_queue.cc:237] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.386708 26573 catalog_manager.cc:5697] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 4 to 5, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.591405 26898 raft_consensus.cc:993] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: : Instructing follower 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:48.591929 26999 raft_consensus.cc:1081] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Signalling peer 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:48.593742 26749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:56868
I20260709 13:09:48.594265 26749 raft_consensus.cc:493] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.594569 26749 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.599447 26749 raft_consensus.cc:515] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.601263 26749 leader_election.cc:290] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 3 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:48.602229 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:48.602784 26676 raft_consensus.cc:3055] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:48.602715 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2765c4610c6a406ba8cc6243db77a837" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:48.603034 26676 raft_consensus.cc:740] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:48.603230 26826 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.603906 26676 consensus_queue.cc:260] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.604898 26676 raft_consensus.cc:3060] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.608906 26826 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 3.
I20260709 13:09:48.610085 26676 raft_consensus.cc:2468] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 3.
I20260709 13:09:48.610284 26716 leader_election.cc:304] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:48.611320 26980 raft_consensus.cc:2804] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:48.612475 26980 raft_consensus.cc:697] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:48.613300 26980 consensus_queue.cc:237] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.621088 26573 catalog_manager.cc:5697] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 2 to 3, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.654908 26898 raft_consensus.cc:993] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: : Instructing follower c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:48.655395 26999 raft_consensus.cc:1081] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Signalling peer c4bd782d54644072b2d9d8508688f416 to start an election
I20260709 13:09:48.656993 26826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b"
dest_uuid: "c4bd782d54644072b2d9d8508688f416"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:09:48.657488 26826 raft_consensus.cc:493] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.657795 26826 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.663468 26826 raft_consensus.cc:515] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.665166 26826 leader_election.cc:290] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833)
I20260709 13:09:48.665848 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:48.666258 26749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed4a61056fd4a06a8c1f77c1791fe4b" candidate_uuid: "c4bd782d54644072b2d9d8508688f416" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
I20260709 13:09:48.666469 26676 raft_consensus.cc:3055] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:48.666775 26749 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.666807 26676 raft_consensus.cc:740] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:48.667626 26676 consensus_queue.cc:260] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.668545 26676 raft_consensus.cc:3060] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.671717 26749 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:48.672734 26792 leader_election.cc:304] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:48.673501 26977 raft_consensus.cc:2804] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:48.673522 26676 raft_consensus.cc:2468] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4bd782d54644072b2d9d8508688f416 in term 3.
I20260709 13:09:48.674026 26977 raft_consensus.cc:697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Becoming Leader. State: Replica: c4bd782d54644072b2d9d8508688f416, State: Running, Role: LEADER
I20260709 13:09:48.675105 26977 consensus_queue.cc:237] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.682715 26573 catalog_manager.cc:5697] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 reported cstate change: term changed from 2 to 3, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to c4bd782d54644072b2d9d8508688f416 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "c4bd782d54644072b2d9d8508688f416" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.818598 26749 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 5 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:48.820066 26977 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:48.830989 26676 raft_consensus.cc:1275] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 5 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:48.832921 27015 consensus_queue.cc:1048] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:48.844084 26898 raft_consensus.cc:993] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: : Instructing follower 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:48.844544 26999 raft_consensus.cc:1081] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Signalling peer 03081ad4fd0045f6b871faeef2b8ace0 to start an election
I20260709 13:09:48.846092 26749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6"
dest_uuid: "03081ad4fd0045f6b871faeef2b8ace0"
 from {username='slave'} at 127.0.0.1:56868
I20260709 13:09:48.846544 26749 raft_consensus.cc:493] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.846846 26749 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.853024 26749 raft_consensus.cc:515] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.854547 26749 leader_election.cc:290] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 3 election: Requested vote from peers 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981), c4bd782d54644072b2d9d8508688f416 (127.25.109.131:45269)
I20260709 13:09:48.855466 26676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "046c6c360b2343a380f2deef798afb4f"
I20260709 13:09:48.855680 26826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15d8e6c0ee7487da59fa61a94784bd6" candidate_uuid: "03081ad4fd0045f6b871faeef2b8ace0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4bd782d54644072b2d9d8508688f416"
I20260709 13:09:48.855978 26676 raft_consensus.cc:3055] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:48.856200 26826 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.856283 26676 raft_consensus.cc:740] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 046c6c360b2343a380f2deef798afb4f, State: Running, Role: LEADER
I20260709 13:09:48.856995 26676 consensus_queue.cc:260] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.857879 26676 raft_consensus.cc:3060] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:48.861536 26826 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 3.
I20260709 13:09:48.862504 26716 leader_election.cc:304] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03081ad4fd0045f6b871faeef2b8ace0, c4bd782d54644072b2d9d8508688f416; no voters: 
I20260709 13:09:48.863085 26676 raft_consensus.cc:2468] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03081ad4fd0045f6b871faeef2b8ace0 in term 3.
I20260709 13:09:48.863230 26980 raft_consensus.cc:2804] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:48.863808 26980 raft_consensus.cc:697] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 LEADER]: Becoming Leader. State: Replica: 03081ad4fd0045f6b871faeef2b8ace0, State: Running, Role: LEADER
I20260709 13:09:48.864656 26980 consensus_queue.cc:237] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } }
I20260709 13:09:48.872480 26574 catalog_manager.cc:5697] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 reported cstate change: term changed from 2 to 3, leader changed from 046c6c360b2343a380f2deef798afb4f (127.25.109.129) to 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "03081ad4fd0045f6b871faeef2b8ace0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.151249 26676 raft_consensus.cc:1275] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.152675 27015 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.161852 26749 raft_consensus.cc:1275] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Refusing update from remote peer c4bd782d54644072b2d9d8508688f416: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.163657 27004 consensus_queue.cc:1048] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03081ad4fd0045f6b871faeef2b8ace0" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 43833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:49.195231 26676 raft_consensus.cc:1275] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.196484 26980 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.206815 26824 raft_consensus.cc:1275] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.208703 26980 consensus_queue.cc:1048] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.347339 26676 raft_consensus.cc:1275] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.348672 26980 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "046c6c360b2343a380f2deef798afb4f" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:49.351755 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.359591 26824 raft_consensus.cc:1275] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Refusing update from remote peer 03081ad4fd0045f6b871faeef2b8ace0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:49.361253 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
I20260709 13:09:49.361614 27010 consensus_queue.cc:1048] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4bd782d54644072b2d9d8508688f416" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 45269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:49.370399 26789 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:09:49.380092 26789 consensus_peers.cc:597] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 -> Peer 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981): Couldn't send request to peer 046c6c360b2343a380f2deef798afb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.406212 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:49.407269 26038 tablet_replica.cc:333] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.408140 26038 raft_consensus.cc:2243] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.408794 26038 raft_consensus.cc:2272] T 35b0ea8a4805493a800a8104df7cad90 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:49.410213 26715 consensus_peers.cc:597] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 -> Peer 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981): Couldn't send request to peer 046c6c360b2343a380f2deef798afb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.411638 26038 tablet_replica.cc:333] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.412171 26038 raft_consensus.cc:2243] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.412927 26038 raft_consensus.cc:2272] T 374c55d6cf6249fc8a38f46a3cd61d5f P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.414870 26038 tablet_replica.cc:333] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.415422 26038 raft_consensus.cc:2243] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.415812 26038 raft_consensus.cc:2272] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.417922 26038 tablet_replica.cc:333] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.418479 26038 raft_consensus.cc:2243] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.419253 26038 raft_consensus.cc:2272] T 6341a852fe514d5b93574407d9eafd3f P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.420987 26038 tablet_replica.cc:333] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.421450 26038 raft_consensus.cc:2243] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.422230 26038 raft_consensus.cc:2272] T b8711af7272a496f8f539685ff348541 P 046c6c360b2343a380f2deef798afb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.423969 26038 tablet_replica.cc:333] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.424440 26038 raft_consensus.cc:2243] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.424786 26038 raft_consensus.cc:2272] T f15d8e6c0ee7487da59fa61a94784bd6 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.427562 26038 tablet_replica.cc:333] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.428076 26038 raft_consensus.cc:2243] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.428740 26038 raft_consensus.cc:2272] T 01e68698e9bc482cbe99d96b4967a595 P 046c6c360b2343a380f2deef798afb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.430606 26038 tablet_replica.cc:333] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.431066 26038 raft_consensus.cc:2243] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.431442 26038 raft_consensus.cc:2272] T 2765c4610c6a406ba8cc6243db77a837 P 046c6c360b2343a380f2deef798afb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.433849 26038 tablet_replica.cc:333] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.434442 26038 raft_consensus.cc:2243] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.434834 26038 raft_consensus.cc:2272] T 58bd8f8d10294a4985cf1eb920edf872 P 046c6c360b2343a380f2deef798afb4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.437471 26038 tablet_replica.cc:333] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f: stopping tablet replica
I20260709 13:09:49.437932 26038 raft_consensus.cc:2243] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.438776 26038 raft_consensus.cc:2272] T db31770e8a404036be5d7439d4fb93b8 P 046c6c360b2343a380f2deef798afb4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.470963 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
I20260709 13:09:49.494948 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:09:49.511097 26792 consensus_peers.cc:597] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 -> Peer 03081ad4fd0045f6b871faeef2b8ace0 (127.25.109.130:43833): Couldn't send request to peer 03081ad4fd0045f6b871faeef2b8ace0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.526311 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:49.527141 26038 tablet_replica.cc:333] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.527770 26038 raft_consensus.cc:2243] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.528359 26038 raft_consensus.cc:2272] T 35b0ea8a4805493a800a8104df7cad90 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.530434 26038 tablet_replica.cc:333] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.530984 26038 raft_consensus.cc:2243] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.531440 26038 raft_consensus.cc:2272] T 3ed4a61056fd4a06a8c1f77c1791fe4b P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.533653 26038 tablet_replica.cc:333] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.534303 26038 raft_consensus.cc:2243] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.534744 26038 raft_consensus.cc:2272] T 374c55d6cf6249fc8a38f46a3cd61d5f P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.536463 26038 tablet_replica.cc:333] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.536959 26038 raft_consensus.cc:2243] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.537743 26038 raft_consensus.cc:2272] T f15d8e6c0ee7487da59fa61a94784bd6 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.539724 26038 tablet_replica.cc:333] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.540295 26038 raft_consensus.cc:2243] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.540699 26038 raft_consensus.cc:2272] T 6341a852fe514d5b93574407d9eafd3f P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.542511 26038 tablet_replica.cc:333] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.543022 26038 raft_consensus.cc:2243] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.543491 26038 raft_consensus.cc:2272] T b8711af7272a496f8f539685ff348541 P 03081ad4fd0045f6b871faeef2b8ace0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.545270 26038 tablet_replica.cc:333] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.545739 26038 raft_consensus.cc:2243] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.546605 26038 raft_consensus.cc:2272] T 01e68698e9bc482cbe99d96b4967a595 P 03081ad4fd0045f6b871faeef2b8ace0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.548305 26038 tablet_replica.cc:333] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.548795 26038 raft_consensus.cc:2243] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.549535 26038 raft_consensus.cc:2272] T 2765c4610c6a406ba8cc6243db77a837 P 03081ad4fd0045f6b871faeef2b8ace0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.551550 26038 tablet_replica.cc:333] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.552013 26038 raft_consensus.cc:2243] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.552481 26038 raft_consensus.cc:2272] T 58bd8f8d10294a4985cf1eb920edf872 P 03081ad4fd0045f6b871faeef2b8ace0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.554639 26038 tablet_replica.cc:333] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0: stopping tablet replica
I20260709 13:09:49.555099 26038 raft_consensus.cc:2243] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.555540 26038 raft_consensus.cc:2272] T db31770e8a404036be5d7439d4fb93b8 P 03081ad4fd0045f6b871faeef2b8ace0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.586722 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
I20260709 13:09:49.609812 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
W20260709 13:09:49.617121 26789 consensus_peers.cc:597] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 -> Peer 046c6c360b2343a380f2deef798afb4f (127.25.109.129:34981): Couldn't send request to peer 046c6c360b2343a380f2deef798afb4f. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.636729 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:49.637503 26038 tablet_replica.cc:333] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.638341 26038 raft_consensus.cc:2243] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.639271 26038 raft_consensus.cc:2272] T 35b0ea8a4805493a800a8104df7cad90 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.641330 26038 tablet_replica.cc:333] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.641872 26038 raft_consensus.cc:2243] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.642341 26038 raft_consensus.cc:2272] T f15d8e6c0ee7487da59fa61a94784bd6 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.644402 26038 tablet_replica.cc:333] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.644943 26038 raft_consensus.cc:2243] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.645750 26038 raft_consensus.cc:2272] T 3ed4a61056fd4a06a8c1f77c1791fe4b P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.648015 26038 tablet_replica.cc:333] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.648567 26038 raft_consensus.cc:2243] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.648985 26038 raft_consensus.cc:2272] T 6341a852fe514d5b93574407d9eafd3f P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.650837 26038 tablet_replica.cc:333] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.651348 26038 raft_consensus.cc:2243] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.651806 26038 raft_consensus.cc:2272] T 374c55d6cf6249fc8a38f46a3cd61d5f P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.653551 26038 tablet_replica.cc:333] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.654114 26038 raft_consensus.cc:2243] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.654552 26038 raft_consensus.cc:2272] T 01e68698e9bc482cbe99d96b4967a595 P c4bd782d54644072b2d9d8508688f416 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.656204 26038 tablet_replica.cc:333] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.656675 26038 raft_consensus.cc:2243] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.657435 26038 raft_consensus.cc:2272] T 58bd8f8d10294a4985cf1eb920edf872 P c4bd782d54644072b2d9d8508688f416 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.659614 26038 tablet_replica.cc:333] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.660143 26038 raft_consensus.cc:2243] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.660594 26038 raft_consensus.cc:2272] T 2765c4610c6a406ba8cc6243db77a837 P c4bd782d54644072b2d9d8508688f416 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.662861 26038 tablet_replica.cc:333] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.663347 26038 raft_consensus.cc:2243] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.663750 26038 raft_consensus.cc:2272] T db31770e8a404036be5d7439d4fb93b8 P c4bd782d54644072b2d9d8508688f416 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.665360 26038 tablet_replica.cc:333] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416: stopping tablet replica
I20260709 13:09:49.665796 26038 raft_consensus.cc:2243] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:49.666304 26038 raft_consensus.cc:2272] T b8711af7272a496f8f539685ff348541 P c4bd782d54644072b2d9d8508688f416 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.694839 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:09:49.717196 26038 master.cc:562] Master@127.25.109.190:35751 shutting down...
I20260709 13:09:49.739794 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:49.740394 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:49.740690 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P f5c3927ff179423cbd5b2504d1fc27e8: stopping tablet replica
I20260709 13:09:49.762624 26038 master.cc:584] Master@127.25.109.190:35751 shutdown complete.
03081ad4fd0045f6b871faeef2b8ace0  4
046c6c360b2343a380f2deef798afb4f  5
c4bd782d54644072b2d9d8508688f416  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10459 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:09:49.812214 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:33321
I20260709 13:09:49.813515 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:49.820271 27031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:49.820281 27030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:49.820672 27033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:49.821815 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:49.822794 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:49.823002 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:49.823172 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602589823135 us; error 0 us; skew 500 ppm
I20260709 13:09:49.823746 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:49.826426 26038 webserver.cc:533] Webserver started at http://127.25.109.190:35837/ using document root <none> and password file <none>
I20260709 13:09:49.826969 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:49.827188 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:49.827494 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:49.828817 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "b1a1bf33a5434d58a8638deed0153f03"
format_stamp: "Formatted at 2026-07-09 13:09:49 on dist-test-slave-zhdc"
I20260709 13:09:49.833741 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:09:49.837525 27038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.838359 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:49.838690 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "b1a1bf33a5434d58a8638deed0153f03"
format_stamp: "Formatted at 2026-07-09 13:09:49 on dist-test-slave-zhdc"
I20260709 13:09:49.838995 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:49.862167 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:49.863608 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:49.907184 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:33321
I20260709 13:09:49.907294 27089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:33321 every 8 connection(s)
I20260709 13:09:49.911551 27090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.921934 27090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Bootstrap starting.
I20260709 13:09:49.926925 27090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.931546 27090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: No bootstrap required, opened a new log
I20260709 13:09:49.934033 27090 raft_consensus.cc:359] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER }
I20260709 13:09:49.934505 27090 raft_consensus.cc:385] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.934762 27090 raft_consensus.cc:740] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a1bf33a5434d58a8638deed0153f03, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.935447 27090 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER }
I20260709 13:09:49.935935 27090 raft_consensus.cc:399] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:49.936165 27090 raft_consensus.cc:493] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:49.936434 27090 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.941215 27090 raft_consensus.cc:515] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER }
I20260709 13:09:49.941753 27090 leader_election.cc:304] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1a1bf33a5434d58a8638deed0153f03; no voters: 
I20260709 13:09:49.942950 27090 leader_election.cc:290] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:49.943303 27093 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.944695 27093 raft_consensus.cc:697] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 1 LEADER]: Becoming Leader. State: Replica: b1a1bf33a5434d58a8638deed0153f03, State: Running, Role: LEADER
I20260709 13:09:49.945416 27093 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER }
I20260709 13:09:49.946170 27090 sys_catalog.cc:565] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:49.950573 27095 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1a1bf33a5434d58a8638deed0153f03. Latest consensus state: current_term: 1 leader_uuid: "b1a1bf33a5434d58a8638deed0153f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER } }
I20260709 13:09:49.950577 27094 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1a1bf33a5434d58a8638deed0153f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1a1bf33a5434d58a8638deed0153f03" member_type: VOTER } }
I20260709 13:09:49.951329 27094 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:49.951300 27095 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:49.956900 27100 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:49.962198 27100 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:49.965361 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:49.972393 27100 catalog_manager.cc:1383] Generated new cluster ID: f97116a91b51463181dac2fb34ccacd0
I20260709 13:09:49.972733 27100 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:49.993269 27100 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:49.994784 27100 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:50.007658 27100 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Generated new TSK 0
I20260709 13:09:50.008297 27100 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:50.037070 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:50.043879 27111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.045415 27112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.046952 27114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:50.047420 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:50.048574 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:50.048771 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:50.048898 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602590048887 us; error 0 us; skew 500 ppm
I20260709 13:09:50.049396 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:50.051862 26038 webserver.cc:533] Webserver started at http://127.25.109.129:37825/ using document root <none> and password file <none>
I20260709 13:09:50.052345 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:50.052507 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:50.052742 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:50.053933 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "1010256288ec4502b330749e2e3d7c85"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.058837 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:50.062299 27119 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.063038 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:50.063310 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "1010256288ec4502b330749e2e3d7c85"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.063565 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:50.083185 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:50.084638 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:50.086313 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:50.088932 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:50.089182 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.089466 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:50.089658 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.136548 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:38249
I20260709 13:09:50.136653 27181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:38249 every 8 connection(s)
I20260709 13:09:50.142084 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:50.149603 27186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.151448 27187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.155021 27189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:50.155841 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:50.155963 27182 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33321
I20260709 13:09:50.156450 27182 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.157285 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:50.157320 27182 heartbeater.cc:507] Master 127.25.109.190:33321 requested a full tablet report, sending...
W20260709 13:09:50.157706 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:50.157909 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602590157872 us; error 0 us; skew 500 ppm
I20260709 13:09:50.158581 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:50.160058 27055 ts_manager.cc:194] Registered new tserver with Master: 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:09:50.161490 26038 webserver.cc:533] Webserver started at http://127.25.109.130:36559/ using document root <none> and password file <none>
I20260709 13:09:50.162020 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:50.162315 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:50.162395 27055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56054
I20260709 13:09:50.162607 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:50.164206 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "9bc1278c649846e998b312b374274d08"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.168967 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:09:50.172435 27194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.173185 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:50.173468 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "9bc1278c649846e998b312b374274d08"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.173768 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:50.202945 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:50.204409 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:50.206269 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:50.208868 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:50.209057 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.209378 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:50.209551 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.255656 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:33347
I20260709 13:09:50.255756 27256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:33347 every 8 connection(s)
I20260709 13:09:50.260970 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:50.268955 27260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.272473 27261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:50.272715 27263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:50.273881 26038 server_base.cc:1061] running on GCE node
I20260709 13:09:50.274880 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:50.275130 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:50.275388 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602590275351 us; error 0 us; skew 500 ppm
I20260709 13:09:50.275545 27257 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33321
I20260709 13:09:50.275959 27257 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.276182 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:50.276806 27257 heartbeater.cc:507] Master 127.25.109.190:33321 requested a full tablet report, sending...
I20260709 13:09:50.279114 26038 webserver.cc:533] Webserver started at http://127.25.109.131:46075/ using document root <none> and password file <none>
I20260709 13:09:50.279246 27055 ts_manager.cc:194] Registered new tserver with Master: 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:50.279716 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:50.279961 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:50.280323 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:50.281571 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "897d8be8580141d1ad3bb17946d3da89"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.282444 27055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56068
I20260709 13:09:50.287338 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:09:50.290827 27268 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.291610 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:50.291910 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "897d8be8580141d1ad3bb17946d3da89"
format_stamp: "Formatted at 2026-07-09 13:09:50 on dist-test-slave-zhdc"
I20260709 13:09:50.292236 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:50.324884 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:50.326498 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:50.328181 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:50.330736 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:50.330976 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.331223 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:50.331422 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:50.377811 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:37965
I20260709 13:09:50.377918 27330 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:37965 every 8 connection(s)
I20260709 13:09:50.392465 27331 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33321
I20260709 13:09:50.392905 27331 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.393739 27331 heartbeater.cc:507] Master 127.25.109.190:33321 requested a full tablet report, sending...
I20260709 13:09:50.395913 27055 ts_manager.cc:194] Registered new tserver with Master: 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:50.396988 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015614288s
I20260709 13:09:50.397472 27055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56082
I20260709 13:09:50.428051 27055 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56086:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:50.434851 27055 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:50.666769 27147 tablet_service.cc:1511] Processing CreateTablet for tablet d425a845db244636a6b92ed85545087c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:50.667658 27145 tablet_service.cc:1511] Processing CreateTablet for tablet 36d9f53e5fed4e948f0828f157789667 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:50.668484 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d425a845db244636a6b92ed85545087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.669139 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d9f53e5fed4e948f0828f157789667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.670156 27146 tablet_service.cc:1511] Processing CreateTablet for tablet 4eef03c4dd654384acbb187b85475c25 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:50.671576 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eef03c4dd654384acbb187b85475c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.671443 27140 tablet_service.cc:1511] Processing CreateTablet for tablet 1366d63dcc6742608d7574eb132c123a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:50.672799 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1366d63dcc6742608d7574eb132c123a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.675278 27141 tablet_service.cc:1511] Processing CreateTablet for tablet 36bb684ea1124ce1a76a958bd405aa9b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:50.676604 27141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bb684ea1124ce1a76a958bd405aa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.677348 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 2b36513461a9483c98c7adda698d5dad (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:50.678717 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b36513461a9483c98c7adda698d5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.679329 27142 tablet_service.cc:1511] Processing CreateTablet for tablet 031d182ea10543e59e77e0a87f18c0be (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:50.680709 27142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031d182ea10543e59e77e0a87f18c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.683326 27143 tablet_service.cc:1511] Processing CreateTablet for tablet dd2ae66505104867808d4a844f249f6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:50.684640 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2ae66505104867808d4a844f249f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.691143 27138 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6d314618684d688b91fe535777e47b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:50.693462 27144 tablet_service.cc:1511] Processing CreateTablet for tablet c02ecf580b8f4657acdf790942e85fd5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:50.694375 27296 tablet_service.cc:1511] Processing CreateTablet for tablet d425a845db244636a6b92ed85545087c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:50.696159 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d425a845db244636a6b92ed85545087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.692605 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6d314618684d688b91fe535777e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.699321 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ecf580b8f4657acdf790942e85fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.737991 27145 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a8d686c4b4ec199d64c6d3882b858 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:50.740077 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a8d686c4b4ec199d64c6d3882b858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.742785 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 4eef03c4dd654384acbb187b85475c25 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:50.744315 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eef03c4dd654384acbb187b85475c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.748957 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6377ffbb949a09216851d176dbcfc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:50.749518 27294 tablet_service.cc:1511] Processing CreateTablet for tablet 36d9f53e5fed4e948f0828f157789667 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:50.750964 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6377ffbb949a09216851d176dbcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.751125 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d9f53e5fed4e948f0828f157789667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.755841 27293 tablet_service.cc:1511] Processing CreateTablet for tablet c02ecf580b8f4657acdf790942e85fd5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:50.757339 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ecf580b8f4657acdf790942e85fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.760118 27292 tablet_service.cc:1511] Processing CreateTablet for tablet dd2ae66505104867808d4a844f249f6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:50.761845 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2ae66505104867808d4a844f249f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.769501 27147 tablet_service.cc:1511] Processing CreateTablet for tablet d64b1a67a0cc42479c0519e68bc68492 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:50.771032 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64b1a67a0cc42479c0519e68bc68492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.764034 27291 tablet_service.cc:1511] Processing CreateTablet for tablet 031d182ea10543e59e77e0a87f18c0be (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:50.775279 27291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031d182ea10543e59e77e0a87f18c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.767418 27290 tablet_service.cc:1511] Processing CreateTablet for tablet 36bb684ea1124ce1a76a958bd405aa9b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:50.784332 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bb684ea1124ce1a76a958bd405aa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.790400 27289 tablet_service.cc:1511] Processing CreateTablet for tablet 1366d63dcc6742608d7574eb132c123a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:50.791893 27289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1366d63dcc6742608d7574eb132c123a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.824136 27288 tablet_service.cc:1511] Processing CreateTablet for tablet 2b36513461a9483c98c7adda698d5dad (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:50.825736 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b36513461a9483c98c7adda698d5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.827337 27287 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6d314618684d688b91fe535777e47b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:50.835160 27222 tablet_service.cc:1511] Processing CreateTablet for tablet d425a845db244636a6b92ed85545087c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:50.835278 27217 tablet_service.cc:1511] Processing CreateTablet for tablet 031d182ea10543e59e77e0a87f18c0be (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:50.836561 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6d314618684d688b91fe535777e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.836958 27222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d425a845db244636a6b92ed85545087c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.837600 27221 tablet_service.cc:1511] Processing CreateTablet for tablet 4eef03c4dd654384acbb187b85475c25 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:50.838689 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031d182ea10543e59e77e0a87f18c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.840003 27220 tablet_service.cc:1511] Processing CreateTablet for tablet 36d9f53e5fed4e948f0828f157789667 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:50.841437 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d9f53e5fed4e948f0828f157789667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.843358 27219 tablet_service.cc:1511] Processing CreateTablet for tablet c02ecf580b8f4657acdf790942e85fd5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:50.844739 27219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ecf580b8f4657acdf790942e85fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.847419 27218 tablet_service.cc:1511] Processing CreateTablet for tablet dd2ae66505104867808d4a844f249f6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:50.848845 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2ae66505104867808d4a844f249f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.850592 27221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eef03c4dd654384acbb187b85475c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.853374 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 36bb684ea1124ce1a76a958bd405aa9b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:50.853765 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 1366d63dcc6742608d7574eb132c123a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:50.874720 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bb684ea1124ce1a76a958bd405aa9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.897850 27347 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:50.902413 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1366d63dcc6742608d7574eb132c123a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.881922 27294 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a8d686c4b4ec199d64c6d3882b858 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:50.905166 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a8d686c4b4ec199d64c6d3882b858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.912545 27143 tablet_service.cc:1511] Processing CreateTablet for tablet fcf276ae949142ce87f50371f8505b9d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:50.917093 27144 tablet_service.cc:1511] Processing CreateTablet for tablet af55c80b2afb4d89beeb86311b788bca (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:50.885013 27213 tablet_service.cc:1511] Processing CreateTablet for tablet 1a6d314618684d688b91fe535777e47b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:50.883538 27214 tablet_service.cc:1511] Processing CreateTablet for tablet 2b36513461a9483c98c7adda698d5dad (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:50.913960 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf276ae949142ce87f50371f8505b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.925165 27213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6d314618684d688b91fe535777e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.883072 27142 tablet_service.cc:1511] Processing CreateTablet for tablet d87c41315a07486aa13067ad7c47c34a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:50.926364 27142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87c41315a07486aa13067ad7c47c34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.930601 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b36513461a9483c98c7adda698d5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.941447 27291 tablet_service.cc:1511] Processing CreateTablet for tablet d87c41315a07486aa13067ad7c47c34a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:50.942955 27291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87c41315a07486aa13067ad7c47c34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.935335 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af55c80b2afb4d89beeb86311b788bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.948870 27347 tablet_bootstrap.cc:654] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.920761 27140 tablet_service.cc:1511] Processing CreateTablet for tablet 6576306f90684fa797dc0cafcc53fcdb (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:50.952939 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6576306f90684fa797dc0cafcc53fcdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:50.960413 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:50.980041 27141 tablet_service.cc:1511] Processing CreateTablet for tablet dd514c8b688c4f2e90b6ad46174723ef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:50.981536 27141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd514c8b688c4f2e90b6ad46174723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.985206 27138 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2fcee6798446ca0ae9140145ba175 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:50.994490 27220 tablet_service.cc:1511] Processing CreateTablet for tablet 6576306f90684fa797dc0cafcc53fcdb (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:50.995967 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6576306f90684fa797dc0cafcc53fcdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:50.999003 27145 tablet_service.cc:1511] Processing CreateTablet for tablet a41c5fdb574f47168ed45c1838cbd31d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:51.000494 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c5fdb574f47168ed45c1838cbd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.003976 27146 tablet_service.cc:1511] Processing CreateTablet for tablet 1e37f81c47354aae99c01542f682acef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:51.005318 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e37f81c47354aae99c01542f682acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.003373 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd98a20f7c24448860d680b91e30ab5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:51.012317 27292 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6377ffbb949a09216851d176dbcfc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:51.013530 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd98a20f7c24448860d680b91e30ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.013716 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6377ffbb949a09216851d176dbcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.013799 27222 tablet_service.cc:1511] Processing CreateTablet for tablet 08a6377ffbb949a09216851d176dbcfc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:51.022733 27346 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:51.023032 27222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6377ffbb949a09216851d176dbcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.024950 27296 tablet_service.cc:1511] Processing CreateTablet for tablet d64b1a67a0cc42479c0519e68bc68492 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:51.034276 27287 tablet_service.cc:1511] Processing CreateTablet for tablet af55c80b2afb4d89beeb86311b788bca (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:51.044023 27290 tablet_service.cc:1511] Processing CreateTablet for tablet 6576306f90684fa797dc0cafcc53fcdb (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:51.055054 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a8d686c4b4ec199d64c6d3882b858 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:51.056514 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a8d686c4b4ec199d64c6d3882b858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.057169 27288 tablet_service.cc:1511] Processing CreateTablet for tablet fcf276ae949142ce87f50371f8505b9d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:51.064036 27218 tablet_service.cc:1511] Processing CreateTablet for tablet d64b1a67a0cc42479c0519e68bc68492 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:51.066363 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64b1a67a0cc42479c0519e68bc68492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.066680 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2fcee6798446ca0ae9140145ba175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.078991 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af55c80b2afb4d89beeb86311b788bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.074285 27294 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2fcee6798446ca0ae9140145ba175 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:51.087445 27346 tablet_bootstrap.cc:654] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.087903 27349 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:51.094286 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6576306f90684fa797dc0cafcc53fcdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.095407 27293 tablet_service.cc:1511] Processing CreateTablet for tablet a41c5fdb574f47168ed45c1838cbd31d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:51.098201 27220 tablet_service.cc:1511] Processing CreateTablet for tablet af55c80b2afb4d89beeb86311b788bca (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:51.100265 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af55c80b2afb4d89beeb86311b788bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.093531 27219 tablet_service.cc:1511] Processing CreateTablet for tablet d87c41315a07486aa13067ad7c47c34a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:51.108181 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2fcee6798446ca0ae9140145ba175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.115093 27217 tablet_service.cc:1511] Processing CreateTablet for tablet dd514c8b688c4f2e90b6ad46174723ef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:51.107321 27214 tablet_service.cc:1511] Processing CreateTablet for tablet fcf276ae949142ce87f50371f8505b9d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:51.138653 27347 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:51.139237 27347 ts_tablet_manager.cc:1403] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.000s
I20260709 13:09:51.142261 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf276ae949142ce87f50371f8505b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.143051 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c5fdb574f47168ed45c1838cbd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.145982 27219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87c41315a07486aa13067ad7c47c34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.148080 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64b1a67a0cc42479c0519e68bc68492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.150385 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf276ae949142ce87f50371f8505b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.154455 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd514c8b688c4f2e90b6ad46174723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.159327 27143 tablet_service.cc:1511] Processing CreateTablet for tablet b91cb18a432b4fefa2c9d4eff143e3d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:51.161932 27349 tablet_bootstrap.cc:654] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.167991 27182 heartbeater.cc:499] Master 127.25.109.190:33321 was elected leader, sending a full tablet report...
I20260709 13:09:51.168238 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cb18a432b4fefa2c9d4eff143e3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.181313 27289 tablet_service.cc:1511] Processing CreateTablet for tablet dd514c8b688c4f2e90b6ad46174723ef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:51.182978 27289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd514c8b688c4f2e90b6ad46174723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.185068 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd98a20f7c24448860d680b91e30ab5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:51.194645 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd98a20f7c24448860d680b91e30ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.190642 27292 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd98a20f7c24448860d680b91e30ab5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:51.201054 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd98a20f7c24448860d680b91e30ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.171378 27213 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2fcee6798446ca0ae9140145ba175 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:51.204849 27213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2fcee6798446ca0ae9140145ba175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.213356 27217 tablet_service.cc:1511] Processing CreateTablet for tablet 1e37f81c47354aae99c01542f682acef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:51.216074 27146 tablet_service.cc:1511] Processing CreateTablet for tablet dd61db1ee95e4b8baf0a3057db7c4d2a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:51.235416 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e37f81c47354aae99c01542f682acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.236349 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd61db1ee95e4b8baf0a3057db7c4d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.218804 27138 tablet_service.cc:1511] Processing CreateTablet for tablet b62a963093f641fa81d5d816797099e1 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:51.239575 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62a963093f641fa81d5d816797099e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.241627 27347 raft_consensus.cc:359] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.242475 27347 raft_consensus.cc:385] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.242784 27347 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.243736 27347 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.224321 27291 tablet_service.cc:1511] Processing CreateTablet for tablet b91cb18a432b4fefa2c9d4eff143e3d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:51.216079 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 580a99e39c90417485c3e3481d14bbdc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:51.247043 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a99e39c90417485c3e3481d14bbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.249773 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 9e466225c5a147b9b31f11fea1bcf893 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:51.251133 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e466225c5a147b9b31f11fea1bcf893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.255698 27140 tablet_service.cc:1511] Processing CreateTablet for tablet 580a99e39c90417485c3e3481d14bbdc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:51.256994 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a99e39c90417485c3e3481d14bbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.258811 27291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cb18a432b4fefa2c9d4eff143e3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.230571 27141 tablet_service.cc:1511] Processing CreateTablet for tablet 06445e3c1bb74c8f862cf1af47256377 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:51.233052 27214 tablet_service.cc:1511] Processing CreateTablet for tablet 9e466225c5a147b9b31f11fea1bcf893 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:51.233909 27220 tablet_service.cc:1511] Processing CreateTablet for tablet b91cb18a432b4fefa2c9d4eff143e3d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:51.270593 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e466225c5a147b9b31f11fea1bcf893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.271682 27147 tablet_service.cc:1511] Processing CreateTablet for tablet 9e466225c5a147b9b31f11fea1bcf893 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:51.263370 27296 tablet_service.cc:1511] Processing CreateTablet for tablet 1e37f81c47354aae99c01542f682acef (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:51.294276 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cb18a432b4fefa2c9d4eff143e3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.299579 27346 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:51.300165 27346 ts_tablet_manager.cc:1403] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.020s
I20260709 13:09:51.291647 27257 heartbeater.cc:499] Master 127.25.109.190:33321 was elected leader, sending a full tablet report...
I20260709 13:09:51.303099 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6d2e3ad5974f3986941a49bb1339d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:51.304497 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6d2e3ad5974f3986941a49bb1339d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.309760 27349 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:51.310299 27349 ts_tablet_manager.cc:1403] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.012s
I20260709 13:09:51.313207 27349 raft_consensus.cc:359] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.293169 27141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06445e3c1bb74c8f862cf1af47256377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.313922 27349 raft_consensus.cc:385] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.322327 27331 heartbeater.cc:499] Master 127.25.109.190:33321 was elected leader, sending a full tablet report...
I20260709 13:09:51.325841 27290 tablet_service.cc:1511] Processing CreateTablet for tablet b62a963093f641fa81d5d816797099e1 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:51.329941 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e37f81c47354aae99c01542f682acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.334741 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62a963093f641fa81d5d816797099e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.343307 27218 tablet_service.cc:1511] Processing CreateTablet for tablet dd61db1ee95e4b8baf0a3057db7c4d2a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:51.343590 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6d2e3ad5974f3986941a49bb1339d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:51.346004 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6d2e3ad5974f3986941a49bb1339d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.309502 27346 raft_consensus.cc:359] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.352878 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e466225c5a147b9b31f11fea1bcf893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.353528 27220 tablet_service.cc:1511] Processing CreateTablet for tablet b62a963093f641fa81d5d816797099e1 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:51.318868 27349 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.364755 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd61db1ee95e4b8baf0a3057db7c4d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.374805 27349 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.377592 27347 ts_tablet_manager.cc:1434] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.238s	user 0.007s	sys 0.005s
I20260709 13:09:51.378223 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62a963093f641fa81d5d816797099e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.378774 27347 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:51.374004 27221 tablet_service.cc:1511] Processing CreateTablet for tablet a41c5fdb574f47168ed45c1838cbd31d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:51.361327 27142 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6d2e3ad5974f3986941a49bb1339d7 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:51.381914 27221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c5fdb574f47168ed45c1838cbd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.382349 27142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6d2e3ad5974f3986941a49bb1339d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.384150 27143 tablet_service.cc:1511] Processing CreateTablet for tablet ae22f698260e475b89b90dcbd28bda00 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:51.385746 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae22f698260e475b89b90dcbd28bda00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.364490 27294 tablet_service.cc:1511] Processing CreateTablet for tablet dd61db1ee95e4b8baf0a3057db7c4d2a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:51.364526 27288 tablet_service.cc:1511] Processing CreateTablet for tablet be324c341d044aa892e39ebca665c6c6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:51.366861 27219 tablet_service.cc:1511] Processing CreateTablet for tablet 06445e3c1bb74c8f862cf1af47256377 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:51.369279 27217 tablet_service.cc:1511] Processing CreateTablet for tablet ae22f698260e475b89b90dcbd28bda00 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:51.369475 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 1b636aab71bc4cad87e3a5d644042885 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:51.372184 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 93b895e250184ee283d78483d5fcae92 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:51.357028 27346 raft_consensus.cc:385] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.398675 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae22f698260e475b89b90dcbd28bda00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.398041 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd61db1ee95e4b8baf0a3057db7c4d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.397094 27346 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.410234 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be324c341d044aa892e39ebca665c6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.404910 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b636aab71bc4cad87e3a5d644042885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.417506 27289 tablet_service.cc:1511] Processing CreateTablet for tablet 580a99e39c90417485c3e3481d14bbdc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:51.407538 27145 tablet_service.cc:1511] Processing CreateTablet for tablet 1b636aab71bc4cad87e3a5d644042885 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:51.425999 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b636aab71bc4cad87e3a5d644042885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.426605 27219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06445e3c1bb74c8f862cf1af47256377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.431816 27346 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.435268 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b895e250184ee283d78483d5fcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.437296 27292 tablet_service.cc:1511] Processing CreateTablet for tablet 1b636aab71bc4cad87e3a5d644042885 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:51.422307 27287 tablet_service.cc:1511] Processing CreateTablet for tablet 06445e3c1bb74c8f862cf1af47256377 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:51.439064 27222 tablet_service.cc:1511] Processing CreateTablet for tablet be324c341d044aa892e39ebca665c6c6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:51.444201 27222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be324c341d044aa892e39ebca665c6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.448863 27349 ts_tablet_manager.cc:1434] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.138s	user 0.002s	sys 0.013s
I20260709 13:09:51.454591 27293 tablet_service.cc:1511] Processing CreateTablet for tablet ae22f698260e475b89b90dcbd28bda00 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:51.458325 27349 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:51.459442 27144 tablet_service.cc:1511] Processing CreateTablet for tablet be324c341d044aa892e39ebca665c6c6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:51.461931 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be324c341d044aa892e39ebca665c6c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.471088 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 93b895e250184ee283d78483d5fcae92 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:51.472734 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b895e250184ee283d78483d5fcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.479643 27353 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.480053 27347 tablet_bootstrap.cc:654] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.480317 27353 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.430792 27289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a99e39c90417485c3e3481d14bbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.483050 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06445e3c1bb74c8f862cf1af47256377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.486351 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae22f698260e475b89b90dcbd28bda00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.488507 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b636aab71bc4cad87e3a5d644042885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.478178 27146 tablet_service.cc:1511] Processing CreateTablet for tablet 432318984ae54d3b86d6f16faa526523 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:51.491992 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432318984ae54d3b86d6f16faa526523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.533941 27353 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:51.550576 27296 tablet_service.cc:1511] Processing CreateTablet for tablet 93b895e250184ee283d78483d5fcae92 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:51.552152 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b895e250184ee283d78483d5fcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.554021 27138 tablet_service.cc:1511] Processing CreateTablet for tablet 38b3919a88c74cac9b41f07419fbb92d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:51.573179 27349 tablet_bootstrap.cc:654] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.593590 27214 tablet_service.cc:1511] Processing CreateTablet for tablet 38b3919a88c74cac9b41f07419fbb92d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:51.596103 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b3919a88c74cac9b41f07419fbb92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.600140 27140 tablet_service.cc:1511] Processing CreateTablet for tablet e2433340983a46c0b79d3ff64b3694b6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:51.602257 27147 tablet_service.cc:1511] Processing CreateTablet for tablet 23b189bbd0aa4c6787e99f8cc041dd48 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:51.604734 27143 tablet_service.cc:1511] Processing CreateTablet for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:51.589973 27354 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.607455 27220 tablet_service.cc:1511] Processing CreateTablet for tablet 432318984ae54d3b86d6f16faa526523 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:51.547433 27290 tablet_service.cc:1511] Processing CreateTablet for tablet 432318984ae54d3b86d6f16faa526523 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:51.615411 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b3919a88c74cac9b41f07419fbb92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.632556 27346 ts_tablet_manager.cc:1434] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.332s	user 0.013s	sys 0.017s
I20260709 13:09:51.633664 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c0f63822c7471ebdec8a5f3dfa21a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.634614 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432318984ae54d3b86d6f16faa526523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.628016 27354 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.651466 27143 tablet_service.cc:1511] Processing CreateTablet for tablet 86bf2019fd7b421393e482331c89a37d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:51.652904 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bf2019fd7b421393e482331c89a37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.634624 27288 tablet_service.cc:1511] Processing CreateTablet for tablet 23b189bbd0aa4c6787e99f8cc041dd48 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:51.660468 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b189bbd0aa4c6787e99f8cc041dd48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.661556 27349 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:51.662142 27349 ts_tablet_manager.cc:1403] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.205s	user 0.023s	sys 0.043s
I20260709 13:09:51.664783 27347 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:51.665366 27347 ts_tablet_manager.cc:1403] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.287s	user 0.021s	sys 0.000s
I20260709 13:09:51.668660 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 38b3919a88c74cac9b41f07419fbb92d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:51.669610 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2433340983a46c0b79d3ff64b3694b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.665653 27349 raft_consensus.cc:359] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.683054 27346 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:51.671299 27213 tablet_service.cc:1511] Processing CreateTablet for tablet 23b189bbd0aa4c6787e99f8cc041dd48 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:51.684319 27142 tablet_service.cc:1511] Processing CreateTablet for tablet 63772c6ab6094654b0215f6a3be7d6fc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:51.670037 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b3919a88c74cac9b41f07419fbb92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.689073 27141 tablet_service.cc:1511] Processing CreateTablet for tablet c2d8b32b61494130ab83c26fc2d310e6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:51.658174 27354 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:51.692539 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432318984ae54d3b86d6f16faa526523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.678426 27349 raft_consensus.cc:385] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.694229 27349 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.702347 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b189bbd0aa4c6787e99f8cc041dd48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.709380 27346 tablet_bootstrap.cc:654] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.673954 27287 tablet_service.cc:1511] Processing CreateTablet for tablet e2433340983a46c0b79d3ff64b3694b6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:51.679593 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:51.718665 27351 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.736095 27351 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.721431 27142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63772c6ab6094654b0215f6a3be7d6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.675716 27218 tablet_service.cc:1511] Processing CreateTablet for tablet e2433340983a46c0b79d3ff64b3694b6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:51.745916 27145 tablet_service.cc:1511] Processing CreateTablet for tablet d6c3d4b3cf374582b470348b1f7dc027 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:51.722168 27349 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.727203 27217 tablet_service.cc:1511] Processing CreateTablet for tablet c2d8b32b61494130ab83c26fc2d310e6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:51.735435 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2433340983a46c0b79d3ff64b3694b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.747313 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c3d4b3cf374582b470348b1f7dc027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.748364 27349 ts_tablet_manager.cc:1434] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.002s
I20260709 13:09:51.749400 27349 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:51.743739 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 652ad18b41cd4991881cb7beaaa59f8c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:51.749784 27140 tablet_service.cc:1511] Processing CreateTablet for tablet 006b4229b8b346a4b6e1de5910f7b5a4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:51.750977 27351 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:51.750974 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ad18b41cd4991881cb7beaaa59f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.740540 27213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b189bbd0aa4c6787e99f8cc041dd48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.755810 27141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d8b32b61494130ab83c26fc2d310e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.693861 27216 tablet_service.cc:1511] Processing CreateTablet for tablet 63772c6ab6094654b0215f6a3be7d6fc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:51.689065 27222 tablet_service.cc:1511] Processing CreateTablet for tablet 86bf2019fd7b421393e482331c89a37d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:51.771715 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:51.769142 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c0f63822c7471ebdec8a5f3dfa21a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:51.774677 27195 leader_election.cc:343] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.778475 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d8b32b61494130ab83c26fc2d310e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.779201 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2433340983a46c0b79d3ff64b3694b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.803313 27146 tablet_service.cc:1511] Processing CreateTablet for tablet d6a8841c8bb041a1a423a427ed084489 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:09:51.847672 27039 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72790.5us
I20260709 13:09:51.807061 27138 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba2f184437940dbb94ed0532f27e854 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:51.841091 27139 tablet_service.cc:1511] Processing CreateTablet for tablet 54a3803047aa4a85bd0d761bdb45cead (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:51.835927 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:51.860170 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c0f63822c7471ebdec8a5f3dfa21a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.828709 27221 tablet_service.cc:1511] Processing CreateTablet for tablet d6c3d4b3cf374582b470348b1f7dc027 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:51.826727 27219 tablet_service.cc:1511] Processing CreateTablet for tablet 652ad18b41cd4991881cb7beaaa59f8c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:51.843581 27293 tablet_service.cc:1511] Processing CreateTablet for tablet 63772c6ab6094654b0215f6a3be7d6fc (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:51.839656 27291 tablet_service.cc:1511] Processing CreateTablet for tablet 86bf2019fd7b421393e482331c89a37d (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:51.826701 27222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bf2019fd7b421393e482331c89a37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.785750 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b4229b8b346a4b6e1de5910f7b5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.824568 27349 tablet_bootstrap.cc:654] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.844565 27292 tablet_service.cc:1511] Processing CreateTablet for tablet c2d8b32b61494130ab83c26fc2d310e6 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:51.879330 27356 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.879904 27356 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.887173 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:51.888392 27218 tablet_service.cc:1511] Processing CreateTablet for tablet d6a8841c8bb041a1a423a427ed084489 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:09:51.888868 27195 leader_election.cc:343] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.889874 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63772c6ab6094654b0215f6a3be7d6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.911904 27214 tablet_service.cc:1511] Processing CreateTablet for tablet 006b4229b8b346a4b6e1de5910f7b5a4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:51.912652 27221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c3d4b3cf374582b470348b1f7dc027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.890756 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63772c6ab6094654b0215f6a3be7d6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.913362 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b4229b8b346a4b6e1de5910f7b5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.850700 27347 raft_consensus.cc:359] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:51.914273 27347 raft_consensus.cc:385] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.914644 27347 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.915455 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:51.915592 27347 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:51.917270 27122 leader_election.cc:343] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.917761 27294 tablet_service.cc:1511] Processing CreateTablet for tablet 652ad18b41cd4991881cb7beaaa59f8c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:51.919250 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ad18b41cd4991881cb7beaaa59f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.921324 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba2f184437940dbb94ed0532f27e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.899770 27356 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:51.924199 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a3803047aa4a85bd0d761bdb45cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.926349 27219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ad18b41cd4991881cb7beaaa59f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.926643 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d8b32b61494130ab83c26fc2d310e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.918273 27347 ts_tablet_manager.cc:1434] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.253s	user 0.010s	sys 0.000s
I20260709 13:09:51.928407 27347 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:51.928020 27296 tablet_service.cc:1511] Processing CreateTablet for tablet d6c3d4b3cf374582b470348b1f7dc027 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:51.936759 27144 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45788 (request call id 32) took 1047 ms. Trace:
I20260709 13:09:51.937335 27144 rpcz_store.cc:276] 0709 13:09:50.889609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.433407 (+543798us) service_pool.cc:224] Handling call
0709 13:09:51.461400 (+ 27993us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.461508 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:51.712676 (+251168us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:51.902510 (+189834us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:51.936682 (+ 34172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.938761 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a8841c8bb041a1a423a427ed084489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.939265 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a8841c8bb041a1a423a427ed084489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.940477 27144 tablet_service.cc:1511] Processing CreateTablet for tablet 695ceba1143c428490ae6aad424a66ea (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:51.943300 27220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46398 (request call id 33) took 1033 ms. Trace:
I20260709 13:09:51.956442 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c3d4b3cf374582b470348b1f7dc027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.959569 27291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bf2019fd7b421393e482331c89a37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.960511 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695ceba1143c428490ae6aad424a66ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.965775 27289 tablet_service.cc:1511] Processing CreateTablet for tablet 006b4229b8b346a4b6e1de5910f7b5a4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:09:51.967953 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:51.968390 27289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b4229b8b346a4b6e1de5910f7b5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.968379 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:51.970260 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:51.970914 27306 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
W20260709 13:09:51.972239 27197 leader_election.cc:343] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.972720 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:51.965763 27290 tablet_service.cc:1511] Processing CreateTablet for tablet d6a8841c8bb041a1a423a427ed084489 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:51.973985 27356 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:51.978847 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a8841c8bb041a1a423a427ed084489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.988266 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:51.962615 27220 rpcz_store.cc:276] 0709 13:09:50.910466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.577673 (+667207us) service_pool.cc:224] Handling call
0709 13:09:51.629715 (+ 52042us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.656447 (+ 26732us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:51.772915 (+116468us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:51.942753 (+169838us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:51.943235 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.991822 27220 tablet_service.cc:1511] Processing CreateTablet for tablet 54a3803047aa4a85bd0d761bdb45cead (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:51.993471 27356 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.996383 27142 tablet_service.cc:1511] Processing CreateTablet for tablet c8f560534ffa48878a9e4d4766199287 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:51.998677 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.010689 27356 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.011106 27356 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:52.011921 27272 leader_election.cc:343] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.999462 27349 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.013039 27349 ts_tablet_manager.cc:1403] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.005s
I20260709 13:09:52.003862 27347 tablet_bootstrap.cc:654] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.015031 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a3803047aa4a85bd0d761bdb45cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.005771 27346 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.009167 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.016167 27346 ts_tablet_manager.cc:1403] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.333s	user 0.018s	sys 0.014s
I20260709 13:09:52.019380 27346 raft_consensus.cc:359] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.020097 27346 raft_consensus.cc:385] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.020388 27346 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.021270 27346 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:52.022439 27123 leader_election.cc:343] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.973843 27213 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba2f184437940dbb94ed0532f27e854 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:52.023763 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:51.999274 27287 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba2f184437940dbb94ed0532f27e854 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:52.038674 27354 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.046180 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:52.047642 27269 leader_election.cc:343] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.047964 27142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f560534ffa48878a9e4d4766199287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.048169 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:52.048358 27222 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9dfa4361254d838c2b61576ada60f4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:52.049183 27351 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.054706 27213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba2f184437940dbb94ed0532f27e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.060482 27346 ts_tablet_manager.cc:1434] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:09:52.028054 27356 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.062438 27222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9dfa4361254d838c2b61576ada60f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.063479 27221 tablet_service.cc:1511] Processing CreateTablet for tablet fe318d32db494aafa007d9cb3d4cf02a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:52.064113 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:52.065068 27288 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34430 (request call id 35) took 1004 ms. Trace:
I20260709 13:09:52.065196 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba2f184437940dbb94ed0532f27e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.048149 27217 tablet_service.cc:1511] Processing CreateTablet for tablet c8f560534ffa48878a9e4d4766199287 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:52.067642 27147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45788 (request call id 35) took 1038 ms. Trace:
I20260709 13:09:52.088145 27288 rpcz_store.cc:276] 0709 13:09:51.061195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.631331 (+570136us) service_pool.cc:224] Handling call
0709 13:09:51.659949 (+ 28618us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.660056 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:51.907599 (+247543us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.041567 (+133968us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.064996 (+ 23429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.090554 27147 rpcz_store.cc:276] 0709 13:09:51.029185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.560449 (+531264us) service_pool.cc:224] Handling call
0709 13:09:51.667641 (+107192us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5800005198. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d6b831 00007f9a56d48ac3 00007f9a56cf7400 00007f9a5017caf4 00007f9a5017ca82 00007f9a5017c9b1
0709 13:09:51.667781 (+   140us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.667882 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:51.813158 (+145276us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.023152 (+209994us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.067567 (+ 44415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26364160}
I20260709 13:09:52.092548 27288 tablet_service.cc:1511] Processing CreateTablet for tablet c8f560534ffa48878a9e4d4766199287 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:52.014041 27143 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9dfa4361254d838c2b61576ada60f4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:52.095105 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9dfa4361254d838c2b61576ada60f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.094914 27147 tablet_service.cc:1511] Processing CreateTablet for tablet f5d526be8aec49c8863369b60c8e884c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:52.097395 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f560534ffa48878a9e4d4766199287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.098023 27147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d526be8aec49c8863369b60c8e884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.098209 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 695ceba1143c428490ae6aad424a66ea (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:52.099589 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695ceba1143c428490ae6aad424a66ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.100788 27293 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9dfa4361254d838c2b61576ada60f4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:52.072602 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:52.102129 27306 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.069469 27145 tablet_service.cc:1511] Processing CreateTablet for tablet fe318d32db494aafa007d9cb3d4cf02a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:52.103688 27145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe318d32db494aafa007d9cb3d4cf02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.103613 27218 tablet_service.cc:1511] Processing CreateTablet for tablet 9936add6bb224d4bbd8bcd5a38781ae5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:52.073498 27356 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.105397 27218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9936add6bb224d4bbd8bcd5a38781ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.075940 27349 raft_consensus.cc:359] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.105800 27349 raft_consensus.cc:385] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.079923 27139 tablet_service.cc:1511] Processing CreateTablet for tablet b3cb013cb450432ba238b716d88554e4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:52.084090 27216 tablet_service.cc:1511] Processing CreateTablet for tablet b3cb013cb450432ba238b716d88554e4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:52.085961 27289 tablet_service.cc:1511] Processing CreateTablet for tablet 695ceba1143c428490ae6aad424a66ea (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:52.088886 27157 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.098023 27219 tablet_service.cc:1511] Processing CreateTablet for tablet f5d526be8aec49c8863369b60c8e884c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:52.125488 27139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cb013cb450432ba238b716d88554e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.070685 27346 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.082736 27294 tablet_service.cc:1511] Processing CreateTablet for tablet 54a3803047aa4a85bd0d761bdb45cead (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:52.116230 27140 tablet_service.cc:1511] Processing CreateTablet for tablet 9936add6bb224d4bbd8bcd5a38781ae5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:52.106202 27349 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.137810 27349 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.143582 27349 ts_tablet_manager.cc:1434] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 13:09:52.144804 27349 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.122363 27306 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:52.123780 27347 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.136592 27140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9936add6bb224d4bbd8bcd5a38781ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.113692 27221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe318d32db494aafa007d9cb3d4cf02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.168413 27290 tablet_service.cc:1511] Processing CreateTablet for tablet b3cb013cb450432ba238b716d88554e4 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:52.170035 27217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f560534ffa48878a9e4d4766199287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.146763 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9dfa4361254d838c2b61576ada60f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.170987 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a3803047aa4a85bd0d761bdb45cead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.171665 27289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695ceba1143c428490ae6aad424a66ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.174898 27216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cb013cb450432ba238b716d88554e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.175298 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:52.137939 27214 tablet_service.cc:1511] Processing CreateTablet for tablet bd31e5d20c484a9facfe437706e9bd6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:52.176360 27356 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.150586 27291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34430 (request call id 38) took 1015 ms. Trace:
I20260709 13:09:52.177299 27291 rpcz_store.cc:276] 0709 13:09:51.134877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.838333 (+703456us) service_pool.cc:224] Handling call
0709 13:09:51.937409 (+ 99076us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d6b831 00007f9a56d48ac3 00007f9a56cf7400 00007f9a5017caf4 00007f9a5017ca82 00007f9a5017c9b1
0709 13:09:51.948787 (+ 11378us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12e9c 00007f9a4ec12a5b 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d6b831 00007f9a56d48ac3 00007f9a56cf7400 00007f9a5017caf4 00007f9a5017ca82 00007f9a5017c9b1
0709 13:09:51.959042 (+ 10255us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.959164 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.029426 (+ 70262us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.149858 (+120432us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.150511 (+   653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32329856}
I20260709 13:09:52.179716 27291 tablet_service.cc:1511] Processing CreateTablet for tablet f5d526be8aec49c8863369b60c8e884c (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:52.182255 27291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d526be8aec49c8863369b60c8e884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.151077 27141 tablet_service.cc:1511] Processing CreateTablet for tablet 897bd586cdb44a899e3c85e77da927c3 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:52.117915 27138 tablet_service.cc:1511] Processing CreateTablet for tablet bd31e5d20c484a9facfe437706e9bd6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:52.152825 27346 tablet_bootstrap.cc:654] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.133700 27295 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34430 (request call id 37) took 1018 ms. Trace:
I20260709 13:09:52.122267 27292 tablet_service.cc:1511] Processing CreateTablet for tablet fe318d32db494aafa007d9cb3d4cf02a (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:52.164716 27347 ts_tablet_manager.cc:1403] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.237s	user 0.021s	sys 0.000s
I20260709 13:09:52.176877 27219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d526be8aec49c8863369b60c8e884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.150882 27157 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:52.198910 27141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897bd586cdb44a899e3c85e77da927c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.204514 27138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd31e5d20c484a9facfe437706e9bd6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.195708 27356 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:52.194821 27295 rpcz_store.cc:276] 0709 13:09:51.115032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.834786 (+719754us) service_pool.cc:224] Handling call
0709 13:09:51.859526 (+ 24740us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:51.859648 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.090603 (+230955us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.133073 (+ 42470us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.133621 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.207975 27295 tablet_service.cc:1511] Processing CreateTablet for tablet 9936add6bb224d4bbd8bcd5a38781ae5 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:52.210383 27347 raft_consensus.cc:359] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.211220 27347 raft_consensus.cc:385] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.211560 27347 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.164321 27144 tablet_service.cc:1511] Processing CreateTablet for tablet aa050ea82d9b4a729f786c4fd23f4904 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:52.222373 27295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9936add6bb224d4bbd8bcd5a38781ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.222537 27214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd31e5d20c484a9facfe437706e9bd6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.223219 27292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe318d32db494aafa007d9cb3d4cf02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.228318 27373 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.228864 27373 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.232596 27373 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.212838 27347 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.236228 27146 tablet_service.cc:1511] Processing CreateTablet for tablet 51fed810b66a4d09868add1d38749c15 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:52.236784 27347 ts_tablet_manager.cc:1434] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:09:52.233873 27296 tablet_service.cc:1511] Processing CreateTablet for tablet bd31e5d20c484a9facfe437706e9bd6b (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:52.237738 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.243103 27288 tablet_service.cc:1511] Processing CreateTablet for tablet 897bd586cdb44a899e3c85e77da927c3 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:52.245419 27220 tablet_service.cc:1511] Processing CreateTablet for tablet aa050ea82d9b4a729f786c4fd23f4904 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:52.211408 27356 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.258955 27351 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.259294 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.259523 27351 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.260721 27290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cb013cb450432ba238b716d88554e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:52.257357 27197 leader_election.cc:343] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.257243 27347 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.261286 27144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa050ea82d9b4a729f786c4fd23f4904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.266896 27296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd31e5d20c484a9facfe437706e9bd6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:52.271229 27195 leader_election.cc:343] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.271806 27195 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:52.287217 27146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fed810b66a4d09868add1d38749c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.286167 27215 tablet_service.cc:1511] Processing CreateTablet for tablet 897bd586cdb44a899e3c85e77da927c3 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:52.293695 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:52.295477 27269 leader_election.cc:343] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.297844 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.298380 27215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897bd586cdb44a899e3c85e77da927c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.298589 27231 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:52.299989 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:52.304467 27294 tablet_service.cc:1511] Processing CreateTablet for tablet c956eb948d264e3fa713d592c530d94e (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:52.305717 27287 tablet_service.cc:1511] Processing CreateTablet for tablet aa050ea82d9b4a729f786c4fd23f4904 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:52.304479 27293 tablet_service.cc:1511] Processing CreateTablet for tablet 51fed810b66a4d09868add1d38749c15 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:52.308606 27221 tablet_service.cc:1511] Processing CreateTablet for tablet 51fed810b66a4d09868add1d38749c15 (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:52.314293 27213 tablet_service.cc:1511] Processing CreateTablet for tablet c956eb948d264e3fa713d592c530d94e (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:52.326419 27351 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.327345 27351 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.327791 27351 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.328198 27351 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.290915 27288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897bd586cdb44a899e3c85e77da927c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.333642 27293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fed810b66a4d09868add1d38749c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.329996 27374 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.335289 27287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa050ea82d9b4a729f786c4fd23f4904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.341044 27221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fed810b66a4d09868add1d38749c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.343170 27346 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.343844 27346 ts_tablet_manager.cc:1403] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.273s	user 0.017s	sys 0.005s
I20260709 13:09:52.336723 27143 tablet_service.cc:1511] Processing CreateTablet for tablet c956eb948d264e3fa713d592c530d94e (DEFAULT_TABLE table=test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:52.345782 27143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c956eb948d264e3fa713d592c530d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.346879 27220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa050ea82d9b4a729f786c4fd23f4904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.347544 27346 raft_consensus.cc:359] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.348364 27346 raft_consensus.cc:385] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.348716 27346 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.340852 27294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c956eb948d264e3fa713d592c530d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.357095 27213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c956eb948d264e3fa713d592c530d94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:52.387118 27142 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45788 (request call id 48) took 1013 ms. Trace:
W20260709 13:09:52.399402 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 99496.1us
I20260709 13:09:52.391057 27346 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.402292 27354 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.402936 27354 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.392175 27142 rpcz_store.cc:276] 0709 13:09:51.373957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.995350 (+621393us) service_pool.cc:224] Handling call
0709 13:09:52.022838 (+ 27488us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:52.047353 (+ 24515us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.096828 (+ 49475us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.386511 (+289683us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.387035 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.481135 27217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46398 (request call id 48) took 1070 ms. Trace:
I20260709 13:09:52.473804 27052 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.491219 27354 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.491743 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.491796 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:52.494382 27123 leader_election.cc:343] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:52.495463 27122 leader_election.cc:343] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.495908 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:52.498262 27354 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.498837 27347 tablet_bootstrap.cc:654] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.508065 27349 tablet_bootstrap.cc:700] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent opening tablet: real 0.110s	user 0.000s	sys 0.004s
I20260709 13:09:52.521994 27346 ts_tablet_manager.cc:1434] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.178s	user 0.022s	sys 0.014s
I20260709 13:09:52.530934 27346 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.535176 27145 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45788 (request call id 50) took 1095 ms. Trace:
I20260709 13:09:52.535722 27145 rpcz_store.cc:276] 0709 13:09:51.439364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.068462 (+629098us) service_pool.cc:224] Handling call
0709 13:09:52.103074 (+ 34612us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:52.103215 (+   141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.240108 (+136893us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.534680 (+294572us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.535108 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.538559 27289 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34430 (request call id 47) took 1167 ms. Trace:
I20260709 13:09:52.538980 27289 rpcz_store.cc:276] 0709 13:09:51.370927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.085088 (+714161us) service_pool.cc:224] Handling call
0709 13:09:52.124311 (+ 39223us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:52.124411 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.493011 (+368600us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.525929 (+ 32918us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.538492 (+ 12563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.481699 27217 rpcz_store.cc:276] 0709 13:09:51.411236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.046681 (+635445us) service_pool.cc:224] Handling call
0709 13:09:52.124612 (+ 77931us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:09:52.124725 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:09:52.301952 (+177227us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.480502 (+178550us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.481056 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:52.540717 27346 tablet_bootstrap.cc:654] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.544739 27349 tablet_bootstrap.cc:654] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.599907 27349 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.600853 27349 ts_tablet_manager.cc:1403] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.456s	user 0.021s	sys 0.025s
I20260709 13:09:52.601908 27347 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.608503 27351 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.613219 27351 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.613750 27347 ts_tablet_manager.cc:1403] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.357s	user 0.024s	sys 0.058s
I20260709 13:09:52.614568 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:52.615962 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:52.617226 27231 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.619498 27349 raft_consensus.cc:359] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.620275 27349 raft_consensus.cc:385] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.620580 27349 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.621502 27349 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:09:52.622285 27269 leader_election.cc:343] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.624032 27349 ts_tablet_manager.cc:1434] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:52.625133 27349 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.625203 27347 raft_consensus.cc:359] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.626163 27231 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:52.626832 27347 raft_consensus.cc:385] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.627327 27347 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.628155 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:52.629434 27351 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.629920 27351 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:52.630795 27351 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.631511 27346 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.632032 27346 ts_tablet_manager.cc:1403] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.018s
I20260709 13:09:52.635315 27346 raft_consensus.cc:359] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.628196 27347 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.636130 27346 raft_consensus.cc:385] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.636201 27349 tablet_bootstrap.cc:654] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.636518 27346 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.637764 27347 ts_tablet_manager.cc:1434] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:09:52.637805 27346 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.639004 27347 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.640308 27346 ts_tablet_manager.cc:1434] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:52.648738 27346 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.648078 27053 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.655755 27349 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.656322 27349 ts_tablet_manager.cc:1403] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:09:52.659678 27349 raft_consensus.cc:359] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.660451 27349 raft_consensus.cc:385] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.660634 27346 tablet_bootstrap.cc:654] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.660809 27349 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.661785 27349 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.650408 27347 tablet_bootstrap.cc:654] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.673825 27349 ts_tablet_manager.cc:1434] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:09:52.675161 27349 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.681412 27347 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.682013 27347 ts_tablet_manager.cc:1403] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.003s
I20260709 13:09:52.682217 27349 tablet_bootstrap.cc:654] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.681445 27346 tablet_bootstrap.cc:492] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.685657 27347 raft_consensus.cc:359] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.686450 27346 ts_tablet_manager.cc:1403] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:09:52.686481 27347 raft_consensus.cc:385] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.686901 27347 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.687739 27349 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.688216 27349 ts_tablet_manager.cc:1403] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:09:52.688027 27347 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.689946 27346 raft_consensus.cc:359] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.690447 27347 ts_tablet_manager.cc:1434] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:52.690886 27346 raft_consensus.cc:385] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.691234 27346 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.691148 27349 raft_consensus.cc:359] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.691948 27349 raft_consensus.cc:385] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.692023 27347 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.692287 27349 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.692307 27346 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.693164 27349 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.698390 27349 ts_tablet_manager.cc:1434] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:52.699446 27349 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.699805 27347 tablet_bootstrap.cc:654] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.699930 27346 ts_tablet_manager.cc:1434] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:52.701184 27346 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.706349 27349 tablet_bootstrap.cc:654] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.709794 27346 tablet_bootstrap.cc:654] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.712427 27347 tablet_bootstrap.cc:492] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.712978 27347 ts_tablet_manager.cc:1403] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:09:52.716182 27347 raft_consensus.cc:359] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.717015 27347 raft_consensus.cc:385] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.717356 27347 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.718386 27347 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.726413 27347 ts_tablet_manager.cc:1434] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:09:52.727604 27347 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.733330 27378 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.736788 27356 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.737423 27347 tablet_bootstrap.cc:654] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.734594 27378 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.741235 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.741483 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.742069 27231 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:52.742249 27378 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.743331 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:52.744666 27378 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.745854 27349 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.746627 27349 ts_tablet_manager.cc:1403] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.018s
I20260709 13:09:52.751024 27349 raft_consensus.cc:359] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.752149 27349 raft_consensus.cc:385] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.752584 27349 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.753750 27349 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.755308 27346 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.755831 27346 ts_tablet_manager.cc:1403] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.012s
I20260709 13:09:52.757364 27349 ts_tablet_manager.cc:1434] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:09:52.757525 27351 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.758014 27351 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.758553 27349 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.759025 27356 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.759522 27356 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.760331 27351 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.762804 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.762837 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.764379 27156 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:52.765360 27346 raft_consensus.cc:359] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:52.765785 27197 leader_election.cc:343] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.766490 27346 raft_consensus.cc:385] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.766861 27346 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.767690 27346 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.768524 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.769578 27349 tablet_bootstrap.cc:654] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.770435 27346 ts_tablet_manager.cc:1434] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:09:52.770499 27356 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.766733 27269 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:52.771238 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.774827 27351 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:52.775069 27272 leader_election.cc:343] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.775204 27351 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.775619 27351 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:52.778584 27195 leader_election.cc:343] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.779038 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:52.779877 27374 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.783627 27349 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.783806 27351 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.784291 27349 ts_tablet_manager.cc:1403] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 13:09:52.786892 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:52.787460 27156 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.787919 27349 raft_consensus.cc:359] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.788832 27349 raft_consensus.cc:385] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.789171 27349 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.790160 27349 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.796779 27349 ts_tablet_manager.cc:1434] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:09:52.797768 27349 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.803758 27346 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.805289 27349 tablet_bootstrap.cc:654] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.819976 27347 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.820626 27347 ts_tablet_manager.cc:1403] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.093s	user 0.036s	sys 0.034s
I20260709 13:09:52.773828 27378 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.824440 27356 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.825610 27356 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.828662 27156 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:52.828819 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:52.829639 27400 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:52.833180 27231 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.834645 27347 raft_consensus.cc:359] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.826478 27351 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.836323 27347 raft_consensus.cc:385] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.836751 27347 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.840919 27349 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.841437 27349 ts_tablet_manager.cc:1403] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.009s
I20260709 13:09:52.841504 27269 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:52.843201 27356 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.844483 27346 tablet_bootstrap.cc:654] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.845391 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.845628 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.846163 27347 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.846520 27376 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:52.849815 27197 leader_election.cc:343] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:52.854378 27195 leader_election.cc:343] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.854677 27347 ts_tablet_manager.cc:1434] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 13:09:52.854892 27195 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:52.855808 27397 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.853854 27349 raft_consensus.cc:359] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.860460 27349 raft_consensus.cc:385] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.860915 27349 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.859297 27347 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.859647 27378 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.868988 27378 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.869243 27349 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.873802 27349 ts_tablet_manager.cc:1434] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:09:52.873661 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.874789 27349 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
W20260709 13:09:52.875159 27123 leader_election.cc:343] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.879802 27347 tablet_bootstrap.cc:654] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.879890 27376 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:52.881052 27376 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.883551 27349 tablet_bootstrap.cc:654] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.884430 27403 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.885038 27403 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.888967 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.889128 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.871280 27378 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:52.891008 27269 leader_election.cc:343] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.889206 27403 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.893568 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:52.895053 27122 leader_election.cc:343] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.895498 27122 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:52.896615 27354 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.897081 27347 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.897078 27354 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.897969 27347 ts_tablet_manager.cc:1403] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
W20260709 13:09:52.898240 27272 leader_election.cc:343] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.898711 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:52.899605 27354 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:52.900107 27354 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.901940 27347 raft_consensus.cc:359] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.902403 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:52.903200 27232 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:52.904052 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.904742 27305 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:52.905371 27347 raft_consensus.cc:385] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.905699 27347 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.906865 27349 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.906548 27347 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.907385 27349 ts_tablet_manager.cc:1403] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.006s
I20260709 13:09:52.906744 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:52.907631 27351 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.908654 27354 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.912569 27354 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.912953 27354 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.856858 27231 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:52.909683 27347 ts_tablet_manager.cc:1434] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:52.915396 27347 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.916957 27053 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.910219 27349 raft_consensus.cc:359] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.919046 27349 raft_consensus.cc:385] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.920221 27347 tablet_bootstrap.cc:654] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.921396 27349 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.921088 27354 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.922289 27349 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.924110 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:52.924491 27349 ts_tablet_manager.cc:1434] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:52.924693 27306 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.925491 27349 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:52.927047 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:52.927618 27231 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.931492 27349 tablet_bootstrap.cc:654] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.932066 27306 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:52.921039 27346 tablet_bootstrap.cc:492] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:52.933320 27346 ts_tablet_manager.cc:1403] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.011s
I20260709 13:09:52.933881 27122 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:52.934816 27378 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.936278 27397 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.936759 27397 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.937409 27346 raft_consensus.cc:359] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.939085 27397 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.939417 27346 raft_consensus.cc:385] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.939862 27346 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.942605 27346 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.944895 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.945767 27157 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:52.947793 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.948058 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:52.948617 27354 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:09:52.949671 27197 leader_election.cc:343] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.950304 27397 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.950698 27397 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.951071 27397 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.951014 27231 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:52.962638 27346 ts_tablet_manager.cc:1434] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.009s
I20260709 13:09:52.963737 27378 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:52.962817 27397 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.964900 27378 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:09:52.966974 27346 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:52.967444 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:52.968032 27157 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.968708 27347 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:52.969166 27347 ts_tablet_manager.cc:1403] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.011s
W20260709 13:09:52.970739 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:52.972043 27347 raft_consensus.cc:359] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.972566 27347 raft_consensus.cc:385] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.972826 27347 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.973510 27347 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.974617 27346 tablet_bootstrap.cc:654] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.975503 27347 ts_tablet_manager.cc:1434] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:52.976771 27347 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:52.979699 27349 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:52.980156 27349 ts_tablet_manager.cc:1403] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.018s
I20260709 13:09:52.977001 27157 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:52.981134 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:52.981969 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:09:52.983424 27197 leader_election.cc:343] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.984166 27356 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.984680 27356 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:52.984813 27374 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.985589 27356 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.985471 27374 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.990386 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:52.991333 27306 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:52.994488 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:52.995157 27349 raft_consensus.cc:359] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:52.978386 27397 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.995905 27400 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.996603 27400 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.996666 27374 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:52.997288 27400 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.995900 27349 raft_consensus.cc:385] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.998546 27349 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.999282 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:52.999325 27349 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.005167 27349 ts_tablet_manager.cc:1434] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
W20260709 13:09:53.005445 27195 leader_election.cc:343] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.006230 27349 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.003196 27347 tablet_bootstrap.cc:654] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.007890 27400 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.013515 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:53.015852 27195 leader_election.cc:343] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.018391 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.019032 27306 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.021569 27054 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.024391 27347 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.025139 27347 ts_tablet_manager.cc:1403] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.001s
I20260709 13:09:53.027110 27306 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.028483 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:53.029397 27397 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.028920 27347 raft_consensus.cc:359] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.029891 27347 raft_consensus.cc:385] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.030169 27397 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:53.030277 27347 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.031190 27397 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.031680 27347 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.035758 27400 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.039860 27349 tablet_bootstrap.cc:654] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.040179 27347 ts_tablet_manager.cc:1434] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:09:53.041740 27347 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.044639 27346 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.045171 27346 ts_tablet_manager.cc:1403] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.040s
I20260709 13:09:53.047116 27054 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.048108 27346 raft_consensus.cc:359] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.048974 27346 raft_consensus.cc:385] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.049324 27346 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.050257 27346 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.053172 27346 ts_tablet_manager.cc:1434] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:53.054108 27346 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.060541 27346 tablet_bootstrap.cc:654] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.062177 27347 tablet_bootstrap.cc:654] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.064441 27053 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.066596 27346 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.067076 27346 ts_tablet_manager.cc:1403] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:09:53.069654 27403 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.070036 27349 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.070672 27349 ts_tablet_manager.cc:1403] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.006s
I20260709 13:09:53.070181 27403 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.072485 27403 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.073210 27346 raft_consensus.cc:359] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.073455 27349 raft_consensus.cc:359] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.073884 27346 raft_consensus.cc:385] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.074229 27349 raft_consensus.cc:385] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.074294 27346 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.074743 27349 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.075346 27346 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.075416 27349 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.075919 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.077059 27397 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.077847 27346 ts_tablet_manager.cc:1434] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:53.077507 27397 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.077737 27269 leader_election.cc:343] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.079319 27349 ts_tablet_manager.cc:1434] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:53.080091 27397 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.080276 27349 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.081251 27346 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.074143 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:09:53.083042 27272 leader_election.cc:343] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.083483 27272 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.084970 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.085657 27157 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.086985 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.087563 27349 tablet_bootstrap.cc:654] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.087822 27397 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.088253 27397 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.088594 27397 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.089159 27376 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.090458 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.091116 27306 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.089859 27376 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:53.087561 27346 tablet_bootstrap.cc:654] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.069235 27347 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.099411 27347 ts_tablet_manager.cc:1403] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:09:53.099578 27349 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.100759 27349 ts_tablet_manager.cc:1403] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:09:53.098115 27397 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.104355 27349 raft_consensus.cc:359] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.105079 27349 raft_consensus.cc:385] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.105018 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.105597 27349 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.105973 27156 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.106487 27349 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.104614 27347 raft_consensus.cc:359] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.107944 27347 raft_consensus.cc:385] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.108636 27347 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.108989 27349 ts_tablet_manager.cc:1434] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:53.110232 27349 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.110220 27347 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.115954 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.116601 27306 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.117684 27349 tablet_bootstrap.cc:654] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.122262 27397 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.122709 27349 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.123215 27349 ts_tablet_manager.cc:1403] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:09:53.125247 27306 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.125629 27156 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.126296 27349 raft_consensus.cc:359] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.126659 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.127040 27349 raft_consensus.cc:385] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.127348 27349 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.128134 27349 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.128743 27397 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.129932 27397 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:53.130692 27346 tablet_bootstrap.cc:492] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.131212 27346 ts_tablet_manager.cc:1403] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:09:53.134101 27346 raft_consensus.cc:359] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.134840 27346 raft_consensus.cc:385] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.135098 27346 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.135782 27346 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.136299 27347 ts_tablet_manager.cc:1434] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:09:53.137873 27346 ts_tablet_manager.cc:1434] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:53.138867 27346 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.139787 27349 ts_tablet_manager.cc:1434] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.007s
I20260709 13:09:53.140156 27397 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.140829 27349 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.143663 27403 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.145524 27346 tablet_bootstrap.cc:654] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.155567 27403 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.156168 27403 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.158427 27403 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.160691 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.160868 27349 tablet_bootstrap.cc:654] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.160691 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.161429 27156 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.161641 27403 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.161713 27232 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.162756 27269 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:53.164042 27351 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.164408 27351 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.164728 27351 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.162381 27403 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.172922 27347 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.176474 27349 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.177424 27349 ts_tablet_manager.cc:1403] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.002s
I20260709 13:09:53.180344 27349 raft_consensus.cc:359] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.181061 27349 raft_consensus.cc:385] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.181340 27349 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.182027 27349 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.182258 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.183008 27157 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.184072 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.184324 27349 ts_tablet_manager.cc:1434] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:09:53.184319 27269 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:53.184756 27232 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.185199 27376 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.185425 27349 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.185555 27376 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.185947 27376 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.186293 27403 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.191877 27351 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.196547 27349 tablet_bootstrap.cc:654] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.196611 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.197000 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:53.197391 27157 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.197592 27232 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.205327 27351 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.206964 27347 tablet_bootstrap.cc:654] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.195026 27376 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.206990 27427 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:09:53.205222 27232 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.212476 27376 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.205222 27157 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.213647 27346 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.214191 27346 ts_tablet_manager.cc:1403] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.075s	user 0.028s	sys 0.031s
I20260709 13:09:53.214452 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.215129 27156 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.217176 27346 raft_consensus.cc:359] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.217911 27346 raft_consensus.cc:385] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.218228 27346 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.218852 27400 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.218935 27346 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.219511 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:53.219396 27400 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.220077 27231 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.221160 27346 ts_tablet_manager.cc:1434] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:09:53.221565 27400 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.222141 27346 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.222801 27269 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:53.224145 27349 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.224285 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.224619 27349 ts_tablet_manager.cc:1403] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.009s
I20260709 13:09:53.226997 27376 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.228505 27376 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:09:53.229820 27197 leader_election.cc:343] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.229496 27052 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.231565 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:53.233031 27195 leader_election.cc:343] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.229458 27346 tablet_bootstrap.cc:654] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.233292 27403 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.233501 27195 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:53.233777 27403 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.236310 27403 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.240355 27400 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.242246 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.243029 27155 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.244648 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:53.245131 27347 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.245599 27347 ts_tablet_manager.cc:1403] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.000s
I20260709 13:09:53.246249 27403 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.246698 27403 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.247076 27403 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.248540 27347 raft_consensus.cc:359] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.249279 27347 raft_consensus.cc:385] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.249655 27347 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.249183 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.250483 27232 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.259892 27349 raft_consensus.cc:359] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.260573 27349 raft_consensus.cc:385] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.260860 27349 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.229457 27376 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.251824 27347 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.261493 27349 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.263636 27347 ts_tablet_manager.cc:1434] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:09:53.264758 27347 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.268857 27349 ts_tablet_manager.cc:1434] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:09:53.270459 27349 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.255769 27403 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.273090 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.273815 27155 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.275408 27403 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.276953 27346 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.277508 27346 ts_tablet_manager.cc:1403] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.018s
I20260709 13:09:53.278385 27378 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.278887 27378 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.279947 27347 tablet_bootstrap.cc:654] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.280419 27346 raft_consensus.cc:359] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.280972 27378 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.281080 27346 raft_consensus.cc:385] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.281394 27346 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.273515 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:53.282836 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.283260 27232 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.283903 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.284441 27349 tablet_bootstrap.cc:654] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:53.284319 27123 leader_election.cc:343] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.284618 27306 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:53.285841 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.287531 27378 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.287909 27378 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.287775 27231 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.288362 27378 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.289376 27272 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.282233 27346 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.290298 27403 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.290833 27403 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:53.291750 27403 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.295624 27346 ts_tablet_manager.cc:1434] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:09:53.295857 27156 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.297420 27346 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.297492 27232 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.303531 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.301234 27155 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.312855 27053 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.311584 27351 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.308658 27378 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.323691 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:53.324632 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.325273 27306 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:53.325577 27123 leader_election.cc:343] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.326479 27397 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.326988 27397 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.329152 27397 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.330242 27378 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.331287 27351 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:53.331534 27376 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.332878 27351 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.332973 27376 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.336231 27376 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.336257 27306 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:53.337601 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.337884 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.338492 27305 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.340555 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:09:53.340502 27272 leader_election.cc:343] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.344337 27378 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.344888 27378 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:53.345745 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.345875 27378 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.347316 27269 leader_election.cc:343] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.347780 27269 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.349184 27403 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.342319 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.350663 27155 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.342845 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.356638 27397 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.357214 27397 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.357672 27397 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.369190 27347 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.370007 27347 ts_tablet_manager.cc:1403] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.007s
I20260709 13:09:53.373296 27347 raft_consensus.cc:359] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.374071 27347 raft_consensus.cc:385] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.374397 27347 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.375389 27347 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.376291 27349 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.376809 27349 ts_tablet_manager.cc:1403] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.107s	user 0.029s	sys 0.013s
I20260709 13:09:53.382100 27052 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.383559 27347 ts_tablet_manager.cc:1434] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:09:53.384750 27347 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.383623 27053 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.385859 27053 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.386854 27346 tablet_bootstrap.cc:654] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.391510 27349 raft_consensus.cc:359] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.392263 27349 raft_consensus.cc:385] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.392580 27349 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.392591 27397 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.393410 27349 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.395756 27349 ts_tablet_manager.cc:1434] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:09:53.397264 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.398217 27347 tablet_bootstrap.cc:654] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.398138 27155 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.407874 27378 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.410285 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.410920 27306 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.419938 27349 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.423079 27347 tablet_bootstrap.cc:492] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.423588 27347 ts_tablet_manager.cc:1403] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.010s
I20260709 13:09:53.424501 27155 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.424836 27378 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.417936 27346 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.426436 27346 ts_tablet_manager.cc:1403] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.017s
I20260709 13:09:53.426687 27347 raft_consensus.cc:359] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.427385 27347 raft_consensus.cc:385] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.427652 27347 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.428313 27347 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.430279 27403 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.430786 27347 ts_tablet_manager.cc:1434] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:09:53.432008 27347 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.432421 27195 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.433506 27356 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.434000 27356 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:53.435199 27356 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.439581 27347 tablet_bootstrap.cc:654] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.429898 27346 raft_consensus.cc:359] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.441782 27346 raft_consensus.cc:385] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.442022 27346 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.442284 27378 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.442744 27346 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.442827 27378 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.446784 27378 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.446779 27349 tablet_bootstrap.cc:654] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.455029 27306 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.456867 27346 ts_tablet_manager.cc:1434] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:53.458354 27346 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.445235 27397 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.462455 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.463374 27306 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:53.461217 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.467947 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.469156 27378 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.470191 27351 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.476341 27356 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.478379 27356 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.486518 27378 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.492136 27356 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.500701 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.501540 27306 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.502696 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:53.504237 27195 leader_election.cc:343] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.507805 27346 tablet_bootstrap.cc:654] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.508117 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:53.507807 27356 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.510937 27349 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.511426 27349 ts_tablet_manager.cc:1403] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.005s
I20260709 13:09:53.511554 27400 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.511999 27400 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.512342 27400 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.520366 27347 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.520925 27347 ts_tablet_manager.cc:1403] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.020s
I20260709 13:09:53.521940 27054 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.523744 27347 raft_consensus.cc:359] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.510928 27356 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.524500 27347 raft_consensus.cc:385] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.524884 27347 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.526794 27356 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.525863 27349 raft_consensus.cc:359] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.527622 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.527966 27349 raft_consensus.cc:385] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.528667 27349 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.528825 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.529649 27349 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.530372 27195 leader_election.cc:343] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.525815 27347 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.532388 27349 ts_tablet_manager.cc:1434] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.009s
W20260709 13:09:53.531234 27197 leader_election.cc:343] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.533071 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:53.533741 27349 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.533831 27356 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.534297 27347 ts_tablet_manager.cc:1434] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:09:53.535151 27347 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.536144 27400 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.538376 27400 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.540838 27346 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.541368 27346 ts_tablet_manager.cc:1403] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.003s
I20260709 13:09:53.542914 27347 tablet_bootstrap.cc:654] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.543715 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.544266 27346 raft_consensus.cc:359] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.544957 27346 raft_consensus.cc:385] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.545262 27346 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.545446 27397 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.545895 27346 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.544950 27374 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.548192 27346 ts_tablet_manager.cc:1434] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:53.548313 27374 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.549201 27346 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
W20260709 13:09:53.552074 27195 leader_election.cc:343] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.553018 27397 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.556141 27346 tablet_bootstrap.cc:654] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.559193 27374 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.562191 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:53.574626 27195 leader_election.cc:343] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.588948 27349 tablet_bootstrap.cc:654] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.592274 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.592999 27306 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.598665 27346 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.599448 27346 ts_tablet_manager.cc:1403] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.024s
I20260709 13:09:53.604130 27346 raft_consensus.cc:359] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.605142 27346 raft_consensus.cc:385] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.605476 27346 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.606534 27346 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.609724 27346 ts_tablet_manager.cc:1434] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:53.610654 27349 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.607227 27356 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.611339 27349 ts_tablet_manager.cc:1403] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.010s
I20260709 13:09:53.614266 27349 raft_consensus.cc:359] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.614970 27349 raft_consensus.cc:385] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.615242 27349 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.615876 27349 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.610734 27346 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:53.618165 27349 ts_tablet_manager.cc:1434] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:09:53.618873 27305 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.619129 27349 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.622623 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.618724 27306 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.653684 27351 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.654491 27351 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.659286 27197 leader_election.cc:343] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.660002 27197 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:53.664149 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:09:53.665715 27272 leader_election.cc:343] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.666337 27351 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.670038 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.669965 27351 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.670939 27157 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.673849 27346 tablet_bootstrap.cc:654] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.675371 27374 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.675920 27374 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.677857 27269 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.678385 27374 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.678747 27351 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.678916 27349 tablet_bootstrap.cc:654] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.679153 27351 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.679541 27351 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.680543 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.681213 27155 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:53.682650 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.683530 27400 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.683877 27400 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.684235 27400 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.690938 27397 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.692834 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:53.678886 27374 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.695865 27374 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.701041 27349 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.700564 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.701560 27356 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.704413 27347 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.706656 27347 ts_tablet_manager.cc:1403] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.172s	user 0.045s	sys 0.049s
I20260709 13:09:53.701750 27349 ts_tablet_manager.cc:1403] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.029s
I20260709 13:09:53.700546 27400 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.716321 27400 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.717453 27349 raft_consensus.cc:359] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.719342 27349 raft_consensus.cc:385] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.720969 27349 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.720067 27347 raft_consensus.cc:359] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.722011 27349 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.722276 27347 raft_consensus.cc:385] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.723991 27347 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.725068 27347 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.728159 27349 ts_tablet_manager.cc:1434] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:53.731230 27349 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:53.735715 27351 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.732228 27347 ts_tablet_manager.cc:1434] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 13:09:53.736531 27376 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.737596 27347 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.739619 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:53.740588 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.741189 27156 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:53.742762 27272 leader_election.cc:343] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:53.747807 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54577.2us
I20260709 13:09:53.748626 27347 tablet_bootstrap.cc:654] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.750495 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:53.751142 27155 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.752863 27349 tablet_bootstrap.cc:654] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:53.762099 27197 leader_election.cc:343] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.764770 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:53.767190 27231 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.779865 27403 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.784781 27155 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:53.787379 27397 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.787936 27397 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.790688 27397 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.791713 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:53.792588 27378 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.793552 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:53.795598 27400 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.796072 27400 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:53.796273 27356 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.797017 27400 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.799458 27197 leader_election.cc:343] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.818526 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:53.826777 27195 leader_election.cc:343] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.836086 27351 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.849900 27346 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:53.850483 27346 ts_tablet_manager.cc:1403] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.240s	user 0.056s	sys 0.076s
I20260709 13:09:53.847705 27374 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:53.852530 27374 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.854508 27346 raft_consensus.cc:359] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.855218 27346 raft_consensus.cc:385] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.855504 27346 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.856340 27346 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.859032 27403 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.859875 27346 ts_tablet_manager.cc:1434] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:09:53.860872 27346 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
W20260709 13:09:53.859189 27197 leader_election.cc:343] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.873502 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:53.877228 27397 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.883091 27156 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:53.898669 27269 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.900032 27403 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:53.900591 27403 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:53.901655 27403 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.904842 27347 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.905395 27347 ts_tablet_manager.cc:1403] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.168s	user 0.055s	sys 0.044s
I20260709 13:09:53.906618 27349 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:53.907090 27349 ts_tablet_manager.cc:1403] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.176s	user 0.042s	sys 0.041s
I20260709 13:09:53.908591 27347 raft_consensus.cc:359] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.909519 27347 raft_consensus.cc:385] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.909852 27347 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.909814 27349 raft_consensus.cc:359] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.911092 27349 raft_consensus.cc:385] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.911352 27349 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.912434 27349 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.917927 27349 ts_tablet_manager.cc:1434] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:53.919183 27378 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.924961 27347 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.925222 27054 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.926260 27351 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.928560 27346 tablet_bootstrap.cc:654] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.935369 27458 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:53.935417 27464 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.937399 27464 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.939689 27464 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.941459 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:53.942988 27269 leader_election.cc:343] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.948880 27053 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.951045 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.951798 27232 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:53.933079 27403 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.929438 27347 ts_tablet_manager.cc:1434] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:09:53.954838 27347 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:53.958307 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:53.959293 27376 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.959843 27376 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.962764 27376 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:53.963351 27376 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:53.963781 27376 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.964208 27376 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:53.965730 27347 tablet_bootstrap.cc:654] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:53.981387 27378 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.982020 27378 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.984367 27378 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:53.985111 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.986827 27346 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
W20260709 13:09:53.986712 27272 leader_election.cc:343] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.987311 27346 ts_tablet_manager.cc:1403] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.032s
I20260709 13:09:53.989475 27347 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:53.990417 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:53.990239 27346 raft_consensus.cc:359] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.990283 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:53.991012 27346 raft_consensus.cc:385] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.991312 27346 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.991671 27347 ts_tablet_manager.cc:1403] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:09:53.992089 27346 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:53.992115 27122 leader_election.cc:343] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:53.993427 27123 leader_election.cc:343] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:53.994412 27123 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:53.994679 27347 raft_consensus.cc:359] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.995398 27347 raft_consensus.cc:385] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:53.995605 27354 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:53.995676 27347 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:53.996562 27347 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:53.998078 27347 ts_tablet_manager.cc:1434] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:09:53.999035 27347 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.000140 27458 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.000774 27458 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.002386 27349 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.002722 27378 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.009490 27378 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.015282 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.016233 27349 tablet_bootstrap.cc:654] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.020133 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.021257 27303 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:54.022111 27376 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.005003 27346 ts_tablet_manager.cc:1434] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:09:54.004807 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.026788 27346 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.026973 27349 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.027413 27349 ts_tablet_manager.cc:1403] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 13:09:54.027367 27376 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.029590 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:54.030333 27232 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.030262 27349 raft_consensus.cc:359] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.031016 27349 raft_consensus.cc:385] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.031531 27349 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.032220 27349 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.033293 27346 tablet_bootstrap.cc:654] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.034185 27195 leader_election.cc:343] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.034691 27349 ts_tablet_manager.cc:1434] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:09:54.005736 27458 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.006549 27054 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.035698 27349 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.022848 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.037901 27354 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.038875 27346 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.023568 27378 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.039398 27346 ts_tablet_manager.cc:1403] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
W20260709 13:09:54.004401 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:54.024890 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64896.7us
I20260709 13:09:54.043877 27349 tablet_bootstrap.cc:654] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.005767 27347 tablet_bootstrap.cc:654] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.045890 27346 raft_consensus.cc:359] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.046665 27346 raft_consensus.cc:385] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.046923 27346 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.047708 27346 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.050011 27346 ts_tablet_manager.cc:1434] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:09:54.052074 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:54.052489 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:54.053977 27269 leader_election.cc:343] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:54.058022 27269 leader_election.cc:343] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.058449 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.059914 27351 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.061120 27232 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.065701 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:54.067323 27197 leader_election.cc:343] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.067814 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.068992 27458 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.069381 27400 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.069911 27400 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.070855 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:54.072137 27400 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.078286 27476 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.078867 27476 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:54.079799 27476 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.083158 27351 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.083662 27351 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.085531 27354 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.085788 27351 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.088732 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.089334 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.090243 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.104959 27153 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:54.103590 27053 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.090710 27400 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.091048 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.106652 27155 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:54.098424 27346 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.108537 27195 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:54.110984 27400 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.111451 27400 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.111873 27400 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.118137 27458 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.118932 27197 leader_election.cc:343] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.118706 27458 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.120930 27272 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.122447 27351 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.122931 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.123783 27153 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:54.121138 27458 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.127105 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.130570 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.132411 27458 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.134362 27476 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.135030 27476 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.139647 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.140480 27153 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.141517 27458 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.142234 27269 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:54.143316 27376 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.143769 27376 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.144166 27376 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.152092 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.137964 27476 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:09:54.157212 27272 leader_election.cc:343] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.165742 27346 tablet_bootstrap.cc:654] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.167662 27400 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.172119 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:54.173048 27155 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.175010 27351 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.191321 27376 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.194397 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:54.194970 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:54.195580 27153 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.198223 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:09:54.202214 27197 leader_election.cc:343] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.201001 27155 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:54.204399 27195 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.210142 27458 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.210965 27458 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:54.212203 27458 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:54.214800 27272 leader_election.cc:343] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.196580 27400 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.196977 27376 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.241523 27347 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.242321 27347 ts_tablet_manager.cc:1403] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.244s	user 0.033s	sys 0.031s
I20260709 13:09:54.236208 27153 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.247920 27269 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.257555 27349 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.253115 27347 raft_consensus.cc:359] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.262152 27347 raft_consensus.cc:385] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.262270 27351 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.262329 27349 ts_tablet_manager.cc:1403] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.227s	user 0.049s	sys 0.051s
I20260709 13:09:54.262526 27347 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.262915 27351 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:54.263676 27347 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.263860 27351 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.265523 27347 ts_tablet_manager.cc:1434] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260709 13:09:54.265792 27354 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.266544 27347 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.266371 27354 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.268703 27354 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.269378 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.269840 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.270045 27232 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
W20260709 13:09:54.271353 27122 leader_election.cc:343] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.272253 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.273703 27354 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.269670 27349 raft_consensus.cc:359] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.274271 27354 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.274398 27349 raft_consensus.cc:385] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.270678 27053 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.274806 27354 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.274857 27349 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.276623 27349 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.278971 27349 ts_tablet_manager.cc:1434] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:54.279896 27349 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.286435 27347 tablet_bootstrap.cc:654] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.288125 27346 tablet_bootstrap.cc:492] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.288609 27349 tablet_bootstrap.cc:654] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.288642 27346 ts_tablet_manager.cc:1403] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.190s	user 0.041s	sys 0.051s
I20260709 13:09:54.292088 27346 raft_consensus.cc:359] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.293198 27346 raft_consensus.cc:385] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.293483 27346 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.285784 27054 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.305408 27354 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.307964 27346 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.309508 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:54.310145 27232 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.310325 27346 ts_tablet_manager.cc:1434] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:54.311297 27354 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.317101 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:54.318461 27346 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
W20260709 13:09:54.319329 27122 leader_election.cc:343] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.328843 27347 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.329551 27347 ts_tablet_manager.cc:1403] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.011s
I20260709 13:09:54.330111 27232 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:54.331609 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.334287 27347 raft_consensus.cc:359] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.335319 27347 raft_consensus.cc:385] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.335681 27347 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.337956 27354 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.338519 27354 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:54.339349 27354 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.325798 27346 tablet_bootstrap.cc:654] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.343988 27351 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:54.350397 27347 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.351253 27349 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.351780 27349 ts_tablet_manager.cc:1403] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.072s	user 0.035s	sys 0.024s
I20260709 13:09:54.355001 27347 ts_tablet_manager.cc:1434] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.007s
I20260709 13:09:54.354933 27349 raft_consensus.cc:359] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.355643 27349 raft_consensus.cc:385] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.355906 27349 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.357254 27347 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.356878 27349 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.360462 27349 ts_tablet_manager.cc:1434] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:09:54.363404 27052 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.367288 27346 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.367892 27346 ts_tablet_manager.cc:1403] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 13:09:54.370553 27349 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.370838 27346 raft_consensus.cc:359] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.371579 27346 raft_consensus.cc:385] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.371876 27346 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.372689 27346 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.375254 27346 ts_tablet_manager.cc:1434] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:09:54.376428 27346 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.376770 27347 tablet_bootstrap.cc:654] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.377965 27354 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.378473 27354 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.380700 27354 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.381892 27349 tablet_bootstrap.cc:654] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.382438 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.384833 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.385839 27232 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:54.392886 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.394865 27374 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.400185 27347 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.400713 27347 ts_tablet_manager.cc:1403] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:09:54.400709 27354 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.412364 27476 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.416857 27458 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.404017 27347 raft_consensus.cc:359] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.419328 27347 raft_consensus.cc:385] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.419611 27347 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.426271 27458 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:54.421648 27347 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.432231 27347 ts_tablet_manager.cc:1434] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:09:54.433213 27347 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.451020 27349 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.451584 27349 ts_tablet_manager.cc:1403] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.058s
I20260709 13:09:54.453312 27347 tablet_bootstrap.cc:654] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.454569 27376 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.455098 27376 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.457329 27376 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.459322 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.459295 27349 raft_consensus.cc:359] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.460163 27349 raft_consensus.cc:385] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.460453 27349 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.460310 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.463061 27232 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:09:54.461154 27354 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.464291 27272 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.461155 27349 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.465624 27376 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.466789 27346 tablet_bootstrap.cc:654] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.467303 27349 ts_tablet_manager.cc:1434] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:54.468348 27349 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.473418 27376 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.475260 27349 tablet_bootstrap.cc:654] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.485258 27458 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.488691 27346 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.489406 27346 ts_tablet_manager.cc:1403] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.000s
I20260709 13:09:54.495255 27347 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.495944 27347 ts_tablet_manager.cc:1403] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 13:09:54.491585 27376 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.498656 27376 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.504452 27376 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.505452 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:54.507016 27269 leader_election.cc:343] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.508904 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.509599 27232 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.509181 27346 raft_consensus.cc:359] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.510186 27346 raft_consensus.cc:385] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.510526 27346 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.510671 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:54.511233 27346 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.514106 27346 ts_tablet_manager.cc:1434] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:09:54.515141 27376 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.515385 27346 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.515547 27376 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.515961 27376 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.519673 27347 raft_consensus.cc:359] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.520646 27347 raft_consensus.cc:385] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.520979 27347 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.521847 27347 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.525774 27347 ts_tablet_manager.cc:1434] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:09:54.527048 27347 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.531133 27476 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.531705 27476 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.534875 27374 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.535359 27374 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.537441 27374 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.537730 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.538403 27232 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.538597 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.539163 27346 tablet_bootstrap.cc:654] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.539284 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:54.540223 27197 leader_election.cc:343] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.540227 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:54.541436 27403 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.533862 27476 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.541888 27403 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.542045 27347 tablet_bootstrap.cc:654] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.542039 27195 leader_election.cc:343] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.542354 27403 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.542682 27195 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.545747 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.546468 27155 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.548409 27397 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.557737 27376 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.559636 27349 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.560490 27349 ts_tablet_manager.cc:1403] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.036s
I20260709 13:09:54.560904 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:54.562816 27269 leader_election.cc:343] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.563853 27376 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.565516 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:54.566228 27232 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.570986 27349 raft_consensus.cc:359] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.571739 27349 raft_consensus.cc:385] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.572039 27349 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.572999 27346 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.572731 27349 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.573560 27346 ts_tablet_manager.cc:1403] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.010s
I20260709 13:09:54.573772 27232 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.575024 27349 ts_tablet_manager.cc:1434] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:54.575141 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:54.575981 27349 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.576313 27376 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.576807 27376 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:54.577736 27376 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.579174 27403 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.576786 27346 raft_consensus.cc:359] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.582145 27346 raft_consensus.cc:385] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.582576 27346 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.583542 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:54.590860 27346 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.592046 27349 tablet_bootstrap.cc:654] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.591822 27156 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.594097 27346 ts_tablet_manager.cc:1434] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:09:54.596297 27346 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.601230 27156 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.602393 27269 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:54.603442 27476 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.604141 27476 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:54.604954 27476 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.613804 27351 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.614416 27351 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.615682 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:54.616453 27230 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.617097 27351 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.618400 27346 tablet_bootstrap.cc:654] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.619902 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.620693 27156 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.622007 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:54.617653 27351 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:54.623076 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.623096 27464 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.624819 27464 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:54.624902 27272 leader_election.cc:343] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.625192 27464 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.632099 27347 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.632869 27347 ts_tablet_manager.cc:1403] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.015s
I20260709 13:09:54.636261 27349 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.636778 27349 ts_tablet_manager.cc:1403] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.006s
I20260709 13:09:54.640471 27403 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.641932 27349 raft_consensus.cc:359] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.642699 27349 raft_consensus.cc:385] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.643011 27349 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.644143 27464 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.644305 27349 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.646570 27349 ts_tablet_manager.cc:1434] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:54.647644 27349 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.648188 27230 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.648159 27351 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.652593 27347 raft_consensus.cc:359] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.654310 27347 raft_consensus.cc:385] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.655077 27347 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.655663 27346 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.656842 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:54.659610 27346 ts_tablet_manager.cc:1403] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.007s
I20260709 13:09:54.660125 27153 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.663748 27346 raft_consensus.cc:359] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.664588 27346 raft_consensus.cc:385] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.663779 27464 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.664937 27346 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.666265 27346 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.656375 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:09:54.668617 27272 leader_election.cc:343] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.668767 27346 ts_tablet_manager.cc:1434] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:54.669888 27346 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.673380 27153 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:54.659075 27349 tablet_bootstrap.cc:654] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.674754 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:09:54.676147 27403 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.676370 27346 tablet_bootstrap.cc:654] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.677011 27403 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:54.678130 27403 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.684136 27349 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.684636 27349 ts_tablet_manager.cc:1403] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.001s
I20260709 13:09:54.656239 27347 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.687577 27347 ts_tablet_manager.cc:1434] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:09:54.687455 27349 raft_consensus.cc:359] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.688167 27349 raft_consensus.cc:385] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.688453 27349 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.689152 27349 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.688539 27347 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.694344 27346 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.694834 27346 ts_tablet_manager.cc:1403] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:09:54.698081 27397 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.698647 27397 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.699426 27349 ts_tablet_manager.cc:1434] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:54.700402 27349 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.702811 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:54.704072 27197 leader_election.cc:343] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.704833 27397 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.706411 27349 tablet_bootstrap.cc:654] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.705624 27055 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.697834 27346 raft_consensus.cc:359] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.709499 27346 raft_consensus.cc:385] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.709764 27346 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.710481 27346 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.712343 27346 ts_tablet_manager.cc:1434] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:09:54.712836 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.713275 27346 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
W20260709 13:09:54.714241 27195 leader_election.cc:343] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.714730 27195 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.715934 27397 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.717911 27347 tablet_bootstrap.cc:654] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.720314 27346 tablet_bootstrap.cc:654] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.730535 27055 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.732295 27305 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.739339 27347 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.740029 27458 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:54.740182 27347 ts_tablet_manager.cc:1403] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 13:09:54.732302 27055 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.745850 27347 raft_consensus.cc:359] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.746906 27347 raft_consensus.cc:385] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.747287 27347 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.748194 27347 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.748751 27349 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.749277 27349 ts_tablet_manager.cc:1403] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:09:54.752105 27347 ts_tablet_manager.cc:1434] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:54.752055 27349 raft_consensus.cc:359] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.752758 27349 raft_consensus.cc:385] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.753046 27349 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.753319 27347 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.753823 27349 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.755059 27374 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.756735 27349 ts_tablet_manager.cc:1434] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:54.757795 27349 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.760922 27347 tablet_bootstrap.cc:654] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.764214 27349 tablet_bootstrap.cc:654] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.769598 27346 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.770284 27346 ts_tablet_manager.cc:1403] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.015s
I20260709 13:09:54.773231 27346 raft_consensus.cc:359] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.773902 27346 raft_consensus.cc:385] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.774252 27346 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.775079 27346 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.778331 27346 ts_tablet_manager.cc:1434] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:54.779455 27346 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.782864 27347 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.783488 27347 ts_tablet_manager.cc:1403] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.009s
I20260709 13:09:54.786046 27346 tablet_bootstrap.cc:654] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:54.796254 27349 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.796736 27349 ts_tablet_manager.cc:1403] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.008s
I20260709 13:09:54.799319 27347 raft_consensus.cc:359] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.799563 27349 raft_consensus.cc:359] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.800122 27347 raft_consensus.cc:385] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.800590 27347 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.800154 27349 raft_consensus.cc:385] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.801827 27347 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.802518 27349 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.803812 27347 ts_tablet_manager.cc:1434] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:09:54.804798 27347 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.806834 27412 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.808341 27349 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.807298 27412 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.814844 27412 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.815369 27349 ts_tablet_manager.cc:1434] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:09:54.816390 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.817034 27230 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:54.816602 27349 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.819625 27123 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:54.810609 27354 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:54.820624 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.821820 27354 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.822217 27354 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.822576 27347 tablet_bootstrap.cc:654] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.831008 27122 leader_election.cc:343] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.822567 27354 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.842186 27230 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.847609 27354 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.850438 27346 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:54.850994 27346 ts_tablet_manager.cc:1403] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.000s
I20260709 13:09:54.850821 27522 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:54.858747 27354 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.860283 27347 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:54.860754 27347 ts_tablet_manager.cc:1403] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.002s
I20260709 13:09:54.860972 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:54.860986 27349 tablet_bootstrap.cc:654] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:54.865167 27122 leader_election.cc:343] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.866798 27376 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:54.868326 27403 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:54.868443 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:54.870239 27232 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.880054 27400 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.880923 27349 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:54.880609 27400 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.886520 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:54.888577 27195 leader_election.cc:343] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.885787 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:54.890971 27197 leader_election.cc:343] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.891575 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.893496 27374 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:54.894268 27346 raft_consensus.cc:359] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.894804 27400 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.895411 27346 raft_consensus.cc:385] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.895865 27346 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.896225 27349 ts_tablet_manager.cc:1403] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.000s
I20260709 13:09:54.896746 27346 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.915514 27232 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:54.917619 27123 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.917968 27349 raft_consensus.cc:359] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.921590 27349 raft_consensus.cc:385] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.922449 27349 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.923851 27349 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.933323 27522 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:54.941718 27346 ts_tablet_manager.cc:1434] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:09:54.942934 27346 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:54.946020 27400 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.946557 27400 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.942505 27522 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:54.948745 27400 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.951467 27349 ts_tablet_manager.cc:1434] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.007s
I20260709 13:09:54.952461 27349 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:54.953948 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.954631 27156 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:54.957369 27347 raft_consensus.cc:359] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.958122 27347 raft_consensus.cc:385] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:54.958391 27347 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:54.957445 27476 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.962487 27476 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.964749 27476 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.965409 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:54.966244 27374 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.960578 27412 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.966647 27374 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.967046 27374 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.966892 27412 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.969097 27412 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.970646 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.971673 27354 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.972208 27122 leader_election.cc:343] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:54.972165 27354 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.972793 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.973506 27229 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:54.974470 27354 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:54.975852 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:54.976514 27153 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:54.949173 27522 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.977056 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.977557 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:54.982729 27400 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.983759 27347 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.984181 27400 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.984668 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:54.985951 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:54.986470 27228 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:54.989396 27412 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:54.991403 27412 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.991770 27412 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:54.980257 27305 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:54.995069 27347 ts_tablet_manager.cc:1434] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.013s
I20260709 13:09:54.996354 27347 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:54.999689 27374 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:54.996110 27123 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:55.002848 27354 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.004938 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:55.005653 27229 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:55.005990 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.006606 27374 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.006753 27153 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.008378 27351 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.008870 27351 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.011696 27351 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:54.996340 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:55.021328 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:55.022395 27229 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:55.024716 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:55.025534 27376 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.025908 27376 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.026302 27376 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.027274 27354 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.027653 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.029837 27400 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.030753 27351 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.031250 27351 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.033198 27153 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:55.033967 27376 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.035221 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.036047 27349 tablet_bootstrap.cc:654] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:55.043176 27195 leader_election.cc:343] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.035787 27412 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.037185 27464 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.044934 27464 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.046499 27412 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.047133 27464 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.047186 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:55.048486 27376 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:09:55.048822 27122 leader_election.cc:343] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.053095 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:55.053735 27230 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.037775 27351 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.060173 27053 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.062191 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:55.064678 27306 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.076025 27347 tablet_bootstrap.cc:654] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.069015 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:55.088598 27374 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.089144 27374 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:55.089988 27374 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.095249 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:55.095920 27232 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.099586 27346 tablet_bootstrap.cc:654] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.101487 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:55.105237 27229 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
W20260709 13:09:55.106736 27269 leader_election.cc:343] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.108338 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.108450 27464 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.109694 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:55.110499 27464 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.110868 27464 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.111207 27464 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.118752 27232 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:55.119685 27349 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.120290 27230 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:55.120198 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:55.120232 27349 ts_tablet_manager.cc:1403] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.013s
I20260709 13:09:55.121601 27306 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:55.126315 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.127349 27349 raft_consensus.cc:359] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.128103 27349 raft_consensus.cc:385] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.128404 27349 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.129225 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:55.131500 27197 leader_election.cc:343] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.132033 27197 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.129321 27349 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.133232 27397 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.133900 27053 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.125039 27376 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.140612 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.150312 27349 ts_tablet_manager.cc:1434] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:09:55.151374 27349 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.152042 27351 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.145840 27376 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:55.156296 27476 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.154273 27529 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.158506 27529 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:55.158936 27464 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:55.159778 27272 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.162865 27351 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.163754 27376 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.164846 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:09:55.166798 27269 leader_election.cc:343] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.167757 27346 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:55.169862 27230 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.159521 27529 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.170940 27346 ts_tablet_manager.cc:1403] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.016s
W20260709 13:09:55.177661 27269 leader_election.cc:343] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:55.177883 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:55.178399 27347 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:55.180063 27347 ts_tablet_manager.cc:1403] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.000s
I20260709 13:09:55.182034 27374 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.181777 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:55.183224 27232 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.183143 27374 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.184773 27346 raft_consensus.cc:359] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.185432 27346 raft_consensus.cc:385] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.185684 27346 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.185803 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.186434 27156 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.180138 27464 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.186461 27230 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:55.188050 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.188735 27272 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:09:55.189244 27195 leader_election.cc:343] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.189931 27346 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.190177 27374 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.192520 27464 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.193068 27464 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:55.193840 27464 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.198558 27346 ts_tablet_manager.cc:1434] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:55.198257 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.199407 27232 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:55.199689 27346 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:55.199747 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:55.201402 27269 leader_election.cc:343] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.202684 27403 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.209338 27347 raft_consensus.cc:359] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.210301 27347 raft_consensus.cc:385] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.210623 27347 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
W20260709 13:09:55.212311 27197 leader_election.cc:343] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.212936 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.214715 27397 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.228724 27349 tablet_bootstrap.cc:654] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.202698 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:55.205505 27053 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.231127 27464 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.231634 27464 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:55.232527 27464 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.233497 27347 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.241953 27347 ts_tablet_manager.cc:1434] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:09:55.242971 27347 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:55.247469 27346 tablet_bootstrap.cc:654] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.264356 27403 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:55.271109 27403 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:55.275581 27156 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:55.283078 27053 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.287262 27053 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.301061 27347 tablet_bootstrap.cc:654] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.330608 27349 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.331225 27349 ts_tablet_manager.cc:1403] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.180s	user 0.007s	sys 0.013s
I20260709 13:09:55.339996 27349 raft_consensus.cc:359] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.340669 27349 raft_consensus.cc:385] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.340942 27349 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.344798 27349 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.347560 27349 ts_tablet_manager.cc:1434] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:09:55.349156 27349 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.350414 27346 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:55.350950 27346 ts_tablet_manager.cc:1403] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.007s
I20260709 13:09:55.353870 27346 raft_consensus.cc:359] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.354681 27346 raft_consensus.cc:385] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.355000 27346 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.355504 27349 tablet_bootstrap.cc:654] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.356693 27346 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.361408 27347 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:55.361889 27347 ts_tablet_manager.cc:1403] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.009s
I20260709 13:09:55.362499 27346 ts_tablet_manager.cc:1434] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:55.362088 27052 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.363566 27346 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:55.364641 27347 raft_consensus.cc:359] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.365337 27347 raft_consensus.cc:385] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.365613 27347 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.366482 27347 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.368664 27347 ts_tablet_manager.cc:1434] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:55.371726 27346 tablet_bootstrap.cc:654] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.372191 27349 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.372682 27349 ts_tablet_manager.cc:1403] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 13:09:55.375164 27347 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:55.375995 27349 raft_consensus.cc:359] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.376699 27349 raft_consensus.cc:385] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.376969 27349 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.377722 27349 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.380347 27349 ts_tablet_manager.cc:1434] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:09:55.381271 27349 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.382459 27347 tablet_bootstrap.cc:654] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.388249 27349 tablet_bootstrap.cc:654] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.390478 27403 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.390990 27403 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.393327 27403 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.394920 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.395752 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:09:55.396394 27269 leader_election.cc:343] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.396556 27229 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:55.398031 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:55.399411 27403 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.399942 27403 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.400328 27403 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.408995 27403 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.410496 27349 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.413029 27349 ts_tablet_manager.cc:1403] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 13:09:55.411041 27347 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:55.413971 27347 ts_tablet_manager.cc:1403] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.008s
I20260709 13:09:55.414906 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.416035 27349 raft_consensus.cc:359] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.416728 27349 raft_consensus.cc:385] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:55.416710 27269 leader_election.cc:343] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.417027 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:55.418273 27229 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.417318 27349 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.419147 27349 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.417616 27347 raft_consensus.cc:359] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.419905 27403 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.420142 27347 raft_consensus.cc:385] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.420727 27374 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.426296 27374 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.422029 27349 ts_tablet_manager.cc:1434] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:55.428548 27349 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.428448 27374 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.437206 27349 tablet_bootstrap.cc:654] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.429926 27347 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.429924 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.440510 27155 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:55.430929 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.441970 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:09:55.442834 27197 leader_election.cc:343] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.443372 27374 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.444000 27374 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.444557 27374 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.450891 27349 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.450783 27347 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.451411 27349 ts_tablet_manager.cc:1403] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.015s
I20260709 13:09:55.456498 27347 ts_tablet_manager.cc:1434] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.004s
I20260709 13:09:55.457600 27347 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:55.454622 27349 raft_consensus.cc:359] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.459833 27349 raft_consensus.cc:385] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.460161 27349 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.425263 27229 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:55.460991 27349 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.461547 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:55.462807 27403 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.463297 27349 ts_tablet_manager.cc:1434] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:55.463615 27403 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:55.464479 27349 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.464541 27403 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.458483 27374 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.479025 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.479772 27155 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.480540 27349 tablet_bootstrap.cc:654] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.482607 27347 tablet_bootstrap.cc:654] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.485610 27374 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.486972 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:09:55.488873 27197 leader_election.cc:343] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.490731 27155 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:55.497572 27522 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.507047 27397 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.518203 27306 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.519125 27397 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.519842 27397 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.529657 27349 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.530231 27349 ts_tablet_manager.cc:1403] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.066s	user 0.034s	sys 0.031s
I20260709 13:09:55.512517 27374 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.533707 27374 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.539034 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.539961 27374 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:55.540849 27197 leader_election.cc:343] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.570008 27531 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:55.573246 27229 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.588771 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.589169 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.621402 27155 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:55.628450 27346 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:55.629009 27346 ts_tablet_manager.cc:1403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.266s	user 0.046s	sys 0.066s
I20260709 13:09:55.633621 27349 raft_consensus.cc:359] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.634473 27349 raft_consensus.cc:385] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.634771 27349 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.635566 27349 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.637137 27349 ts_tablet_manager.cc:1434] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.107s	user 0.026s	sys 0.022s
I20260709 13:09:55.638124 27349 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.628607 27397 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.643929 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.647436 27347 tablet_bootstrap.cc:492] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:55.581959 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.649920 27347 ts_tablet_manager.cc:1403] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.029s
I20260709 13:09:55.655970 27347 raft_consensus.cc:359] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.656819 27347 raft_consensus.cc:385] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.657083 27347 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.657748 27347 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.659353 27347 ts_tablet_manager.cc:1434] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:09:55.661303 27347 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:55.663224 27400 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:55.669013 27122 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.659875 27306 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:55.678555 27349 tablet_bootstrap.cc:654] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:55.681455 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 93292us
I20260709 13:09:55.675498 27558 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.692299 27558 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:55.693233 27558 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.690938 27346 raft_consensus.cc:359] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.696803 27346 raft_consensus.cc:385] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.697084 27346 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
W20260709 13:09:55.685254 27195 leader_election.cc:343] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.708482 27346 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.712975 27195 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.714085 27400 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.714463 27400 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.714800 27400 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.715771 27346 ts_tablet_manager.cc:1434] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.004s
I20260709 13:09:55.716760 27346 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:55.725069 27347 tablet_bootstrap.cc:654] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.728730 27053 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.729091 27400 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.731818 27400 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:55.743527 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 82212.9us
I20260709 13:09:55.748519 27346 tablet_bootstrap.cc:654] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:55.751381 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:55.752209 27156 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.774035 27558 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.774683 27558 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.775580 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:55.776928 27558 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.781514 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:55.782563 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.785617 27558 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:55.789672 27558 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.790192 27558 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.794387 27464 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.783326 27156 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
W20260709 13:09:55.788288 27195 leader_election.cc:343] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.797220 27195 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:55.800655 27560 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:55.801175 27560 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:55.801563 27376 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:55.802021 27560 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.800081 27558 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.808876 27558 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.803341 27376 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:55.817476 27349 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:55.818001 27349 ts_tablet_manager.cc:1403] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.024s
W20260709 13:09:55.823323 27197 leader_election.cc:343] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.828981 27052 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.833442 27563 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.833994 27563 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.836269 27563 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.832988 27347 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:55.837009 27347 ts_tablet_manager.cc:1403] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.002s
I20260709 13:09:55.844810 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.848207 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.856871 27347 raft_consensus.cc:359] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.857658 27347 raft_consensus.cc:385] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.857940 27347 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.868866 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:55.857486 27269 consensus_peers.cc:597] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.856895 27195 leader_election.cc:343] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.884475 27347 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.889937 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:55.890865 27304 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:55.891970 27529 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:55.892283 27197 leader_election.cc:343] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:55.853446 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 53487.9us
I20260709 13:09:55.896482 27347 ts_tablet_manager.cc:1434] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
W20260709 13:09:55.887076 27195 leader_election.cc:343] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:55.897653 27347 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:55.915056 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:55.894519 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:55.928263 27349 raft_consensus.cc:359] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.928810 27349 raft_consensus.cc:385] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.930637 27560 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:55.926100 27304 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:55.929581 27349 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.939924 27349 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.941689 27349 ts_tablet_manager.cc:1434] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.123s	user 0.003s	sys 0.001s
I20260709 13:09:55.942636 27349 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:55.943504 27403 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.943990 27403 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.944679 27346 tablet_bootstrap.cc:492] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:55.945232 27346 ts_tablet_manager.cc:1403] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.229s	user 0.071s	sys 0.066s
I20260709 13:09:55.942730 27053 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.948554 27403 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:55.960249 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:55.961210 27156 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:55.969854 27346 raft_consensus.cc:359] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.971107 27346 raft_consensus.cc:385] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:55.971514 27346 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:55.992865 27522 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.993424 27522 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.996079 27522 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:55.999038 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:56.000662 27122 leader_election.cc:343] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.003034 27403 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.003724 27403 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:55.990746 27558 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.004725 27558 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.009681 27403 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:56.014959 27558 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.019955 27346 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.021443 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.022367 27346 ts_tablet_manager.cc:1434] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.077s	user 0.013s	sys 0.007s
I20260709 13:09:56.023056 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:56.023545 27269 leader_election.cc:343] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:56.025439 27195 leader_election.cc:343] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.035724 27347 tablet_bootstrap.cc:654] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:56.041986 27269 consensus_peers.cc:597] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.045722 27346 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.050736 27156 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.051836 27349 tablet_bootstrap.cc:654] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:56.047608 27197 leader_election.cc:343] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.060066 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.062453 27464 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.068817 27560 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.070191 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:56.070945 27227 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:56.071844 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:56.072428 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:56.078323 27464 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.081579 27464 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.084244 27560 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.084486 27346 tablet_bootstrap.cc:654] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.084852 27560 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:56.086434 27560 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.095392 27349 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.097262 27349 ts_tablet_manager.cc:1403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.003s
I20260709 13:09:56.105108 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:56.109513 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:56.111570 27347 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.083065 27272 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:56.112112 27347 ts_tablet_manager.cc:1403] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.008s
I20260709 13:09:56.112586 27403 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:56.115222 27403 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.115669 27403 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.116473 27347 raft_consensus.cc:359] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.117020 27347 raft_consensus.cc:385] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.117254 27347 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.117787 27347 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.121172 27347 ts_tablet_manager.cc:1434] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:56.123687 27347 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
W20260709 13:09:56.126750 27123 leader_election.cc:343] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.127468 27123 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:56.129045 27531 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:56.134037 27197 leader_election.cc:343] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.133662 27349 raft_consensus.cc:359] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.134718 27197 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.134886 27349 raft_consensus.cc:385] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.135493 27349 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.135689 27560 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:56.129267 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46302.8us
I20260709 13:09:56.137217 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:56.136543 27349 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.138188 27464 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.140276 27349 ts_tablet_manager.cc:1434] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:09:56.141295 27349 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.150846 27403 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.154940 27403 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:56.154826 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:56.157620 27269 leader_election.cc:343] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.160180 27464 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.161785 27052 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.167925 27346 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.168468 27346 ts_tablet_manager.cc:1403] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.018s
I20260709 13:09:56.171895 27349 tablet_bootstrap.cc:654] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.172290 27564 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:56.176770 27346 raft_consensus.cc:359] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.177491 27346 raft_consensus.cc:385] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.177802 27346 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.178771 27347 tablet_bootstrap.cc:654] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.179921 27346 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.183485 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:56.188042 27228 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.188858 27346 ts_tablet_manager.cc:1434] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:56.189807 27346 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.199028 27306 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.217645 27564 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:56.221336 27346 tablet_bootstrap.cc:654] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.230059 27228 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:56.262737 27272 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:56.264245 27464 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.264760 27464 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:56.267740 27349 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.267484 27558 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:56.268220 27349 ts_tablet_manager.cc:1403] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.005s
I20260709 13:09:56.265712 27464 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.286734 27349 raft_consensus.cc:359] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.289235 27349 raft_consensus.cc:385] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.289608 27349 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.290812 27349 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.294613 27346 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.295501 27346 ts_tablet_manager.cc:1403] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.011s
I20260709 13:09:56.290910 27560 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.297425 27560 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.300673 27560 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.303785 27347 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.308094 27347 ts_tablet_manager.cc:1403] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.186s	user 0.007s	sys 0.032s
I20260709 13:09:56.308818 27349 ts_tablet_manager.cc:1434] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:09:56.309896 27349 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.312981 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:56.321480 27347 raft_consensus.cc:359] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.323244 27347 raft_consensus.cc:385] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.323560 27347 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.357553 27347 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.323534 27531 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.359722 27346 raft_consensus.cc:359] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.361711 27346 raft_consensus.cc:385] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.362087 27346 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
W20260709 13:09:56.343716 27197 leader_election.cc:343] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.362897 27346 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.363987 27347 ts_tablet_manager.cc:1434] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.056s	user 0.027s	sys 0.011s
I20260709 13:09:56.365051 27347 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:56.365581 27531 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.373195 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:56.376538 27197 consensus_peers.cc:597] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.378639 27564 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.378733 27531 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.379436 27349 tablet_bootstrap.cc:654] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.379261 27564 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.380988 27346 ts_tablet_manager.cc:1434] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:09:56.382303 27346 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.387467 27564 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.389869 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:56.390180 27349 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.391295 27349 ts_tablet_manager.cc:1403] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.000s
W20260709 13:09:56.391947 27197 leader_election.cc:343] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.392307 27347 tablet_bootstrap.cc:654] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.394269 27349 raft_consensus.cc:359] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.395030 27349 raft_consensus.cc:385] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.395347 27349 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.396409 27349 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.399629 27349 ts_tablet_manager.cc:1434] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:56.400635 27347 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.458884 27347 ts_tablet_manager.cc:1403] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.002s
I20260709 13:09:56.460259 27346 tablet_bootstrap.cc:654] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.475620 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:09:56.465487 27195 leader_election.cc:343] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.478428 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:56.479007 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.480811 27558 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.488262 27122 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:56.400882 27349 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.492731 27529 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.465824 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.498703 27153 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:56.510716 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.465781 27347 raft_consensus.cc:359] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.515715 27347 raft_consensus.cc:385] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.516304 27347 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.516775 27564 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:56.517227 27564 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.517608 27564 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.517387 27347 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.521950 27346 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.525005 27347 ts_tablet_manager.cc:1434] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 13:09:56.527079 27403 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.527987 27347 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:56.538672 27157 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.553175 27349 tablet_bootstrap.cc:654] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.547552 27403 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.558391 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:56.559381 27231 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:56.560722 27564 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.561254 27272 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:56.562453 27376 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:56.562568 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52104.4us
I20260709 13:09:56.562891 27376 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.563266 27376 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.565397 27346 ts_tablet_manager.cc:1403] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.006s
W20260709 13:09:56.575235 27195 consensus_peers.cc:597] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.568488 27403 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:56.576200 27569 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.577001 27569 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.580084 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.589743 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:56.583662 27055 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.589849 27155 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:56.590168 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:56.590478 27154 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.587420 27564 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.596884 27376 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.602687 27569 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:09:56.603166 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:56.604537 27197 leader_election.cc:343] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.605309 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:56.610044 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.622555 27376 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:56.628409 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:56.629549 27155 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.631348 27269 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:56.632422 27376 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.638415 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:56.639396 27231 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.649302 27155 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:56.651175 27346 raft_consensus.cc:359] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.659227 27346 raft_consensus.cc:385] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.659394 27347 tablet_bootstrap.cc:654] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.659511 27346 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.653949 27349 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.626181 27564 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:09:56.660766 27349 ts_tablet_manager.cc:1403] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.260s	user 0.015s	sys 0.012s
I20260709 13:09:56.657279 27154 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:56.670329 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.664789 27349 raft_consensus.cc:359] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.675297 27349 raft_consensus.cc:385] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.666397 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:56.675719 27349 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.676764 27403 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.677239 27403 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:56.678308 27403 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.680732 27400 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:56.681210 27400 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:56.678448 27349 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.682039 27400 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.685146 27349 ts_tablet_manager.cc:1434] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:09:56.685209 27597 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:56.696208 27349 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.665241 27346 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.704846 27346 ts_tablet_manager.cc:1434] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.004s
I20260709 13:09:56.706549 27346 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.715831 27564 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.666505 27231 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:56.717476 27564 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.737090 27157 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.754575 27564 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.763051 27052 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.776291 27400 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.790226 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.790671 27347 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.790591 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:56.791231 27349 tablet_bootstrap.cc:654] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.791271 27347 ts_tablet_manager.cc:1403] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.264s	user 0.020s	sys 0.011s
I20260709 13:09:56.791615 27400 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.800544 27347 raft_consensus.cc:359] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.801379 27347 raft_consensus.cc:385] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.801760 27346 tablet_bootstrap.cc:654] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.801705 27347 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.805750 27347 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.810039 27347 ts_tablet_manager.cc:1434] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:09:56.811568 27197 leader_election.cc:343] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.810114 27400 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.812143 27304 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:56.817258 27597 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:56.825579 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.812713 27055 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.816428 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:56.835673 27195 leader_election.cc:343] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.836234 27195 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.816463 27347 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:56.854857 27606 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:56.858451 27197 leader_election.cc:343] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:56.860858 27195 leader_election.cc:343] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.861367 27195 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.862278 27607 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.864933 27346 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.865573 27346 ts_tablet_manager.cc:1403] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.159s	user 0.026s	sys 0.023s
I20260709 13:09:56.868979 27346 raft_consensus.cc:359] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.869649 27346 raft_consensus.cc:385] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.869939 27346 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.870810 27346 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.876178 27346 ts_tablet_manager.cc:1434] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:09:56.877243 27346 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.884883 27346 tablet_bootstrap.cc:654] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.885422 27349 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.886082 27349 ts_tablet_manager.cc:1403] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.190s	user 0.015s	sys 0.004s
I20260709 13:09:56.891601 27347 tablet_bootstrap.cc:654] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.889585 27349 raft_consensus.cc:359] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.894317 27349 raft_consensus.cc:385] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.894670 27349 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.895546 27349 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.897809 27349 ts_tablet_manager.cc:1434] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:56.898043 27346 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.898567 27346 ts_tablet_manager.cc:1403] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.006s
I20260709 13:09:56.899360 27349 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.902289 27346 raft_consensus.cc:359] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.903203 27346 raft_consensus.cc:385] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.903519 27346 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.904388 27346 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.906816 27346 ts_tablet_manager.cc:1434] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:56.909039 27349 tablet_bootstrap.cc:654] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.911032 27346 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.913507 27558 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.914002 27558 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.916167 27558 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:56.918495 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:56.919909 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:56.920207 27195 leader_election.cc:343] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:56.921615 27197 leader_election.cc:343] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:56.922659 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:56.924701 27606 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:56.933980 27347 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.934577 27347 ts_tablet_manager.cc:1403] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.007s
I20260709 13:09:56.935808 27346 tablet_bootstrap.cc:654] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.937341 27347 raft_consensus.cc:359] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.938073 27347 raft_consensus.cc:385] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.938366 27347 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.939072 27347 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.941318 27347 ts_tablet_manager.cc:1434] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:09:56.942965 27347 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:56.946038 27349 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.946612 27349 ts_tablet_manager.cc:1403] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.015s
I20260709 13:09:56.949777 27349 raft_consensus.cc:359] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.950484 27349 raft_consensus.cc:385] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.950775 27349 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.951045 27347 tablet_bootstrap.cc:654] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.951536 27349 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.953769 27349 ts_tablet_manager.cc:1434] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:56.956820 27349 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.959625 27346 tablet_bootstrap.cc:492] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.964283 27346 ts_tablet_manager.cc:1403] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.033s
I20260709 13:09:56.966584 27349 tablet_bootstrap.cc:654] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.968928 27346 raft_consensus.cc:359] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.969762 27346 raft_consensus.cc:385] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.970110 27346 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.970793 27346 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.973345 27346 ts_tablet_manager.cc:1434] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:09:56.974149 27349 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:56.974532 27347 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:56.974684 27349 ts_tablet_manager.cc:1403] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:09:56.974983 27347 ts_tablet_manager.cc:1403] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 13:09:56.976228 27346 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:56.977614 27349 raft_consensus.cc:359] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.978413 27349 raft_consensus.cc:385] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.978686 27349 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.979408 27349 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.981859 27349 ts_tablet_manager.cc:1434] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:56.983026 27349 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:56.984418 27346 tablet_bootstrap.cc:654] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.983996 27347 raft_consensus.cc:359] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.985447 27347 raft_consensus.cc:385] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:56.988624 27347 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:56.989468 27347 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:56.991160 27349 tablet_bootstrap.cc:654] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:56.991959 27347 ts_tablet_manager.cc:1434] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:56.995158 27346 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:56.995664 27346 ts_tablet_manager.cc:1403] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:09:56.998247 27347 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.001189 27346 raft_consensus.cc:359] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.001956 27346 raft_consensus.cc:385] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.002274 27346 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.002883 27346 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.005079 27346 ts_tablet_manager.cc:1434] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:57.007616 27347 tablet_bootstrap.cc:654] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.009601 27346 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:57.016978 27346 tablet_bootstrap.cc:654] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.024616 27347 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.025168 27347 ts_tablet_manager.cc:1403] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:09:57.027994 27347 raft_consensus.cc:359] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.028841 27347 raft_consensus.cc:385] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.029153 27347 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.029978 27347 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.039556 27347 ts_tablet_manager.cc:1434] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:57.040735 27347 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.041064 27597 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.041311 27349 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:57.041893 27349 ts_tablet_manager.cc:1403] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.006s
I20260709 13:09:57.041625 27597 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.044003 27597 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:57.045186 27349 raft_consensus.cc:359] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.045634 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.045986 27349 raft_consensus.cc:385] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.046382 27228 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:57.046416 27349 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.046468 27608 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.047533 27349 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.048095 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.047313 27608 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.048710 27154 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:57.052999 27269 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:57.053821 27531 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.054366 27531 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.056895 27376 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.057260 27376 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.057543 27376 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.056506 27349 ts_tablet_manager.cc:1434] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:09:57.058440 27531 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.059202 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.059955 27228 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.061272 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:57.062551 27531 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.062892 27531 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.063246 27531 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.063139 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.064141 27304 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.071266 27608 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.072297 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.072297 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.074524 27347 tablet_bootstrap.cc:654] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.074321 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:57.075712 27529 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:57.059224 27349 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:57.085152 27531 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.089129 27376 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.094602 27558 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.098639 27558 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.099309 27376 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:57.100960 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:57.101554 27154 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.103240 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.103850 27155 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:57.101392 27558 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.107986 27349 tablet_bootstrap.cc:654] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.109854 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.119031 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:57.119740 27228 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.123255 27569 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:57.117573 27195 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:09:57.128317 27197 leader_election.cc:343] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.129004 27558 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.129463 27558 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.129850 27558 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.132711 27531 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.132925 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:57.133507 27304 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.138023 27154 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:57.139549 27269 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:57.140524 27597 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.139917 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:57.142035 27597 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:57.143064 27597 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.146404 27231 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.152856 27304 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:57.154507 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:57.159149 27228 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:57.160449 27346 tablet_bootstrap.cc:492] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:57.160463 27347 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.161074 27346 ts_tablet_manager.cc:1403] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.154s	user 0.040s	sys 0.024s
I20260709 13:09:57.161127 27347 ts_tablet_manager.cc:1403] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.033s
I20260709 13:09:57.156411 27531 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.166864 27347 raft_consensus.cc:359] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.167765 27347 raft_consensus.cc:385] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.168097 27347 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.170468 27531 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:57.170441 27607 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.174269 27347 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.193806 27347 ts_tablet_manager.cc:1434] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:09:57.196682 27347 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.177165 27607 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.173767 27531 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.200266 27607 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.179100 27558 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.206140 27558 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.215670 27349 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:57.216470 27349 ts_tablet_manager.cc:1403] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.157s	user 0.022s	sys 0.033s
I20260709 13:09:57.217486 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.217991 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.218811 27304 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:57.219363 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:57.219990 27153 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:57.222510 27195 leader_election.cc:343] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.221680 27346 raft_consensus.cc:359] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.224346 27346 raft_consensus.cc:385] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.224797 27346 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.225041 27607 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.225472 27558 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:57.225515 27607 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.227025 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:57.227669 27304 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.228016 27607 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.230778 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:57.225636 27346 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.232971 27607 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.234234 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.228822 27231 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:57.234622 27607 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.235127 27607 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:57.238271 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 51081.1us
I20260709 13:09:57.237638 27153 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:57.241382 27346 ts_tablet_manager.cc:1434] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.003s
W20260709 13:09:57.239464 27195 leader_election.cc:343] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.239418 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:57.249053 27197 leader_election.cc:343] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.249771 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:57.251487 27606 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:57.251868 27195 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:57.252697 27558 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.253185 27558 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:57.254014 27558 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.253516 27052 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:57.257573 27197 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.256381 27055 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.260664 27627 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.262908 27346 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:57.261937 27597 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:57.265226 27627 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.268555 27627 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:57.269632 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:57.272832 27269 leader_election.cc:343] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.275092 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.275820 27228 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:57.278192 27272 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:57.285594 27597 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.319583 27349 raft_consensus.cc:359] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.310316 27597 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.320765 27349 raft_consensus.cc:385] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.328572 27349 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
W20260709 13:09:57.330351 27629 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:57.332842 27346 tablet_bootstrap.cc:654] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.337486 27349 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.327696 27597 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.347427 27347 tablet_bootstrap.cc:654] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.340754 27304 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:57.354292 27607 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.356905 27607 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.382128 27400 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.382985 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:57.383227 27400 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.379385 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:57.384649 27305 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.385399 27400 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:57.389712 27195 leader_election.cc:343] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.388839 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:57.393841 27195 leader_election.cc:343] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.395110 27054 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.404876 27597 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.409688 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:57.410537 27231 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:57.413687 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 54413.8us
I20260709 13:09:57.417017 27349 ts_tablet_manager.cc:1434] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.200s	user 0.010s	sys 0.000s
I20260709 13:09:57.418241 27349 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:57.419387 27231 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:57.420629 27272 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:57.421389 27627 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.421900 27627 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:57.422758 27627 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.425770 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:57.427433 27269 leader_election.cc:343] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.441431 27305 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:57.444670 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.421383 27597 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:57.452123 27157 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.459120 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:09:57.461369 27197 leader_election.cc:343] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.461895 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:57.466228 27346 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:57.466763 27346 ts_tablet_manager.cc:1403] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.206s	user 0.010s	sys 0.008s
I20260709 13:09:57.470305 27634 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.471727 27634 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:57.472635 27634 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.478600 27633 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:57.483948 27346 raft_consensus.cc:359] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.483464 27052 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:57.484532 27346 raft_consensus.cc:385] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.484804 27346 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.485517 27346 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.488343 27347 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.488655 27346 ts_tablet_manager.cc:1434] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:57.492753 27346 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:57.489288 27347 ts_tablet_manager.cc:1403] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.293s	user 0.024s	sys 0.017s
I20260709 13:09:57.499101 27633 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.499620 27633 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.501722 27633 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.502617 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.502856 27347 raft_consensus.cc:359] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.503573 27347 raft_consensus.cc:385] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.503835 27347 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.504001 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:57.504076 27195 leader_election.cc:343] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.504534 27347 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.505470 27349 tablet_bootstrap.cc:654] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:57.507745 27197 leader_election.cc:343] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.508267 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:57.509485 27633 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:57.509783 27347 ts_tablet_manager.cc:1434] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:57.511022 27347 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.521931 27346 tablet_bootstrap.cc:654] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.526238 27347 tablet_bootstrap.cc:654] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.520291 27052 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.540493 27347 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.541131 27347 ts_tablet_manager.cc:1403] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:09:57.544876 27347 raft_consensus.cc:359] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.545814 27347 raft_consensus.cc:385] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.546190 27347 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.547006 27347 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.550261 27347 ts_tablet_manager.cc:1434] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:09:57.557420 27347 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.560019 27349 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:57.560501 27349 ts_tablet_manager.cc:1403] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.003s
I20260709 13:09:57.562844 27349 raft_consensus.cc:359] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.563536 27349 raft_consensus.cc:385] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.563835 27349 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.564602 27349 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.566278 27347 tablet_bootstrap.cc:654] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.568758 27346 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:57.569396 27346 ts_tablet_manager.cc:1403] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.025s
I20260709 13:09:57.573092 27346 raft_consensus.cc:359] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.574081 27346 raft_consensus.cc:385] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.574496 27346 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.575527 27346 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.578800 27349 ts_tablet_manager.cc:1434] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:57.579244 27346 ts_tablet_manager.cc:1434] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:57.579999 27349 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:57.581640 27346 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:57.587376 27347 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.587857 27347 ts_tablet_manager.cc:1403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.011s
I20260709 13:09:57.588029 27346 tablet_bootstrap.cc:654] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.590812 27347 raft_consensus.cc:359] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.591558 27347 raft_consensus.cc:385] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.591813 27347 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.592790 27349 tablet_bootstrap.cc:654] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.592581 27347 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.594939 27347 ts_tablet_manager.cc:1434] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:09:57.596124 27347 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.608651 27347 tablet_bootstrap.cc:654] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.613029 27569 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:57.615402 27347 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.615902 27347 ts_tablet_manager.cc:1403] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:09:57.618739 27347 raft_consensus.cc:359] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.619526 27347 raft_consensus.cc:385] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.619845 27347 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.620618 27347 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.621557 27608 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.622691 27347 ts_tablet_manager.cc:1434] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:57.623505 27608 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.624848 27347 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.630420 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.631012 27346 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:57.631062 27304 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.631596 27346 ts_tablet_manager.cc:1403] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.009s
I20260709 13:09:57.632566 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:57.632800 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.634232 27531 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.625851 27608 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.634690 27531 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.635123 27531 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.638036 27154 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.640834 27349 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:57.641317 27349 ts_tablet_manager.cc:1403] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 13:09:57.634145 27229 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.640588 27346 raft_consensus.cc:359] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.646844 27346 raft_consensus.cc:385] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.647171 27346 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.648340 27346 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.660619 27627 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:57.664664 27347 tablet_bootstrap.cc:654] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.680805 27349 raft_consensus.cc:359] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.681669 27349 raft_consensus.cc:385] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.681951 27349 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.684775 27531 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.689424 27349 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.691896 27531 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.702950 27531 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:57.703867 27304 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.725661 27346 ts_tablet_manager.cc:1434] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.010s
I20260709 13:09:57.735478 27634 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:57.761792 27569 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.762578 27569 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.765435 27569 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:09:57.767534 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:57.782217 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:57.783119 27306 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.785696 27349 ts_tablet_manager.cc:1434] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.000s
I20260709 13:09:57.796468 27349 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:57.799342 27651 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:57.821404 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.832777 27347 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:57.833698 27347 ts_tablet_manager.cc:1403] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.209s	user 0.006s	sys 0.015s
I20260709 13:09:57.813707 27608 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:09:57.838421 27608 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.844420 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.845391 27232 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:57.847476 27597 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.847988 27597 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.857950 27306 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:57.860183 27346 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:57.816776 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:57.871850 27231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.883378 27347 raft_consensus.cc:359] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.884075 27347 raft_consensus.cc:385] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.884380 27347 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.882069 27635 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.885030 27652 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.885293 27635 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.885584 27652 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.887230 27347 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.894574 27272 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:57.881870 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:57.897699 27627 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:09:57.898286 27652 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.898325 27627 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.898964 27652 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.900508 27652 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:57.902269 27569 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.903570 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.903825 27569 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.904412 27635 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.904491 27569 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.902181 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.904307 27225 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.902518 27564 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:57.910281 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:57.913130 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:57.913952 27349 tablet_bootstrap.cc:654] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.915074 27347 ts_tablet_manager.cc:1434] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.012s
W20260709 13:09:57.917032 27654 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:57.908458 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.920133 27652 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.923278 27403 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.925964 27403 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:57.912137 27651 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:57.937942 27347 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:57.929386 27651 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.931951 27608 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:57.942323 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.929764 27303 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:57.945997 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.947965 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:57.950773 27122 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:09:57.952108 27195 leader_election.cc:343] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.940725 27651 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.945168 27597 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:57.964874 27346 tablet_bootstrap.cc:654] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.965181 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:57.953215 27608 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:57.979668 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
W20260709 13:09:57.995568 27269 leader_election.cc:343] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:57.999845 27627 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.000284 27569 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.005627 27349 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.006250 27349 ts_tablet_manager.cc:1403] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.010s
I20260709 13:09:58.007455 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:58.012328 27269 leader_election.cc:343] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.014416 27569 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.016923 27347 tablet_bootstrap.cc:654] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:58.019778 27195 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.012029 27403 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.026481 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.027136 27230 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.027398 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.030258 27558 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.030823 27558 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.032195 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.032994 27226 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:58.033316 27558 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:58.035835 27197 leader_election.cc:343] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.036273 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.044404 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:58.039698 27634 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.047073 27230 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:58.059056 27628 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.060770 27531 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.060927 27628 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.061313 27628 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.061285 27531 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.062422 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:58.065338 27197 leader_election.cc:343] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.056777 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.063558 27531 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.071007 27272 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:58.072645 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.074957 27376 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.075455 27376 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:58.073145 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.076125 27376 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.076825 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:58.071899 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.079149 27229 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
W20260709 13:09:58.080374 27122 leader_election.cc:343] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.083143 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.084277 27531 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.084708 27531 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.085136 27531 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.085491 27346 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.085978 27346 ts_tablet_manager.cc:1403] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.020s
I20260709 13:09:58.091928 27269 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.092626 27403 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:58.088250 27569 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:58.094151 27346 raft_consensus.cc:359] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.095386 27346 raft_consensus.cc:385] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.095803 27346 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.098412 27346 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.102461 27346 ts_tablet_manager.cc:1434] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:58.104218 27346 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
W20260709 13:09:58.107467 27195 leader_election.cc:343] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.107936 27195 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.109157 27634 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.109145 27349 raft_consensus.cc:359] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.113585 27269 leader_election.cc:343] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.120172 27349 raft_consensus.cc:385] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.120798 27349 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.108824 27651 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.123309 27269 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.122829 27349 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.127331 27531 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.124482 27607 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:58.131716 27531 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.131822 27156 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:09:58.134157 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:58.138854 27349 ts_tablet_manager.cc:1434] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.001s
I20260709 13:09:58.139810 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.140462 27226 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:58.141017 27122 leader_election.cc:343] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.101872 27628 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.148916 27651 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.149883 27269 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.150630 27628 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.151345 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:58.151815 27569 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.155735 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.156525 27230 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.151456 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.158774 27229 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.171082 27055 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.172600 27569 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.178158 27349 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.182402 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:58.186815 27347 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.187551 27347 ts_tablet_manager.cc:1403] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.254s	user 0.042s	sys 0.032s
I20260709 13:09:58.189297 27305 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
W20260709 13:09:58.191215 27269 leader_election.cc:343] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.199659 27347 raft_consensus.cc:359] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.200233 27347 raft_consensus.cc:385] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.200460 27347 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.201067 27347 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.197467 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:58.202858 27531 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.203320 27531 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:58.204185 27531 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.209563 27230 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:58.210225 27229 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:58.211825 27226 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:58.213477 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:58.213835 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.215958 27649 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.216441 27649 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:58.217242 27649 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.219254 27347 ts_tablet_manager.cc:1434] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:58.221515 27347 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.220238 27628 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.223714 27628 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:58.224574 27628 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.225790 27349 tablet_bootstrap.cc:654] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.229616 27346 tablet_bootstrap.cc:654] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.250620 27347 tablet_bootstrap.cc:654] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.252712 27346 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.254757 27346 ts_tablet_manager.cc:1403] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.009s
I20260709 13:09:58.253518 27349 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.256079 27349 ts_tablet_manager.cc:1403] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.008s
I20260709 13:09:58.260416 27346 raft_consensus.cc:359] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.261339 27346 raft_consensus.cc:385] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.261665 27346 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.263223 27349 raft_consensus.cc:359] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.264137 27349 raft_consensus.cc:385] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.264470 27349 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.265797 27349 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.267516 27349 ts_tablet_manager.cc:1434] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:58.268535 27349 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.268666 27347 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.269101 27347 ts_tablet_manager.cc:1403] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.009s
I20260709 13:09:58.271804 27347 raft_consensus.cc:359] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.272503 27347 raft_consensus.cc:385] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.272770 27347 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.273415 27347 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.275640 27347 ts_tablet_manager.cc:1434] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:58.273516 27346 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.276654 27347 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.277794 27346 ts_tablet_manager.cc:1434] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:58.283322 27347 tablet_bootstrap.cc:654] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.284173 27649 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.284663 27649 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.287947 27649 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.290222 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.290786 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.292704 27123 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.295140 27346 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:58.297646 27347 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.298162 27347 ts_tablet_manager.cc:1403] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:09:58.300544 27349 tablet_bootstrap.cc:654] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.303574 27346 tablet_bootstrap.cc:654] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.308288 27649 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.309618 27052 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.312031 27052 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.317276 27347 raft_consensus.cc:359] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.318998 27347 raft_consensus.cc:385] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.319350 27347 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.320149 27347 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.322188 27349 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.322875 27349 ts_tablet_manager.cc:1403] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.017s
I20260709 13:09:58.324321 27347 ts_tablet_manager.cc:1434] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:09:58.325670 27347 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.330231 27054 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.332325 27347 tablet_bootstrap.cc:654] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.332125 27054 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.333371 27558 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.333833 27558 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.336771 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:58.338140 27195 leader_election.cc:343] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.339911 27558 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.340161 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.341342 27628 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.341763 27197 leader_election.cc:343] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.341893 27628 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.342299 27197 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.343348 27558 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.344048 27628 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.346441 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.348173 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.351445 27347 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.352021 27347 ts_tablet_manager.cc:1403] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
W20260709 13:09:58.353605 27272 leader_election.cc:343] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.354351 27349 raft_consensus.cc:359] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.355059 27349 raft_consensus.cc:385] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.354852 27347 raft_consensus.cc:359] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.355654 27464 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.355413 27349 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.355844 27347 raft_consensus.cc:385] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.356173 27347 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.356480 27349 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.357318 27269 leader_election.cc:343] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.357028 27347 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.357782 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.359634 27349 ts_tablet_manager.cc:1434] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:09:58.356144 27464 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.361210 27628 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.361756 27347 ts_tablet_manager.cc:1434] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:58.362378 27464 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.362879 27347 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.363899 27349 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.365573 27346 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.366078 27346 ts_tablet_manager.cc:1403] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.009s
I20260709 13:09:58.368706 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.368853 27346 raft_consensus.cc:359] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.369400 27226 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:58.369563 27346 raft_consensus.cc:385] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.369948 27346 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.371063 27346 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.373181 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.375404 27347 tablet_bootstrap.cc:654] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.379297 27349 tablet_bootstrap.cc:654] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.380970 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:58.381796 27464 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.382243 27464 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.382598 27464 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:58.383280 27269 leader_election.cc:343] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.389484 27346 ts_tablet_manager.cc:1434] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:09:58.390672 27346 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:58.411675 27464 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.417755 27649 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.420032 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:58.422097 27346 tablet_bootstrap.cc:654] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.423089 27464 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.424893 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.422421 27349 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.425534 27226 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.425732 27349 ts_tablet_manager.cc:1403] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.026s
I20260709 13:09:58.427640 27347 tablet_bootstrap.cc:492] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.429996 27347 ts_tablet_manager.cc:1403] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.067s	user 0.002s	sys 0.019s
W20260709 13:09:58.432096 27269 leader_election.cc:343] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.435827 27347 raft_consensus.cc:359] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.438763 27347 raft_consensus.cc:385] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.439452 27347 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.443071 27349 raft_consensus.cc:359] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.443813 27349 raft_consensus.cc:385] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.444079 27349 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.444674 27349 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.449572 27226 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:58.440537 27347 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.450981 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:58.452617 27628 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.453363 27628 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:58.454325 27628 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.455027 27349 ts_tablet_manager.cc:1434] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:58.456403 27349 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.460567 27649 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.461091 27649 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.463281 27649 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.466887 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.452627 27347 ts_tablet_manager.cc:1434] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:09:58.484620 27347 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.487247 27349 tablet_bootstrap.cc:654] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.488469 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.493960 27346 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.494591 27346 ts_tablet_manager.cc:1403] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.104s	user 0.029s	sys 0.014s
I20260709 13:09:58.495620 27347 tablet_bootstrap.cc:654] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.497795 27123 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.497952 27346 raft_consensus.cc:359] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.498672 27346 raft_consensus.cc:385] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.498894 27652 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.498974 27346 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.500891 27652 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.504660 27346 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.511415 27346 ts_tablet_manager.cc:1434] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:09:58.512485 27346 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:58.513581 27150 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.515688 27464 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.520521 27349 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.521044 27349 ts_tablet_manager.cc:1403] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.005s
I20260709 13:09:58.524953 27349 raft_consensus.cc:359] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.526235 27349 raft_consensus.cc:385] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.526585 27349 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.527403 27349 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.529301 27349 ts_tablet_manager.cc:1434] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:58.530296 27349 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.536837 27349 tablet_bootstrap.cc:654] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.543083 27052 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.551230 27347 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:58.551961 27347 ts_tablet_manager.cc:1403] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.004s
I20260709 13:09:58.562559 27346 tablet_bootstrap.cc:654] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.571091 27347 raft_consensus.cc:359] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.572091 27347 raft_consensus.cc:385] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.572463 27347 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.577886 27349 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.578598 27349 ts_tablet_manager.cc:1403] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.014s
W20260709 13:09:58.579212 27269 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.573328 27347 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.583832 27649 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.584530 27649 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.592504 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.595526 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.596379 27226 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:58.597766 27123 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.598023 27649 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.598532 27652 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.599184 27659 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.599836 27659 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.601878 27531 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.602566 27531 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.607753 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.608421 27226 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:58.609716 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:58.613468 27651 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.613879 27651 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.614296 27651 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.614769 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.615440 27303 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:58.616809 27346 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.605247 27531 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.618925 27659 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.620404 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.621102 27651 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.622128 27347 ts_tablet_manager.cc:1434] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.002s
I20260709 13:09:58.623268 27347 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:58.623582 27151 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.624928 27652 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.629940 27634 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.630436 27634 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.632452 27634 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.632620 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.633471 27226 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:09:58.637535 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.638170 27305 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:58.640470 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.641389 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:09:58.641902 27195 leader_election.cc:343] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.642232 27633 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.642555 27272 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:58.642585 27633 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.643432 27633 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.643877 27376 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.651803 27346 ts_tablet_manager.cc:1403] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.140s	user 0.017s	sys 0.034s
I20260709 13:09:58.652786 27651 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.654165 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:58.654527 27376 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.654809 27304 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.655416 27346 raft_consensus.cc:359] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.656165 27346 raft_consensus.cc:385] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.656476 27346 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.657409 27346 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.659754 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:58.660334 27231 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.661689 27346 ts_tablet_manager.cc:1434] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:58.661331 27633 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.664865 27633 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.665802 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:09:58.667209 27195 leader_election.cc:343] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.666069 27346 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:58.668452 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:58.669082 27303 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.679675 27652 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.681510 27346 tablet_bootstrap.cc:654] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.687273 27304 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:58.688539 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:09:58.689429 27652 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.691612 27652 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:09:58.692708 27303 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:58.692587 27652 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.693921 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:58.695086 27633 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.695593 27633 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:58.696445 27633 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.650280 27349 raft_consensus.cc:359] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.701314 27349 raft_consensus.cc:385] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.701602 27349 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.702943 27231 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:09:58.711107 27349 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.730530 27652 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.739984 27349 ts_tablet_manager.cc:1434] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.001s
I20260709 13:09:58.741351 27376 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.757340 27634 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.757886 27634 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.760138 27634 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.760983 27633 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.761196 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.762543 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.761577 27633 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.764032 27195 leader_election.cc:343] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:58.768150 27197 leader_election.cc:343] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.773105 27347 tablet_bootstrap.cc:654] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.772950 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.774120 27349 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:58.782444 27635 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.799337 27652 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:09:58.806730 27269 consensus_peers.cc:597] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:58.808107 27651 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:58.778680 27634 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.838840 27634 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.839895 27052 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.846240 27607 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.846884 27607 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.853942 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.869725 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.859714 27633 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.877275 27349 tablet_bootstrap.cc:654] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.864583 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:58.882782 27197 leader_election.cc:343] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.883421 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:58.894497 27197 leader_election.cc:343] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.895414 27376 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.898823 27659 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:58.896133 27376 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.906030 27195 leader_election.cc:343] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.906527 27195 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:09:58.907605 27195 leader_election.cc:343] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.908010 27195 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:58.909508 27346 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:58.909951 27346 ts_tablet_manager.cc:1403] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.244s	user 0.046s	sys 0.052s
I20260709 13:09:58.870239 27634 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.910883 27558 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.912451 27607 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.909430 27635 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.916443 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.925272 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:58.927969 27376 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:58.927208 27301 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:58.933375 27230 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:58.936792 27272 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:58.937386 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:58.939494 27055 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.944164 27376 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.944787 27376 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.946345 27376 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.949402 27346 raft_consensus.cc:359] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:58.949956 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:58.950258 27346 raft_consensus.cc:385] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.951049 27346 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.957799 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.958585 27346 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.954986 27651 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.966704 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:58.972421 27651 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:58.962149 27607 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.973594 27607 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.973984 27607 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.975201 27651 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:58.977238 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:58.978596 27346 ts_tablet_manager.cc:1434] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.005s
I20260709 13:09:58.979696 27346 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:58.984254 27349 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:58.989579 27349 ts_tablet_manager.cc:1403] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.017s
W20260709 13:09:58.988837 27195 leader_election.cc:343] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.987368 27346 tablet_bootstrap.cc:654] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:59.003382 27702 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:09:59.007606 27347 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.008152 27347 ts_tablet_manager.cc:1403] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.385s	user 0.013s	sys 0.011s
W20260709 13:09:59.015062 27269 leader_election.cc:343] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.019644 27628 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:59.043229 27376 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.047273 27347 raft_consensus.cc:359] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.048102 27347 raft_consensus.cc:385] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.048374 27347 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.055155 27376 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.053853 27347 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.080922 27347 ts_tablet_manager.cc:1434] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 13:09:59.090306 27347 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.089574 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:59.112982 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.107235 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.109632 27229 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.120277 27651 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:59.116868 27151 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.101588 27607 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.136817 27346 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.136870 27123 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:59.137421 27346 ts_tablet_manager.cc:1403] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.013s
I20260709 13:09:59.145565 27349 raft_consensus.cc:359] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.147029 27349 raft_consensus.cc:385] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.147378 27349 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.148588 27607 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:59.150867 27269 leader_election.cc:343] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.152521 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:59.153257 27301 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.148212 27349 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:59.159216 27710 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:59.160943 27349 ts_tablet_manager.cc:1434] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.171s	user 0.008s	sys 0.000s
I20260709 13:09:59.188592 27301 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:09:59.192961 27349 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:59.199141 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.200135 27713 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.200677 27713 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:09:59.201578 27713 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.206987 27607 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.207772 27607 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.212287 27346 raft_consensus.cc:359] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.213091 27346 raft_consensus.cc:385] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.213375 27346 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.214022 27346 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.216583 27346 ts_tablet_manager.cc:1434] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
W20260709 13:09:59.230997 27332 tablet.cc:2406] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:59.233168 27346 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.234117 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.247763 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.249083 27347 tablet_bootstrap.cc:654] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.245153 27607 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:09:59.258705 27195 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:59.276486 27195 leader_election.cc:343] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.281366 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:59.284093 27197 leader_election.cc:343] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:59.292948 27195 leader_election.cc:343] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.293398 27195 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:59.294091 27635 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.294823 27349 tablet_bootstrap.cc:654] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.303586 27229 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:59.307130 27272 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:59.307972 27464 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.308936 27464 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:59.309957 27464 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.319698 27346 tablet_bootstrap.cc:654] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.324609 27709 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:59.344012 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 103157us
I20260709 13:09:59.350000 27347 tablet_bootstrap.cc:492] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.350871 27347 ts_tablet_manager.cc:1403] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.265s	user 0.025s	sys 0.022s
I20260709 13:09:59.357898 27651 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.360801 27347 raft_consensus.cc:359] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.361456 27347 raft_consensus.cc:385] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.361691 27347 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.363487 27347 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.365177 27709 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.365697 27709 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.366564 27347 ts_tablet_manager.cc:1434] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:09:59.368225 27347 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.378650 27150 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.385243 27054 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.406855 27717 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:59.422353 27569 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.423007 27569 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.427716 27709 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.442260 27713 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.442988 27713 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.433619 27569 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.453439 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.454651 27226 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:09:59.458590 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.465649 27713 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.466212 27346 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.466689 27346 ts_tablet_manager.cc:1403] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.004s
I20260709 13:09:59.468158 27659 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.467574 27052 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.468633 27659 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.467811 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.468660 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.467684 27230 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:59.472146 27151 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
W20260709 13:09:59.467067 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43576.1us
I20260709 13:09:59.474031 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.477733 27718 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.477875 27707 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.478165 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.478452 27707 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.478859 27151 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
I20260709 13:09:59.478855 27707 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.482589 27659 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.489007 27349 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:59.489487 27349 ts_tablet_manager.cc:1403] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.297s	user 0.020s	sys 0.008s
I20260709 13:09:59.475029 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:59.491727 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.491588 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.494706 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:09:59.503768 27272 leader_election.cc:343] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.501701 27346 raft_consensus.cc:359] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.504714 27346 raft_consensus.cc:385] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.505012 27346 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.486042 27718 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.505785 27346 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.505012 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.513443 27718 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.517341 27346 ts_tablet_manager.cc:1434] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:09:59.515085 27634 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.520947 27634 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.521302 27634 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.526643 27269 leader_election.cc:343] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.527091 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:59.530678 27569 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.535279 27346 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.540843 27634 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.540881 27707 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.546743 27304 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:59.548965 27707 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.549971 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:59.550916 27230 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:59.551141 27718 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.558350 27718 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.561550 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:59.561878 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:59.562469 27305 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:59.562757 27230 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:09:59.563238 27634 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.564455 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.565258 27150 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:09:59.564401 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.566265 27151 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:09:59.566860 27347 tablet_bootstrap.cc:654] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.570251 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:59.571062 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:09:59.573668 27569 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.575620 27349 raft_consensus.cc:359] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.577517 27349 raft_consensus.cc:385] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.577714 27349 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.578917 27349 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.578589 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:09:59.580802 27304 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:59.577123 27649 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.584671 27349 ts_tablet_manager.cc:1434] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 13:09:59.584955 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:59.585701 27349 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:59.586140 27717 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.595458 27349 tablet_bootstrap.cc:654] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.596356 27347 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.598664 27347 ts_tablet_manager.cc:1403] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.231s	user 0.025s	sys 0.010s
I20260709 13:09:59.602326 27347 raft_consensus.cc:359] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.597714 27346 tablet_bootstrap.cc:654] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.606415 27347 raft_consensus.cc:385] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.606786 27347 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.607491 27349 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:59.608615 27349 ts_tablet_manager.cc:1403] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:09:59.607616 27347 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.611806 27349 raft_consensus.cc:359] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.612478 27349 raft_consensus.cc:385] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.612746 27349 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.613417 27349 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.615434 27347 ts_tablet_manager.cc:1434] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:09:59.615897 27349 ts_tablet_manager.cc:1434] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:59.618268 27349 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Bootstrap starting.
I20260709 13:09:59.623108 27346 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.624430 27346 ts_tablet_manager.cc:1403] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.002s
I20260709 13:09:59.624974 27349 tablet_bootstrap.cc:654] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.625108 27659 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.628862 27659 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.632475 27659 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.635597 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.638459 27226 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:59.639778 27272 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.641558 27569 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.642081 27569 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.642387 27347 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.642570 27569 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.649837 27347 tablet_bootstrap.cc:654] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.657255 27349 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: No bootstrap required, opened a new log
I20260709 13:09:59.657723 27349 ts_tablet_manager.cc:1403] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.027s
I20260709 13:09:59.659741 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.661620 27349 raft_consensus.cc:359] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.662375 27349 raft_consensus.cc:385] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.662638 27349 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.663302 27349 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.664126 27346 raft_consensus.cc:359] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.664829 27346 raft_consensus.cc:385] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.665308 27346 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.665715 27349 ts_tablet_manager.cc:1434] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:59.666074 27346 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.669449 27569 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:09:59.672266 27269 leader_election.cc:343] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.673533 27649 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.674193 27649 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.677688 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.679399 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:59.682314 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.682683 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:09:59.683642 27269 leader_election.cc:343] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.681699 27569 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.683827 27718 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.686228 27649 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.689358 27346 ts_tablet_manager.cc:1434] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:09:59.690987 27346 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.691841 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:59.692442 27230 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.697517 27347 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.698098 27347 ts_tablet_manager.cc:1403] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.033s
I20260709 13:09:59.704708 27230 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:59.705757 27272 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:59.706542 27659 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.707063 27659 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:59.706699 27347 raft_consensus.cc:359] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.707887 27659 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.709561 27346 tablet_bootstrap.cc:654] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.712422 27347 raft_consensus.cc:385] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.712787 27347 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.713502 27347 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.715718 27347 ts_tablet_manager.cc:1434] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:59.716432 27346 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.716907 27346 ts_tablet_manager.cc:1403] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.026s	user 0.001s	sys 0.009s
I20260709 13:09:59.717352 27347 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.720324 27346 raft_consensus.cc:359] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.720945 27346 raft_consensus.cc:385] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.721204 27346 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.721839 27346 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.723969 27346 ts_tablet_manager.cc:1434] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:09:59.726318 27346 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.729790 27055 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.731329 27347 tablet_bootstrap.cc:654] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.734407 27346 tablet_bootstrap.cc:654] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.741302 27151 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.751159 27347 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.751669 27347 ts_tablet_manager.cc:1403] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.002s
I20260709 13:09:59.754240 27707 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.754739 27707 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.755699 27464 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.756853 27707 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.755746 27347 raft_consensus.cc:359] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.758008 27634 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.758446 27347 raft_consensus.cc:385] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.758491 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.758832 27347 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.759241 27226 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:09:59.759538 27347 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.760411 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:09:59.761592 27347 ts_tablet_manager.cc:1434] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:09:59.762199 27272 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:09:59.762641 27347 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.763847 27707 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.764287 27707 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.764595 27707 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.772585 27269 leader_election.cc:343] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.775930 27347 tablet_bootstrap.cc:654] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.778648 27707 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.780927 27707 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:09:59.783674 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:09:59.786443 27347 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.787812 27347 ts_tablet_manager.cc:1403] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:09:59.788203 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:09:59.788841 27226 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.790619 27347 raft_consensus.cc:359] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.791323 27347 raft_consensus.cc:385] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.791563 27347 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.792227 27347 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.796300 27347 ts_tablet_manager.cc:1434] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:59.797271 27347 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
W20260709 13:09:59.806421 27269 leader_election.cc:343] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.810021 27347 tablet_bootstrap.cc:654] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.813005 27151 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.822829 27715 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.828970 27346 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.829540 27346 ts_tablet_manager.cc:1403] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.008s
I20260709 13:09:59.832645 27346 raft_consensus.cc:359] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.833328 27346 raft_consensus.cc:385] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.833602 27346 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.834270 27346 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.835850 27346 ts_tablet_manager.cc:1434] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:09:59.836874 27346 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.850405 27718 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.851037 27718 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.853353 27718 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.855180 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:59.854039 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:09:59.856033 27304 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:09:59.857620 27123 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:09:59.859176 27651 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:59.849293 27269 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.821789 27226 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:09:59.870743 27272 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:09:59.873072 27659 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.874215 27659 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:09:59.877688 27659 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.883337 27651 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.901842 27346 tablet_bootstrap.cc:654] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.902846 27347 tablet_bootstrap.cc:492] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.903342 27347 ts_tablet_manager.cc:1403] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.106s	user 0.029s	sys 0.025s
I20260709 13:09:59.906246 27717 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.906802 27717 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.906893 27347 raft_consensus.cc:359] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.909097 27347 raft_consensus.cc:385] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.909441 27347 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.910247 27347 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.910763 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:09:59.912573 27347 ts_tablet_manager.cc:1434] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
W20260709 13:09:59.912777 27197 leader_election.cc:343] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.913873 27347 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:09:59.909068 27717 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:09:59.918532 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:09:59.923755 27195 leader_election.cc:343] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.924213 27195 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:09:59.926311 27715 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.929566 27347 tablet_bootstrap.cc:654] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.932871 27346 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.933336 27346 ts_tablet_manager.cc:1403] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.005s
I20260709 13:09:59.936177 27346 raft_consensus.cc:359] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.936919 27346 raft_consensus.cc:385] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.937198 27346 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.939594 27346 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.942190 27346 ts_tablet_manager.cc:1434] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:59.943214 27346 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.944077 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.949765 27346 tablet_bootstrap.cc:654] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.977779 27346 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:09:59.978370 27346 ts_tablet_manager.cc:1403] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 13:09:59.984987 27346 raft_consensus.cc:359] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.985862 27346 raft_consensus.cc:385] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.986256 27346 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.986982 27346 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.989321 27346 ts_tablet_manager.cc:1434] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:59.991051 27346 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:09:59.992497 27347 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:09:59.992995 27347 ts_tablet_manager.cc:1403] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.029s
I20260709 13:09:59.995769 27347 raft_consensus.cc:359] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:09:59.996417 27347 raft_consensus.cc:385] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.996671 27347 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.997713 27346 tablet_bootstrap.cc:654] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.997367 27347 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.000342 27347 ts_tablet_manager.cc:1434] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:00.004712 27659 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.005668 27347 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Bootstrap starting.
I20260709 13:10:00.005504 27659 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.007632 27718 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.008199 27718 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.010370 27346 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:10:00.010898 27346 ts_tablet_manager.cc:1403] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:10:00.011543 27718 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.014406 27346 raft_consensus.cc:359] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.015096 27346 raft_consensus.cc:385] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.015368 27346 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.016233 27346 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.018705 27346 ts_tablet_manager.cc:1434] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:00.019433 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:00.019745 27346 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:10:00.020093 27150 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
W20260709 13:10:00.020880 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:00.022951 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:00.024233 27712 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.024588 27712 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.025665 27712 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.026273 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:00.029685 27634 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.030176 27634 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.032188 27634 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.032045 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.032861 27226 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:10:00.033568 27712 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.034298 27123 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.035143 27718 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.035526 27718 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.035876 27718 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.035988 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:00.036164 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:00.036826 27304 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 0.
W20260709 13:10:00.037753 27195 leader_election.cc:343] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.038098 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.038540 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:00.038693 27301 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:00.039675 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:00.045559 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.046522 27634 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.046890 27634 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.047225 27634 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.038726 27229 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.054721 27229 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.056319 27272 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.056979 27376 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.057432 27376 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:00.057022 27634 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.041270 27346 tablet_bootstrap.cc:654] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.058265 27376 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.059715 27634 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.060344 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:10:00.061625 27195 leader_election.cc:343] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.062446 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:00.042207 27347 tablet_bootstrap.cc:654] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.063087 27301 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.035682 27712 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.044243 27659 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.043927 27718 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.075814 27154 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 1: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:10:00.077766 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.079401 27226 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:00.080065 27659 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.080669 27659 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.084466 27659 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.084756 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:00.085976 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:00.087396 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:10:00.087924 27269 leader_election.cc:343] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.088346 27651 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.091285 27346 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:10:00.091802 27346 ts_tablet_manager.cc:1403] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.006s
I20260709 13:10:00.094900 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.095752 27226 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:10:00.094220 27718 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.102974 27301 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:10:00.100052 27055 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.109921 27346 raft_consensus.cc:359] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.110750 27346 raft_consensus.cc:385] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.111034 27346 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.098716 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:00.113214 27707 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.113952 27707 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.114442 27707 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.114938 27346 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.131778 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:00.132376 27346 ts_tablet_manager.cc:1434] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:10:00.132987 27715 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.133500 27715 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:00.134598 27715 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.141742 27346 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:10:00.148090 27718 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.148686 27718 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.151355 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.151988 27230 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:10:00.153191 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.154561 27651 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.155027 27651 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.155360 27651 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.155486 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:00.156159 27304 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 0.
I20260709 13:10:00.157848 27718 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.158089 27346 tablet_bootstrap.cc:654] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.153489 27052 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.159147 27707 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.161755 27707 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.162611 27347 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: No bootstrap required, opened a new log
I20260709 13:10:00.163107 27347 ts_tablet_manager.cc:1403] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.035s
I20260709 13:10:00.163647 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.164270 27230 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.165772 27347 raft_consensus.cc:359] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.166395 27347 raft_consensus.cc:385] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.166661 27347 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.167281 27347 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.203928 27347 ts_tablet_manager.cc:1434] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.002s
I20260709 13:10:00.221444 27718 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.222066 27718 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.224141 27718 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.224848 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.225904 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:00.226347 27229 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:00.227790 27123 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:00.228741 27718 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.232455 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:00.238529 27718 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.239635 27230 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.243010 27651 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.244444 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.245325 27707 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.245815 27707 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:00.246891 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:00.246721 27707 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:00.252502 27269 leader_election.cc:343] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.252720 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.253540 27230 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.248457 27651 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.258529 27301 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.265164 27376 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.269184 27346 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:10:00.269778 27346 ts_tablet_manager.cc:1403] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.128s	user 0.055s	sys 0.044s
I20260709 13:10:00.271728 27301 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:10:00.272918 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:00.273841 27651 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.274433 27230 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:10:00.272730 27346 raft_consensus.cc:359] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.277351 27346 raft_consensus.cc:385] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.277634 27346 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.277889 27651 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:00.278303 27346 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.278853 27651 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.280470 27346 ts_tablet_manager.cc:1434] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:00.281481 27346 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:10:00.280804 27055 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.294107 27376 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.294726 27376 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.295904 27151 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.296731 27376 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.301995 27346 tablet_bootstrap.cc:654] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.306607 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:00.306960 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.307668 27231 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:10:00.307798 27154 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:10:00.309616 27272 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.313174 27376 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.313565 27376 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.313866 27376 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.323730 27376 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.325932 27376 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.326658 27376 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.327459 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.327158 27052 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.330893 27224 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.331229 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:00.345150 27150 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.350847 27224 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.351348 27346 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:10:00.353320 27346 ts_tablet_manager.cc:1403] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.010s
I20260709 13:10:00.357004 27272 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.358091 27376 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.358577 27376 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:00.359504 27376 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.359675 27346 raft_consensus.cc:359] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.360320 27346 raft_consensus.cc:385] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.360600 27346 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.363832 27707 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.363731 27346 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.364357 27707 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.369809 27707 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.371618 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.372485 27230 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:10:00.373781 27272 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.379508 27346 ts_tablet_manager.cc:1434] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:10:00.381505 27712 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.381749 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:00.381987 27712 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.382421 27712 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.382464 27154 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 0.
I20260709 13:10:00.396847 27346 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Bootstrap starting.
I20260709 13:10:00.365618 27150 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.403232 27712 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.435429 27718 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.435829 27569 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.436110 27718 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.441250 27718 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:00.443256 27712 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:00.445923 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:00.446599 27226 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.449026 27346 tablet_bootstrap.cc:654] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.444351 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:00.445176 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:00.450085 27231 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 1: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:00.451745 27122 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:00.452889 27649 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.459975 27649 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:00.459239 27052 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.467839 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:00.468544 27154 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.481087 27226 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.488862 27272 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:00.490865 27569 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.480374 27712 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:10:00.491408 27569 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:00.500386 27569 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.513839 27346 tablet_bootstrap.cc:492] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: No bootstrap required, opened a new log
I20260709 13:10:00.514526 27346 ts_tablet_manager.cc:1403] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.005s
I20260709 13:10:00.519575 27154 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:00.536033 27346 raft_consensus.cc:359] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.536778 27346 raft_consensus.cc:385] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.537034 27346 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.537801 27346 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:00.542415 27346 ts_tablet_manager.cc:1434] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:10:00.592856 27052 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.623076 27151 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.629763 27713 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.640358 27713 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.654706 27764 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.660338 27659 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.777652 27659 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.793992 27569 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.838292 27651 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.852756 27651 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.961606 27712 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:00.963654 27712 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.998500 27712 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.001016 27712 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:10:01.079963 27103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:01.495350 27718 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.495985 27718 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:01.497978 27718 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:01.498589 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:01.499090 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:01.499221 27224 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:10:01.499688 27301 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:10:01.500376 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:01.501080 27718 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:01.501397 27718 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.501694 27718 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.508324 27718 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:01.511214 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:01.511389 27718 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:01.511605 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:01.511861 27224 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.512236 27301 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.519030 27301 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:01.519295 27224 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:01.520272 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:01.521171 27718 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.521687 27718 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:01.522553 27718 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:01.534925 27055 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.025264 27306 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:02.026479 27718 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.041675 27224 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:02.043398 27788 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:02.785238 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.820150 27795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.820318 27796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.820922 27798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.822659 26038 server_base.cc:1061] running on GCE node
I20260709 13:10:02.824107 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.824395 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.824622 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602602824600 us; error 0 us; skew 500 ppm
I20260709 13:10:02.825217 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.828706 26038 webserver.cc:533] Webserver started at http://127.25.109.132:39133/ using document root <none> and password file <none>
I20260709 13:10:02.829502 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.829857 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.830389 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.832360 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-3-root/instance:
uuid: "f4afe81810944d70bc2cc31754392f3d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-zhdc"
I20260709 13:10:02.838373 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:10:02.842739 27803 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.843657 26038 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:02.843946 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
uuid: "f4afe81810944d70bc2cc31754392f3d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-zhdc"
I20260709 13:10:02.844201 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.862466 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.863994 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.865751 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.868324 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.868507 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.868706 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.868846 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.960022 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.132:42741
I20260709 13:10:02.960135 27865 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.132:42741 every 8 connection(s)
I20260709 13:10:02.977267 26038 auto_leader_rebalancer-test.cc:384] add a tserver: f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:02.987371 27866 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33321
I20260709 13:10:02.987823 27866 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.988561 27866 heartbeater.cc:507] Master 127.25.109.190:33321 requested a full tablet report, sending...
I20260709 13:10:02.990686 27055 ts_manager.cc:194] Registered new tserver with Master: f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:02.992163 27055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52102
I20260709 13:10:03.226214 27301 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:03.233551 27231 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.236049 27870 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:03.246311 27154 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.258412 27464 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.256742 27712 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.258252 27224 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:03.259516 27271 consensus_peers.cc:597] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36d2fcee6798446ca0ae9140145ba175. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.272629 27301 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:03.283674 27052 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.283529 27150 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:03.289637 27271 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2d8b32b61494130ab83c26fc2d310e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.290896 27154 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.292299 27870 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.296128 27224 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.297736 27712 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.311020 27150 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.308957 27870 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.318323 27224 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.351397 27054 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.356679 27150 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:03.368441 27301 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.369603 27224 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.369802 27718 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:03.371042 27794 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:03.378739 27122 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86bf2019fd7b421393e482331c89a37d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.382144 27788 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.384984 27224 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.393723 27301 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.400209 27150 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:03.410440 27052 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.424705 27301 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.425256 27224 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.426339 27718 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:03.427336 27122 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63772c6ab6094654b0215f6a3be7d6fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.428633 27890 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.520272 27306 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.524446 27224 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.518414 27890 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.539999 27052 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:03.780004 27894 ts_tablet_manager.cc:933] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:03.783845 27894 tablet_copy_client.cc:323] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:03.825807 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet c2d8b32b61494130ab83c26fc2d310e6 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:03.826838 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet c2d8b32b61494130ab83c26fc2d310e6 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-c2d8b32b61494130ab83c26fc2d310e6
I20260709 13:10:03.829290 27898 ts_tablet_manager.cc:933] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:03.837222 27316 tablet_copy_source_session.cc:215] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.841375 27899 ts_tablet_manager.cc:933] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:03.848843 27894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d8b32b61494130ab83c26fc2d310e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.852741 27899 tablet_copy_client.cc:323] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:03.854851 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 36d2fcee6798446ca0ae9140145ba175 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:03.855433 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 36d2fcee6798446ca0ae9140145ba175 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-36d2fcee6798446ca0ae9140145ba175
I20260709 13:10:03.858784 27898 tablet_copy_client.cc:323] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:03.868439 27316 tablet_copy_source_session.cc:215] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.872813 27899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2fcee6798446ca0ae9140145ba175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.902479 27899 tablet_copy_client.cc:806] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.905047 27899 tablet_copy_client.cc:670] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.914170 27894 tablet_copy_client.cc:806] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.915580 27894 tablet_copy_client.cc:670] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.915884 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 86bf2019fd7b421393e482331c89a37d from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:03.916553 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 86bf2019fd7b421393e482331c89a37d from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-86bf2019fd7b421393e482331c89a37d
I20260709 13:10:03.918224 27899 tablet_copy_client.cc:538] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.921979 27894 tablet_copy_client.cc:538] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.924998 27167 tablet_copy_source_session.cc:215] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.930132 27898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86bf2019fd7b421393e482331c89a37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.937664 27899 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:03.941113 27894 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:03.943534 27904 ts_tablet_manager.cc:933] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:03.994762 27866 heartbeater.cc:499] Master 127.25.109.190:33321 was elected leader, sending a full tablet report...
I20260709 13:10:03.998044 27894 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:03.999338 27894 tablet_bootstrap.cc:492] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:04.000749 27894 ts_tablet_manager.cc:1403] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.018s
I20260709 13:10:04.004985 27894 raft_consensus.cc:359] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.009636 27894 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:04.010758 27894 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.024334 27894 ts_tablet_manager.cc:1434] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.009s
I20260709 13:10:04.030699 27898 tablet_copy_client.cc:806] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.031008 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-c2d8b32b61494130ab83c26fc2d310e6 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:04.031570 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-c2d8b32b61494130ab83c26fc2d310e6 on tablet c2d8b32b61494130ab83c26fc2d310e6 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:04.031592 27898 tablet_copy_client.cc:670] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.041628 27899 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.042732 27898 tablet_copy_client.cc:538] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.042929 27899 tablet_bootstrap.cc:492] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:04.045756 27899 ts_tablet_manager.cc:1403] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.108s	user 0.035s	sys 0.023s
I20260709 13:10:04.043603 27904 tablet_copy_client.cc:323] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:04.054785 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 63772c6ab6094654b0215f6a3be7d6fc from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:04.055425 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 63772c6ab6094654b0215f6a3be7d6fc from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-63772c6ab6094654b0215f6a3be7d6fc
I20260709 13:10:04.057508 27898 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:04.070845 27899 raft_consensus.cc:359] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.081404 27167 tablet_copy_source_session.cc:215] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:04.089066 27899 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:04.091396 27899 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.095237 27899 ts_tablet_manager.cc:1434] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 13:10:04.101341 27904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63772c6ab6094654b0215f6a3be7d6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.109081 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-36d2fcee6798446ca0ae9140145ba175 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:04.109629 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-36d2fcee6798446ca0ae9140145ba175 on tablet 36d2fcee6798446ca0ae9140145ba175 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:04.123091 27898 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.124145 27898 tablet_bootstrap.cc:492] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:04.124868 27898 ts_tablet_manager.cc:1403] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.013s
I20260709 13:10:04.126318 27904 tablet_copy_client.cc:806] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:04.126986 27904 tablet_copy_client.cc:670] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:04.128888 27898 raft_consensus.cc:359] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.129673 27898 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:04.130365 27898 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.131327 27904 tablet_copy_client.cc:538] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:04.132727 27898 ts_tablet_manager.cc:1434] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:10:04.136962 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-86bf2019fd7b421393e482331c89a37d received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:04.137423 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-86bf2019fd7b421393e482331c89a37d on tablet 86bf2019fd7b421393e482331c89a37d with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:04.152228 27904 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:04.177704 27904 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.178707 27904 tablet_bootstrap.cc:492] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:04.179405 27904 ts_tablet_manager.cc:1403] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.007s
I20260709 13:10:04.182384 27904 raft_consensus.cc:359] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.183212 27904 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:04.183848 27904 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:04.186262 27904 ts_tablet_manager.cc:1434] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:04.187879 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-63772c6ab6094654b0215f6a3be7d6fc received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:04.188305 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-63772c6ab6094654b0215f6a3be7d6fc on tablet 63772c6ab6094654b0215f6a3be7d6fc with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:04.192456 27841 raft_consensus.cc:1217] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.239928 27841 raft_consensus.cc:1217] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.358409 27841 raft_consensus.cc:1217] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.427238 27841 raft_consensus.cc:1217] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.756039 27903 raft_consensus.cc:1064] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:04.759300 27903 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:04.766685 27841 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.767405 27231 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.768461 27464 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.769894 27870 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.770488 27150 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.772315 27912 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.789288 27150 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.788523 27841 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.792054 27464 raft_consensus.cc:1064] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:04.794930 27464 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:04.786748 27903 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.808350 27055 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.818813 27840 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.821658 27229 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.822398 27150 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.825700 27788 raft_consensus.cc:1064] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:04.826980 27912 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.828537 27788 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:04.833952 27912 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.844514 27870 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.849412 27229 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.857300 27840 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.861740 27301 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.863219 27718 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.864899 27718 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.887981 27913 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.896886 27226 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.904748 27718 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.908826 27229 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.914042 27841 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.928742 27718 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.946115 27788 raft_consensus.cc:1064] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:04.941661 27840 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.949704 27788 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:04.956163 27301 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.960170 27150 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:04.985213 27226 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.019315 27840 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.020165 27226 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.021063 27890 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.022207 27925 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.035890 27303 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:05.037253 27055 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.048163 27841 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.050762 27919 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:05.056535 27301 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:05.058017 27890 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:05.059847 27464 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.067728 27055 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.069854 27150 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.072580 27841 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.081571 27913 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:05.086447 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2d8b32b61494130ab83c26fc2d310e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.099340 27788 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.100975 27303 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.107630 27150 raft_consensus.cc:2955] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.111912 27052 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.119307 27840 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.123417 27151 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:05.126595 27041 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet c2d8b32b61494130ab83c26fc2d310e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:10:05.127405 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet c2d8b32b61494130ab83c26fc2d310e6 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:05.143548 27937 tablet_replica.cc:333] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:05.136135 27226 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.151785 27054 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.152802 27303 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:05.158116 27840 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.159579 27788 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.163208 27840 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.163450 27229 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.163924 27230 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.164983 27464 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.165743 27788 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.167502 27464 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.169047 27937 raft_consensus.cc:2243] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.170116 27925 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.176702 27903 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.185175 27150 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:05.189320 27839 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.193070 27937 raft_consensus.cc:2272] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.197582 27838 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.182682 27841 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.200299 27890 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.180995 27230 raft_consensus.cc:2955] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.207716 27937 ts_tablet_manager.cc:1916] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.213935 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36d2fcee6798446ca0ae9140145ba175 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.219036 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63772c6ab6094654b0215f6a3be7d6fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.221968 27837 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.220075 27890 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.255211 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86bf2019fd7b421393e482331c89a37d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.255374 27055 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:05.282215 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 90376.1us
I20260709 13:10:05.297287 27230 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.312181 27052 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.313254 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 36d2fcee6798446ca0ae9140145ba175 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:05.315599 27052 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.313583 27937 ts_tablet_manager.cc:1929] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:05.316962 27937 log.cc:1199] T c2d8b32b61494130ab83c26fc2d310e6 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/c2d8b32b61494130ab83c26fc2d310e6
I20260709 13:10:05.318970 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet c2d8b32b61494130ab83c26fc2d310e6 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:05.322894 27939 tablet_replica.cc:333] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:05.323953 27939 raft_consensus.cc:2243] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.324702 27939 raft_consensus.cc:2272] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.329728 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 86bf2019fd7b421393e482331c89a37d with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:05.332134 27890 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.332686 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 63772c6ab6094654b0215f6a3be7d6fc with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:05.333827 27231 raft_consensus.cc:2955] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.338809 27939 ts_tablet_manager.cc:1916] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.338630 27230 raft_consensus.cc:2955] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:05.343642 27940 tablet_replica.cc:333] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:05.344731 27940 raft_consensus.cc:2243] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.345502 27940 raft_consensus.cc:2272] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.354646 27939 ts_tablet_manager.cc:1929] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:05.355142 27939 log.cc:1199] T 36d2fcee6798446ca0ae9140145ba175 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/36d2fcee6798446ca0ae9140145ba175
I20260709 13:10:05.368371 27940 ts_tablet_manager.cc:1916] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.369247 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 36d2fcee6798446ca0ae9140145ba175 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:05.387444 27940 ts_tablet_manager.cc:1929] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:05.388012 27940 log.cc:1199] T 86bf2019fd7b421393e482331c89a37d P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/86bf2019fd7b421393e482331c89a37d
I20260709 13:10:05.389441 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 86bf2019fd7b421393e482331c89a37d (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:05.389588 27940 tablet_replica.cc:333] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:05.390568 27940 raft_consensus.cc:2243] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.391203 27940 raft_consensus.cc:2272] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.394237 27940 ts_tablet_manager.cc:1916] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.407281 27940 ts_tablet_manager.cc:1929] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:05.407668 27940 log.cc:1199] T 63772c6ab6094654b0215f6a3be7d6fc P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/63772c6ab6094654b0215f6a3be7d6fc
I20260709 13:10:05.409190 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 63772c6ab6094654b0215f6a3be7d6fc (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:06.405869 27304 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:06.414880 27271 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b636aab71bc4cad87e3a5d644042885. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.416425 27150 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.417096 27230 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.418138 27913 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.419163 27943 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.427062 27913 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.429069 27230 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.430763 27150 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.449591 27055 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.496321 27231 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:06.516340 27151 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.518487 27938 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.526136 27301 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.528815 27938 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.532532 27932 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.533151 27151 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:06.553318 27197 consensus_peers.cc:597] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 580a99e39c90417485c3e3481d14bbdc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.608629 27051 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.727617 27301 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:06.700368 27306 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.769261 27154 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.770656 27231 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.773355 27464 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:06.774813 27271 consensus_peers.cc:597] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9936add6bb224d4bbd8bcd5a38781ae5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.774827 27962 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:06.804093 27962 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.810997 27154 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.813493 27226 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.826435 27966 ts_tablet_manager.cc:933] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:06.831534 27151 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:06.835450 27966 tablet_copy_client.cc:323] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:06.845346 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 1b636aab71bc4cad87e3a5d644042885 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:06.846100 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 1b636aab71bc4cad87e3a5d644042885 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-1b636aab71bc4cad87e3a5d644042885
I20260709 13:10:06.845920 27051 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.859076 27306 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:06.860958 27122 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08a6377ffbb949a09216851d176dbcfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.862568 27941 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.862784 27231 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.864331 27941 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.870534 27316 tablet_copy_source_session.cc:215] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:06.875277 27966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b636aab71bc4cad87e3a5d644042885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.894578 27890 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.895539 27306 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.902458 27226 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.907485 27966 tablet_copy_client.cc:806] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:06.908277 27966 tablet_copy_client.cc:670] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:06.920440 27966 tablet_copy_client.cc:538] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:06.923528 27051 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:06.931510 27966 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:06.964572 27966 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:06.965708 27966 tablet_bootstrap.cc:492] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:06.966543 27966 ts_tablet_manager.cc:1403] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.009s
I20260709 13:10:06.970136 27966 raft_consensus.cc:359] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:06.971024 27966 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:06.971724 27966 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:06.975371 27966 ts_tablet_manager.cc:1434] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:10:06.977273 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-1b636aab71bc4cad87e3a5d644042885 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:06.977777 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-1b636aab71bc4cad87e3a5d644042885 on tablet 1b636aab71bc4cad87e3a5d644042885 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:07.086683 27966 ts_tablet_manager.cc:933] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:07.099085 27966 tablet_copy_client.cc:323] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:07.118402 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 580a99e39c90417485c3e3481d14bbdc from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:07.118957 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 580a99e39c90417485c3e3481d14bbdc from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-580a99e39c90417485c3e3481d14bbdc
I20260709 13:10:07.128049 27242 tablet_copy_source_session.cc:215] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.131886 27966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580a99e39c90417485c3e3481d14bbdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.151068 27966 tablet_copy_client.cc:806] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.151660 27966 tablet_copy_client.cc:670] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.155377 27966 tablet_copy_client.cc:538] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.161118 27976 ts_tablet_manager.cc:933] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:07.164631 27966 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:07.174621 27976 tablet_copy_client.cc:323] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:07.176712 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 9936add6bb224d4bbd8bcd5a38781ae5 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:07.177286 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 9936add6bb224d4bbd8bcd5a38781ae5 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-9936add6bb224d4bbd8bcd5a38781ae5
I20260709 13:10:07.187219 27316 tablet_copy_source_session.cc:215] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.189989 27966 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.190469 27976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9936add6bb224d4bbd8bcd5a38781ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.191107 27966 tablet_bootstrap.cc:492] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:07.191725 27966 ts_tablet_manager.cc:1403] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.006s
I20260709 13:10:07.195071 27966 raft_consensus.cc:359] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.195919 27966 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:07.196552 27966 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.200717 27966 ts_tablet_manager.cc:1434] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:10:07.205214 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-580a99e39c90417485c3e3481d14bbdc received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:07.205677 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-580a99e39c90417485c3e3481d14bbdc on tablet 580a99e39c90417485c3e3481d14bbdc with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:07.225345 27976 tablet_copy_client.cc:806] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.226009 27976 tablet_copy_client.cc:670] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.229743 27976 tablet_copy_client.cc:538] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.241641 27976 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:07.256583 27966 ts_tablet_manager.cc:933] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:07.260923 27966 tablet_copy_client.cc:323] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:07.263006 27976 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.264093 27976 tablet_bootstrap.cc:492] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:07.264916 27976 ts_tablet_manager.cc:1403] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.005s
I20260709 13:10:07.267498 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 08a6377ffbb949a09216851d176dbcfc from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:07.268100 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 08a6377ffbb949a09216851d176dbcfc from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-08a6377ffbb949a09216851d176dbcfc
I20260709 13:10:07.276494 27167 tablet_copy_source_session.cc:215] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.280766 27966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a6377ffbb949a09216851d176dbcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.283007 27841 raft_consensus.cc:1217] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.284714 27976 raft_consensus.cc:359] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.285629 27976 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:07.286703 27976 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.289191 27976 ts_tablet_manager.cc:1434] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:10:07.309180 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-9936add6bb224d4bbd8bcd5a38781ae5 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:07.309729 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-9936add6bb224d4bbd8bcd5a38781ae5 on tablet 9936add6bb224d4bbd8bcd5a38781ae5 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:07.312777 27966 tablet_copy_client.cc:806] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.313519 27966 tablet_copy_client.cc:670] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.318302 27966 tablet_copy_client.cc:538] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.327219 27966 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:07.348739 27966 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.349517 27966 tablet_bootstrap.cc:492] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:07.350108 27966 ts_tablet_manager.cc:1403] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:10:07.352926 27966 raft_consensus.cc:359] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.353747 27966 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:07.354406 27966 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:07.356478 27966 ts_tablet_manager.cc:1434] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:07.359018 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-08a6377ffbb949a09216851d176dbcfc received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:07.359452 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-08a6377ffbb949a09216851d176dbcfc on tablet 08a6377ffbb949a09216851d176dbcfc with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:07.712494 27837 raft_consensus.cc:1217] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.740428 27837 raft_consensus.cc:1217] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.753998 27943 raft_consensus.cc:1064] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:07.757155 27943 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:07.767048 27151 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.767813 27837 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.768991 27226 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.768631 27943 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:07.770699 27959 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:07.771502 27464 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.792277 27841 raft_consensus.cc:1217] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.805456 27983 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.808171 27226 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.820519 27150 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.838815 27841 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.844492 27051 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.877362 27301 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:07.884883 27841 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:07.885317 27151 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:07.886489 27464 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.888293 27983 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.899734 27464 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.901796 27837 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.916146 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b636aab71bc4cad87e3a5d644042885 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:07.923099 27053 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.931890 27151 raft_consensus.cc:2955] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:07.937534 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b636aab71bc4cad87e3a5d644042885 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:07.964967 27992 tablet_replica.cc:333] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:07.966622 27992 raft_consensus.cc:2243] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.967603 27992 raft_consensus.cc:2272] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.976358 27992 ts_tablet_manager.cc:1916] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:07.994743 27992 ts_tablet_manager.cc:1929] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:07.995253 27992 log.cc:1199] T 1b636aab71bc4cad87e3a5d644042885 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/1b636aab71bc4cad87e3a5d644042885
I20260709 13:10:07.997067 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 1b636aab71bc4cad87e3a5d644042885 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:08.175201 27464 raft_consensus.cc:1064] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:08.177978 27464 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.185354 27837 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.187630 27226 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.188169 27151 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.189256 27464 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.190667 27983 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.194890 27983 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.210711 27982 raft_consensus.cc:1064] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:08.213714 27982 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.242340 27959 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.245078 27150 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.248327 27841 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.278123 27053 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.281894 27226 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.297588 27988 raft_consensus.cc:1064] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:08.300652 27988 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.308923 27841 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.311843 27150 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.314743 27960 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.316915 27304 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.318135 27231 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.325665 27890 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.328028 27890 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.332995 27960 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.334456 27841 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.336766 27304 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.338676 27941 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.343663 27998 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.358599 27304 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.394654 27837 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.395622 27226 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.397310 27464 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.403505 27464 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:08.403833 27988 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.411950 27960 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.416947 27839 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.435560 27837 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.435555 27983 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.448014 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9936add6bb224d4bbd8bcd5a38781ae5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.459609 27055 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.469642 27226 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.508700 27052 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.520833 27839 raft_consensus.cc:2955] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.551299 27151 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:08.554742 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 84706.5us
I20260709 13:10:08.568791 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 9936add6bb224d4bbd8bcd5a38781ae5 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:08.572455 27231 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.577498 27306 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.599788 27053 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.622191 27306 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.662464 28012 tablet_replica.cc:333] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:08.663904 28012 raft_consensus.cc:2243] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.664762 28012 raft_consensus.cc:2272] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.669378 28012 ts_tablet_manager.cc:1916] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.670630 27231 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.677564 27839 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.682354 27938 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:08.686762 27305 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.684909 27150 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:08.690680 27938 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.693924 28012 ts_tablet_manager.cc:1929] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.694497 28012 log.cc:1199] T 9936add6bb224d4bbd8bcd5a38781ae5 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/9936add6bb224d4bbd8bcd5a38781ae5
I20260709 13:10:08.696811 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 9936add6bb224d4bbd8bcd5a38781ae5 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:08.698217 28008 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.700248 27839 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.701881 27988 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.702989 27230 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.705219 27890 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.712507 27988 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.714444 27306 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.730576 27839 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.738397 27837 raft_consensus.cc:2955] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.742656 27231 raft_consensus.cc:2955] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.740201 27052 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.751046 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08a6377ffbb949a09216851d176dbcfc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.756183 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 580a99e39c90417485c3e3481d14bbdc with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:08.764470 28012 tablet_replica.cc:333] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:08.765659 28012 raft_consensus.cc:2243] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.766410 28012 raft_consensus.cc:2272] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.770548 28012 ts_tablet_manager.cc:1916] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.769865 27052 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:08.783095 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 580a99e39c90417485c3e3481d14bbdc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.813370 28012 ts_tablet_manager.cc:1929] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.814045 28012 log.cc:1199] T 580a99e39c90417485c3e3481d14bbdc P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/580a99e39c90417485c3e3481d14bbdc
I20260709 13:10:08.815357 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 08a6377ffbb949a09216851d176dbcfc with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:08.816402 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 580a99e39c90417485c3e3481d14bbdc (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:08.829202 28013 tablet_replica.cc:333] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:08.830542 28013 raft_consensus.cc:2243] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.831763 28013 raft_consensus.cc:2272] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.835794 28013 ts_tablet_manager.cc:1916] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.851912 28013 ts_tablet_manager.cc:1929] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.852396 28013 log.cc:1199] T 08a6377ffbb949a09216851d176dbcfc P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/08a6377ffbb949a09216851d176dbcfc
I20260709 13:10:08.854111 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 08a6377ffbb949a09216851d176dbcfc (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:09.895579 27305 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:09.902190 27271 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 897bd586cdb44a899e3c85e77da927c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.902557 27150 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.904313 28016 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.905866 27231 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.907568 28016 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.914592 28010 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:09.916513 27150 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:09.918743 27231 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:09.931670 27150 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:09.936641 27052 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:09.957562 27122 consensus_peers.cc:597] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 432318984ae54d3b86d6f16faa526523. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.957536 27305 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.962446 27890 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.970176 27226 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.973773 28021 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.981077 27988 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:09.983335 27305 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:09.993947 27226 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.000272 27306 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:10.013890 27271 consensus_peers.cc:597] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b62a963093f641fa81d5d816797099e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.017473 27231 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:10.019441 28010 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.020387 27055 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.030802 27151 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:10.032464 28029 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.033985 28028 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.039152 27231 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.043035 27151 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.053169 27305 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.061089 27053 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:10.074827 27271 consensus_peers.cc:597] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af55c80b2afb4d89beeb86311b788bca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.078737 27231 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:10.079416 27151 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:10.081121 28029 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.084757 27464 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.098384 28010 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.106832 27231 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.113547 27150 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:10.132997 27053 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.283264 28035 ts_tablet_manager.cc:933] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:10.285481 28035 tablet_copy_client.cc:323] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:10.287176 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 897bd586cdb44a899e3c85e77da927c3 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:10.287736 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 897bd586cdb44a899e3c85e77da927c3 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-897bd586cdb44a899e3c85e77da927c3
I20260709 13:10:10.295914 27316 tablet_copy_source_session.cc:215] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.301159 28035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897bd586cdb44a899e3c85e77da927c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.315043 28035 tablet_copy_client.cc:806] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.315728 28035 tablet_copy_client.cc:670] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.322853 28035 tablet_copy_client.cc:538] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.333209 28035 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:10.361506 28035 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.362632 28035 tablet_bootstrap.cc:492] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:10.363382 28035 ts_tablet_manager.cc:1403] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.009s
I20260709 13:10:10.366756 28035 raft_consensus.cc:359] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.367659 28035 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:10.368356 28035 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.371861 28035 ts_tablet_manager.cc:1434] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:10.373652 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-897bd586cdb44a899e3c85e77da927c3 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:10.374092 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-897bd586cdb44a899e3c85e77da927c3 on tablet 897bd586cdb44a899e3c85e77da927c3 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:10.472800 28035 ts_tablet_manager.cc:933] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:10.474802 28035 tablet_copy_client.cc:323] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:10.476480 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 432318984ae54d3b86d6f16faa526523 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:10.476994 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 432318984ae54d3b86d6f16faa526523 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-432318984ae54d3b86d6f16faa526523
I20260709 13:10:10.484292 27167 tablet_copy_source_session.cc:215] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.488095 28035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432318984ae54d3b86d6f16faa526523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.509764 28035 tablet_copy_client.cc:806] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.510531 28035 tablet_copy_client.cc:670] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.514498 28035 tablet_copy_client.cc:538] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.524016 28035 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:10.535921 28040 ts_tablet_manager.cc:933] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:10.545996 28040 tablet_copy_client.cc:323] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:10.548188 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet af55c80b2afb4d89beeb86311b788bca from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:10.548789 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet af55c80b2afb4d89beeb86311b788bca from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-af55c80b2afb4d89beeb86311b788bca
I20260709 13:10:10.554301 28035 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.555482 28035 tablet_bootstrap.cc:492] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:10.556293 28035 ts_tablet_manager.cc:1403] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.008s
I20260709 13:10:10.559913 28035 raft_consensus.cc:359] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.560529 27316 tablet_copy_source_session.cc:215] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.561039 28035 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:10.561843 28035 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.564888 28040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af55c80b2afb4d89beeb86311b788bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.567013 28035 ts_tablet_manager.cc:1434] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:10:10.569530 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-432318984ae54d3b86d6f16faa526523 received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:10.569972 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-432318984ae54d3b86d6f16faa526523 on tablet 432318984ae54d3b86d6f16faa526523 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:10.579281 28035 ts_tablet_manager.cc:933] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:10.602005 28035 tablet_copy_client.cc:323] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:10.603874 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet b62a963093f641fa81d5d816797099e1 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:10.603977 28040 tablet_copy_client.cc:806] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.604462 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet b62a963093f641fa81d5d816797099e1 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-b62a963093f641fa81d5d816797099e1
I20260709 13:10:10.605230 28040 tablet_copy_client.cc:670] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.609959 28040 tablet_copy_client.cc:538] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.613817 27316 tablet_copy_source_session.cc:215] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.618187 28035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62a963093f641fa81d5d816797099e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.642710 28040 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:10.649880 28035 tablet_copy_client.cc:806] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.650755 28035 tablet_copy_client.cc:670] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.655283 28035 tablet_copy_client.cc:538] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.670497 28035 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:10.672336 28040 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.673388 28040 tablet_bootstrap.cc:492] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:10.674140 28040 ts_tablet_manager.cc:1403] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.007s
I20260709 13:10:10.677445 28040 raft_consensus.cc:359] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.678372 28040 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:10.679072 28040 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.681628 28040 ts_tablet_manager.cc:1434] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:10.691960 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-af55c80b2afb4d89beeb86311b788bca received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:10.692425 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-af55c80b2afb4d89beeb86311b788bca on tablet af55c80b2afb4d89beeb86311b788bca with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:10.705422 28035 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.706524 28035 tablet_bootstrap.cc:492] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:10.707342 28035 ts_tablet_manager.cc:1403] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.004s
I20260709 13:10:10.710130 28035 raft_consensus.cc:359] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.711037 28035 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:10.711714 28035 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:10.714095 28035 ts_tablet_manager.cc:1434] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:10.719720 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-b62a963093f641fa81d5d816797099e1 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:10.720184 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-b62a963093f641fa81d5d816797099e1 on tablet b62a963093f641fa81d5d816797099e1 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:10.815486 27837 raft_consensus.cc:1217] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:10.988436 27837 raft_consensus.cc:1217] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:11.061048 27837 raft_consensus.cc:1217] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:11.075945 27837 raft_consensus.cc:1217] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:11.223984 28029 raft_consensus.cc:1064] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:11.228433 28029 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.262967 27837 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.265013 27150 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.266011 27230 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.267139 28050 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.269095 28050 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.276432 28029 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:10:11.289968 28029 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.291941 27231 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.294467 27153 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.314924 27839 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.321415 27053 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.386180 27306 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.392454 27150 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.392906 27839 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.394452 28029 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.396451 28048 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.407969 28029 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.410271 27150 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.410302 27839 raft_consensus.cc:2955] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.431119 27052 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.436331 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 897bd586cdb44a899e3c85e77da927c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.459312 28029 raft_consensus.cc:1064] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:11.461534 28029 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.466816 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 897bd586cdb44a899e3c85e77da927c3 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:11.480341 28059 tablet_replica.cc:333] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:11.496160 28059 raft_consensus.cc:2243] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.498580 28021 raft_consensus.cc:1064] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:11.501454 28021 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.506909 28059 raft_consensus.cc:2272] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.524521 27231 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.527786 27839 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.528435 28047 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.531076 28010 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.531663 28028 raft_consensus.cc:1064] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:11.543545 28059 ts_tablet_manager.cc:1916] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.542001 28028 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.548179 27226 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.549757 28050 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.558637 27151 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.560370 28029 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:11.587381 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67502.7us
I20260709 13:10:11.589807 27837 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.591894 27988 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.606261 27841 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.608839 27306 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.608917 28010 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:11.610698 28063 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.613179 27841 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.614595 27988 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.624819 28010 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.639642 27839 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.640349 27052 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.640607 27231 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:11.652956 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50078.6us
I20260709 13:10:11.660319 28059 ts_tablet_manager.cc:1929] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.660867 28059 log.cc:1199] T 897bd586cdb44a899e3c85e77da927c3 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/897bd586cdb44a899e3c85e77da927c3
I20260709 13:10:11.665584 27151 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.671298 27226 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.671849 27151 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.680018 27052 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.682672 27840 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.687863 27988 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.692417 27226 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.695652 27988 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.696398 28070 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.703372 27229 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.704386 28021 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.711647 27306 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.730690 27226 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.733542 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 897bd586cdb44a899e3c85e77da927c3 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:11.747437 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 432318984ae54d3b86d6f16faa526523 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.748634 27837 raft_consensus.cc:2955] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.783263 27051 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.788297 28071 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:11.802624 28028 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.808295 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 432318984ae54d3b86d6f16faa526523 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:11.844017 27226 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.854657 28075 tablet_replica.cc:333] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:11.868230 28075 raft_consensus.cc:2243] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.869238 28075 raft_consensus.cc:2272] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.880429 28075 ts_tablet_manager.cc:1916] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.885919 27052 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.886910 27839 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.894572 27150 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.909737 28075 ts_tablet_manager.cc:1929] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.911685 28075 log.cc:1199] T 432318984ae54d3b86d6f16faa526523 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/432318984ae54d3b86d6f16faa526523
I20260709 13:10:11.917517 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 432318984ae54d3b86d6f16faa526523 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:11.939044 27301 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:11.944881 27230 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.946427 27839 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.946429 28028 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:11.948195 28071 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.955430 28028 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.957366 27230 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.962463 27839 raft_consensus.cc:2955] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.974295 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af55c80b2afb4d89beeb86311b788bca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.977486 27052 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:11.989778 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet af55c80b2afb4d89beeb86311b788bca with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:11.993499 28078 tablet_replica.cc:333] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:11.994743 28078 raft_consensus.cc:2243] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.995581 28078 raft_consensus.cc:2272] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:12.001363 28078 ts_tablet_manager.cc:1916] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:12.018646 28078 ts_tablet_manager.cc:1929] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:12.019093 28078 log.cc:1199] T af55c80b2afb4d89beeb86311b788bca P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/af55c80b2afb4d89beeb86311b788bca
I20260709 13:10:12.020967 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet af55c80b2afb4d89beeb86311b788bca (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:12.097097 27150 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:12.128120 27301 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:12.137239 27151 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:12.137243 27839 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:12.139096 28070 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:12.140058 28071 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:12.151211 28071 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:12.152527 27839 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:12.162766 27151 raft_consensus.cc:2955] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:12.168248 27051 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:12.169358 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b62a963093f641fa81d5d816797099e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:12.185045 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet b62a963093f641fa81d5d816797099e1 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:12.186131 28059 tablet_replica.cc:333] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:12.187036 28059 raft_consensus.cc:2243] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:12.187597 28059 raft_consensus.cc:2272] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:12.190603 28059 ts_tablet_manager.cc:1916] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:12.204509 28059 ts_tablet_manager.cc:1929] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:12.204968 28059 log.cc:1199] T b62a963093f641fa81d5d816797099e1 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/b62a963093f641fa81d5d816797099e1
I20260709 13:10:12.206524 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet b62a963093f641fa81d5d816797099e1 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:13.263118 27151 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:13.270372 27122 consensus_peers.cc:597] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b91cb18a432b4fefa2c9d4eff143e3d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.270937 27226 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.272534 27306 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.273006 28021 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.274776 28021 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.282124 28021 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.283576 27226 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.285254 27306 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.299860 27226 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:13.301625 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:13.318593 27197 consensus_peers.cc:597] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 652ad18b41cd4991881cb7beaaa59f8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.321231 27151 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.323355 28008 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.323830 27301 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.325114 28008 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.347299 28051 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.348860 27306 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.348872 27150 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.372704 27226 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:13.372529 27052 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:13.381608 27197 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44c0f63822c7471ebdec8a5f3dfa21a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.382361 27306 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.382354 27150 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.384486 28008 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.386144 28008 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.397746 28095 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.403730 27301 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.405445 27151 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.423949 27055 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.425040 27301 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:13.445628 27151 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.447147 27226 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:13.448729 28048 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:13.451025 28099 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.461062 28048 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.463940 27151 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:13.469621 27271 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23b189bbd0aa4c6787e99f8cc041dd48. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.499897 27055 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.504783 27226 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:13.821444 28103 ts_tablet_manager.cc:933] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:13.823151 28103 tablet_copy_client.cc:323] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:13.825246 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet b91cb18a432b4fefa2c9d4eff143e3d7 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:13.825804 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet b91cb18a432b4fefa2c9d4eff143e3d7 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-b91cb18a432b4fefa2c9d4eff143e3d7
I20260709 13:10:13.834519 27167 tablet_copy_source_session.cc:215] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.839188 28103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91cb18a432b4fefa2c9d4eff143e3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.860316 28103 tablet_copy_client.cc:806] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.861111 28103 tablet_copy_client.cc:670] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.862887 28105 ts_tablet_manager.cc:933] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:13.865166 28103 tablet_copy_client.cc:538] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.865463 28105 tablet_copy_client.cc:323] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:13.868914 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:13.869437 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 44c0f63822c7471ebdec8a5f3dfa21a9 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-44c0f63822c7471ebdec8a5f3dfa21a9
I20260709 13:10:13.875326 28103 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:13.882088 27242 tablet_copy_source_session.cc:215] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.885604 28105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c0f63822c7471ebdec8a5f3dfa21a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.895458 28107 ts_tablet_manager.cc:933] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:13.919502 28107 tablet_copy_client.cc:323] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:13.922238 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 652ad18b41cd4991881cb7beaaa59f8c from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:13.922801 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 652ad18b41cd4991881cb7beaaa59f8c from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-652ad18b41cd4991881cb7beaaa59f8c
I20260709 13:10:13.923132 28103 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:13.924172 28103 tablet_bootstrap.cc:492] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:13.924889 28103 ts_tablet_manager.cc:1403] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.007s
I20260709 13:10:13.932503 27242 tablet_copy_source_session.cc:215] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.932658 28105 tablet_copy_client.cc:806] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.935359 28105 tablet_copy_client.cc:670] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.937364 28103 raft_consensus.cc:359] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:13.938385 28103 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:13.938460 28107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ad18b41cd4991881cb7beaaa59f8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.939181 28103 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:13.939687 28105 tablet_copy_client.cc:538] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.965791 28103 ts_tablet_manager.cc:1434] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.041s	user 0.019s	sys 0.004s
I20260709 13:10:13.973203 28107 tablet_copy_client.cc:806] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.974390 28107 tablet_copy_client.cc:670] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.973299 28105 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:13.981076 28107 tablet_copy_client.cc:538] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.988842 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-b91cb18a432b4fefa2c9d4eff143e3d7 received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:13.989355 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-b91cb18a432b4fefa2c9d4eff143e3d7 on tablet b91cb18a432b4fefa2c9d4eff143e3d7 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:14.007035 28107 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:14.024044 28105 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.025048 28105 tablet_bootstrap.cc:492] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:14.025836 28105 ts_tablet_manager.cc:1403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.012s
I20260709 13:10:14.028962 28105 raft_consensus.cc:359] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.029863 28105 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:14.030604 28105 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.055605 28105 ts_tablet_manager.cc:1434] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:10:14.059943 28107 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.061124 28107 tablet_bootstrap.cc:492] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:14.061947 28107 ts_tablet_manager.cc:1403] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.016s
I20260709 13:10:14.062832 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-44c0f63822c7471ebdec8a5f3dfa21a9 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:14.063323 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-44c0f63822c7471ebdec8a5f3dfa21a9 on tablet 44c0f63822c7471ebdec8a5f3dfa21a9 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:14.066628 28103 ts_tablet_manager.cc:933] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:14.074467 28103 tablet_copy_client.cc:323] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:14.074563 28107 raft_consensus.cc:359] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.075511 28107 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:14.076110 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 23b189bbd0aa4c6787e99f8cc041dd48 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:14.076707 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 23b189bbd0aa4c6787e99f8cc041dd48 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-23b189bbd0aa4c6787e99f8cc041dd48
I20260709 13:10:14.078464 28107 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.081084 28107 ts_tablet_manager.cc:1434] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:14.083272 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-652ad18b41cd4991881cb7beaaa59f8c received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:14.083694 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-652ad18b41cd4991881cb7beaaa59f8c on tablet 652ad18b41cd4991881cb7beaaa59f8c with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:14.084887 27316 tablet_copy_source_session.cc:215] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:14.089874 28103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b189bbd0aa4c6787e99f8cc041dd48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.107190 28103 tablet_copy_client.cc:806] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:14.107988 28103 tablet_copy_client.cc:670] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:14.111811 28103 tablet_copy_client.cc:538] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:14.119850 28103 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:14.142751 28103 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:14.144229 28103 tablet_bootstrap.cc:492] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:14.145047 28103 ts_tablet_manager.cc:1403] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.008s
I20260709 13:10:14.147920 28103 raft_consensus.cc:359] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.148617 28103 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:14.149168 28103 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:14.151412 28103 ts_tablet_manager.cc:1434] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:14.155821 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-23b189bbd0aa4c6787e99f8cc041dd48 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:14.156323 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-23b189bbd0aa4c6787e99f8cc041dd48 on tablet 23b189bbd0aa4c6787e99f8cc041dd48 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:14.321997 27837 raft_consensus.cc:1217] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:14.337570 27837 raft_consensus.cc:1217] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:14.480064 27837 raft_consensus.cc:1217] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:14.500658 27837 raft_consensus.cc:1217] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:14.808524 28021 raft_consensus.cc:1064] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:14.811375 28021 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:14.818495 28008 raft_consensus.cc:1064] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:14.821112 28008 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:14.825713 27301 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.826799 27226 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.827383 28115 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.828521 28021 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.829327 27839 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.832626 28115 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.837505 27839 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.837993 27151 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.839833 28095 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:14.866825 28079 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.874876 27306 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.880043 28079 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.881875 28115 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:14.884831 27301 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:14.910573 28095 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:14.915987 27839 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:14.945492 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44893.3us
I20260709 13:10:15.003998 27837 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.027304 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.040565 27232 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.050439 27151 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.073060 27052 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.101483 28130 raft_consensus.cc:1064] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:15.104969 28130 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:15.109443 27305 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.115075 27153 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:15.117570 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 107668us
I20260709 13:10:15.125300 27837 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.126451 27150 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.129848 28095 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.131278 27306 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.134507 28095 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.162858 27839 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.166877 27306 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.165766 28125 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:10:15.178375 28125 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.186385 28084 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:15.199046 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54828.6us
I20260709 13:10:15.211200 28129 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.168051 27232 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:15.238260 27306 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.242515 28095 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.250809 27837 raft_consensus.cc:2955] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.257562 27153 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.260499 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b91cb18a432b4fefa2c9d4eff143e3d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.263337 28127 raft_consensus.cc:1064] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:15.266503 28127 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:15.273949 27839 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.277030 28130 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.287256 27840 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.293267 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.304385 28130 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:15.313972 28079 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.315847 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet b91cb18a432b4fefa2c9d4eff143e3d7 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:15.320612 27839 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.344194 27301 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.347051 27053 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.359871 28146 tablet_replica.cc:333] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:15.368300 27232 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.369438 27839 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.370925 27150 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:15.373229 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:15.376216 27055 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.380836 28148 tablet_replica.cc:333] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:15.381420 28100 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.381973 28148 raft_consensus.cc:2243] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.382899 28148 raft_consensus.cc:2272] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.385008 28100 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.390357 28116 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.400029 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44c0f63822c7471ebdec8a5f3dfa21a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.400521 28148 ts_tablet_manager.cc:1916] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.405543 27151 raft_consensus.cc:2955] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.407779 27153 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.422976 28148 ts_tablet_manager.cc:1929] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.423661 28148 log.cc:1199] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/44c0f63822c7471ebdec8a5f3dfa21a9
I20260709 13:10:15.425401 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 44c0f63822c7471ebdec8a5f3dfa21a9 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:15.428805 28146 raft_consensus.cc:2243] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.429733 28146 raft_consensus.cc:2272] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.436997 28146 ts_tablet_manager.cc:1916] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.438304 28116 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.440430 27152 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.456943 27232 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:15.462214 27840 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.464192 28130 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:15.507019 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53090.4us
W20260709 13:10:15.509984 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45661.8us
I20260709 13:10:15.510155 27301 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.517418 27229 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.524765 27840 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.537223 28095 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.545089 28129 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.551913 27301 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.557519 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 652ad18b41cd4991881cb7beaaa59f8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.561533 27053 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.574211 27839 raft_consensus.cc:2955] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.590301 27301 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:15.590672 27051 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.599987 28146 ts_tablet_manager.cc:1929] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.601815 28146 log.cc:1199] T b91cb18a432b4fefa2c9d4eff143e3d7 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/b91cb18a432b4fefa2c9d4eff143e3d7
I20260709 13:10:15.603662 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet b91cb18a432b4fefa2c9d4eff143e3d7 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:15.609011 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 652ad18b41cd4991881cb7beaaa59f8c with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:15.620354 27152 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.622035 27840 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:15.624341 28152 tablet_replica.cc:333] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:15.625521 28152 raft_consensus.cc:2243] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.625630 28116 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.627117 28141 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.630798 28152 raft_consensus.cc:2272] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.635488 28152 ts_tablet_manager.cc:1916] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.639561 28080 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.653524 27840 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.665683 27152 raft_consensus.cc:2955] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.667025 28152 ts_tablet_manager.cc:1929] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.667559 28152 log.cc:1199] T 652ad18b41cd4991881cb7beaaa59f8c P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/652ad18b41cd4991881cb7beaaa59f8c
I20260709 13:10:15.669633 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 652ad18b41cd4991881cb7beaaa59f8c (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:15.674715 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23b189bbd0aa4c6787e99f8cc041dd48 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:15.681842 27053 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:15.703800 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 23b189bbd0aa4c6787e99f8cc041dd48 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:15.704922 28146 tablet_replica.cc:333] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:15.706140 28146 raft_consensus.cc:2243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:15.706923 28146 raft_consensus.cc:2272] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:15.718381 28146 ts_tablet_manager.cc:1916] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:15.740191 28146 ts_tablet_manager.cc:1929] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:15.740600 28146 log.cc:1199] T 23b189bbd0aa4c6787e99f8cc041dd48 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/23b189bbd0aa4c6787e99f8cc041dd48
I20260709 13:10:15.742146 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 23b189bbd0aa4c6787e99f8cc041dd48 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:16.963184 27153 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:16.974359 27122 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6c3d4b3cf374582b470348b1f7dc027. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.974826 27301 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.975724 27232 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.976475 28084 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:16.977618 28125 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.985956 28125 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:16.987946 27232 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:16.990024 27301 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.017831 27052 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.019217 27301 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.030850 27232 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:17.032553 28080 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:17.033730 27271 consensus_peers.cc:597] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ba2f184437940dbb94ed0532f27e854. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.034471 27153 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:17.036240 28141 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:17.056792 27231 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.059854 28155 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.057143 27154 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.080451 27051 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.090114 27301 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.102731 27153 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:17.102852 27271 consensus_peers.cc:597] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2433340983a46c0b79d3ff64b3694b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.104300 27231 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:17.104447 28156 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:17.106653 28156 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.114194 28155 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.125617 27153 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.119319 27231 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.146431 27301 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.146481 27052 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.190399 27231 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:17.192829 27153 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:17.194684 28080 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:17.196189 27271 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a41c5fdb574f47168ed45c1838cbd31d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:17.197367 28080 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.206035 28141 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.207393 27154 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.211066 27229 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.230189 27052 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:17.500136 28176 ts_tablet_manager.cc:933] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:17.505606 28176 tablet_copy_client.cc:323] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:17.508666 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 8ba2f184437940dbb94ed0532f27e854 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:17.509382 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 8ba2f184437940dbb94ed0532f27e854 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-8ba2f184437940dbb94ed0532f27e854
I20260709 13:10:17.509670 28178 ts_tablet_manager.cc:933] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:17.513849 28178 tablet_copy_client.cc:323] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:17.515879 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet d6c3d4b3cf374582b470348b1f7dc027 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:17.516353 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet d6c3d4b3cf374582b470348b1f7dc027 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-d6c3d4b3cf374582b470348b1f7dc027
I20260709 13:10:17.520552 27316 tablet_copy_source_session.cc:215] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:17.524336 28176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba2f184437940dbb94ed0532f27e854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.525646 27167 tablet_copy_source_session.cc:215] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:17.529440 28178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c3d4b3cf374582b470348b1f7dc027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.542428 28176 tablet_copy_client.cc:806] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:17.543123 28176 tablet_copy_client.cc:670] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:17.547509 28176 tablet_copy_client.cc:538] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:17.553748 28178 tablet_copy_client.cc:806] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:17.554561 28178 tablet_copy_client.cc:670] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:17.557312 28176 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:17.560798 28178 tablet_copy_client.cc:538] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:17.586710 28176 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:17.587978 28176 tablet_bootstrap.cc:492] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:17.588411 28180 ts_tablet_manager.cc:933] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:17.588811 28176 ts_tablet_manager.cc:1403] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.013s
I20260709 13:10:17.590332 28178 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:17.592607 28176 raft_consensus.cc:359] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.593616 28176 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:17.594450 28176 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.597312 28180 tablet_copy_client.cc:323] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:17.599298 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet e2433340983a46c0b79d3ff64b3694b6 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:17.599869 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet e2433340983a46c0b79d3ff64b3694b6 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-e2433340983a46c0b79d3ff64b3694b6
I20260709 13:10:17.608258 27316 tablet_copy_source_session.cc:215] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:17.612061 28180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2433340983a46c0b79d3ff64b3694b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.612344 28176 ts_tablet_manager.cc:1434] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:10:17.622314 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-8ba2f184437940dbb94ed0532f27e854 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:17.622932 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-8ba2f184437940dbb94ed0532f27e854 on tablet 8ba2f184437940dbb94ed0532f27e854 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:17.634764 28180 tablet_copy_client.cc:806] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:17.643952 28180 tablet_copy_client.cc:670] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:17.644320 28176 ts_tablet_manager.cc:933] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:17.643291 28178 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:17.646195 28178 tablet_bootstrap.cc:492] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:17.646955 28178 ts_tablet_manager.cc:1403] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.023s
I20260709 13:10:17.650250 28178 raft_consensus.cc:359] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.651153 28178 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:17.651851 28178 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.653769 28178 ts_tablet_manager.cc:1434] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:17.656064 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-d6c3d4b3cf374582b470348b1f7dc027 received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:17.656622 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-d6c3d4b3cf374582b470348b1f7dc027 on tablet d6c3d4b3cf374582b470348b1f7dc027 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:17.663712 28180 tablet_copy_client.cc:538] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:17.673221 28176 tablet_copy_client.cc:323] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:17.674214 28180 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:17.681474 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet a41c5fdb574f47168ed45c1838cbd31d from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:17.682130 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet a41c5fdb574f47168ed45c1838cbd31d from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-a41c5fdb574f47168ed45c1838cbd31d
I20260709 13:10:17.694767 27316 tablet_copy_source_session.cc:215] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:17.701411 28176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c5fdb574f47168ed45c1838cbd31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:17.765980 28176 tablet_copy_client.cc:806] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:17.767719 28176 tablet_copy_client.cc:670] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:17.772331 28180 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:17.773433 28180 tablet_bootstrap.cc:492] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:17.773643 28176 tablet_copy_client.cc:538] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:17.774282 28180 ts_tablet_manager.cc:1403] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.100s	user 0.046s	sys 0.027s
I20260709 13:10:17.778157 28180 raft_consensus.cc:359] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.779070 28180 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:17.779808 28180 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.782650 28180 ts_tablet_manager.cc:1434] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:10:17.784546 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-e2433340983a46c0b79d3ff64b3694b6 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:17.784962 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-e2433340983a46c0b79d3ff64b3694b6 on tablet e2433340983a46c0b79d3ff64b3694b6 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:17.785507 28176 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:17.811517 28176 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:17.812579 28176 tablet_bootstrap.cc:492] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:17.813618 28176 ts_tablet_manager.cc:1403] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:10:17.816334 28176 raft_consensus.cc:359] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.817158 28176 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:17.817844 28176 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:17.820830 28176 ts_tablet_manager.cc:1434] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:10:17.824558 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-a41c5fdb574f47168ed45c1838cbd31d received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:17.824947 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-a41c5fdb574f47168ed45c1838cbd31d on tablet a41c5fdb574f47168ed45c1838cbd31d with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:17.880724 27837 raft_consensus.cc:1217] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:17.965162 27837 raft_consensus.cc:1217] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:18.028117 27837 raft_consensus.cc:1217] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:18.171566 27837 raft_consensus.cc:1217] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:18.415107 28141 raft_consensus.cc:1064] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:18.417186 28141 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.423910 27839 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.424018 27151 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.425554 28080 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.425705 27231 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.426569 28141 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.427455 28155 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.443375 28155 raft_consensus.cc:1064] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:18.460275 27153 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.456741 28156 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.496503 28155 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.493409 27051 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:18.511711 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47065.1us
I20260709 13:10:18.530619 27229 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.544380 28189 raft_consensus.cc:1064] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:18.546734 27839 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.554123 27231 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.559888 28196 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.561851 27837 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.563346 28196 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.576524 28189 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.605386 27153 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.664218 28141 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.706693 27229 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.708532 28189 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.718703 28156 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.720438 27231 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.745965 27301 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.754045 27837 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.762871 27151 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.765789 27839 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.785594 28208 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.796005 28189 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.809288 27055 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.819113 27301 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.822655 28208 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.826797 27306 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.829732 27839 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.836828 27229 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.840713 27837 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.841159 28155 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.842171 28080 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.856529 27229 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.858280 27054 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.871416 27306 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.876308 28141 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.879853 28194 raft_consensus.cc:1064] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:18.882578 28194 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.883127 27839 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.892136 27151 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:18.895295 27231 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.897487 28192 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:18.899223 27841 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.901697 28207 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:18.903568 27841 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.906072 27837 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.907665 28192 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.909861 28200 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.910953 27153 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.914822 27230 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:18.907446 28194 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:18.920122 28196 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.925137 28196 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:18.929715 27224 raft_consensus.cc:2955] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.934227 27840 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.952931 27840 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.955829 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6c3d4b3cf374582b470348b1f7dc027 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:18.963078 27232 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.967728 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e2433340983a46c0b79d3ff64b3694b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:18.978116 27054 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.977041 27052 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.945500 28080 raft_consensus.cc:2955] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:18.993382 27231 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:19.001493 28200 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.005146 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c3d4b3cf374582b470348b1f7dc027 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:19.009567 27226 raft_consensus.cc:2955] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.023907 28220 tablet_replica.cc:333] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:19.030602 28196 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.035924 28220 raft_consensus.cc:2243] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.036963 28220 raft_consensus.cc:2272] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.040434 27153 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.040867 27839 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.047078 28220 ts_tablet_manager.cc:1916] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.058580 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ba2f184437940dbb94ed0532f27e854 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:19.065328 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet e2433340983a46c0b79d3ff64b3694b6 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:19.085050 27054 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.087285 27054 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.089716 28220 ts_tablet_manager.cc:1929] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:19.090354 28220 log.cc:1199] T d6c3d4b3cf374582b470348b1f7dc027 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/d6c3d4b3cf374582b470348b1f7dc027
I20260709 13:10:19.092132 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet d6c3d4b3cf374582b470348b1f7dc027 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:19.102461 28221 tablet_replica.cc:333] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:19.102358 27226 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.103657 28221 raft_consensus.cc:2243] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.104672 28221 raft_consensus.cc:2272] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.109045 28221 ts_tablet_manager.cc:1916] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.110385 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ba2f184437940dbb94ed0532f27e854 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:19.130904 28221 ts_tablet_manager.cc:1929] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:19.131574 28221 log.cc:1199] T e2433340983a46c0b79d3ff64b3694b6 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/e2433340983a46c0b79d3ff64b3694b6
I20260709 13:10:19.133752 28221 tablet_replica.cc:333] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:19.134922 28221 raft_consensus.cc:2243] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.135634 28221 raft_consensus.cc:2272] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.139950 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet e2433340983a46c0b79d3ff64b3694b6 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:19.140218 28221 ts_tablet_manager.cc:1916] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.148363 27306 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:19.153615 27837 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:19.155216 28196 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.156895 27153 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:19.158187 28221 ts_tablet_manager.cc:1929] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:19.158778 28221 log.cc:1199] T 8ba2f184437940dbb94ed0532f27e854 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/8ba2f184437940dbb94ed0532f27e854
I20260709 13:10:19.160389 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 8ba2f184437940dbb94ed0532f27e854 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:19.161087 28196 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.162676 28141 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.165380 27839 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.172909 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a41c5fdb574f47168ed45c1838cbd31d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:19.178462 27153 raft_consensus.cc:2955] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:19.181164 27052 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.197929 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet a41c5fdb574f47168ed45c1838cbd31d with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:19.202159 28222 tablet_replica.cc:333] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:19.225833 28222 raft_consensus.cc:2243] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.226763 28222 raft_consensus.cc:2272] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.229467 28222 ts_tablet_manager.cc:1916] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.242914 28222 ts_tablet_manager.cc:1929] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:19.243291 28222 log.cc:1199] T a41c5fdb574f47168ed45c1838cbd31d P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/a41c5fdb574f47168ed45c1838cbd31d
I20260709 13:10:19.244964 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet a41c5fdb574f47168ed45c1838cbd31d (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:20.733177 27151 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:20.792222 27302 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:20.795552 28207 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:20.813115 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.834703 27122 consensus_peers.cc:597] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd514c8b688c4f2e90b6ad46174723ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.844699 27231 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:20.891839 28207 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:20.902462 28207 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:20.909744 27224 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:20.913156 27301 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:20.922232 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59252.2us
I20260709 13:10:20.934666 27052 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.942301 27224 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:20.950022 27154 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:20.950541 27197 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e9a8d686c4b4ec199d64c6d3882b858. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.951007 27301 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:20.952747 28252 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:20.953786 28249 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.983758 28249 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:20.985785 27301 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:20.986675 27154 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.006901 27301 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.008354 27051 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.017232 27224 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:21.017414 27271 consensus_peers.cc:597] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06445e3c1bb74c8f862cf1af47256377. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.018872 27154 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:21.019304 28227 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.020550 28226 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.029912 28227 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.034746 27224 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.036832 27154 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.055706 27051 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.068089 27301 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:21.076165 27271 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93b895e250184ee283d78483d5fcae92. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.079818 27229 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:21.081481 28223 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.081954 27154 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:21.083788 28223 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.095129 28226 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.098348 27154 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.101400 27226 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:21.115087 27053 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:21.242743 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080011da20 after lost signal to thread 26041
W20260709 13:10:21.244124 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080011c900 after lost signal to thread 27089
W20260709 13:10:21.246017 27178 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3520 after lost signal to thread 27181
W20260709 13:10:21.247313 27178 debug-util.cc:398] Leaking SignalData structure 0x7b0800325780 after lost signal to thread 27256
W20260709 13:10:21.248572 27178 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb340 after lost signal to thread 27330
W20260709 13:10:21.250941 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080031d260 after lost signal to thread 27865
I20260709 13:10:21.254428 28267 ts_tablet_manager.cc:933] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:21.256515 28267 tablet_copy_client.cc:323] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:21.258333 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet dd514c8b688c4f2e90b6ad46174723ef from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:21.258859 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet dd514c8b688c4f2e90b6ad46174723ef from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-dd514c8b688c4f2e90b6ad46174723ef
I20260709 13:10:21.267678 27167 tablet_copy_source_session.cc:215] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.272439 28267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd514c8b688c4f2e90b6ad46174723ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.293478 28267 tablet_copy_client.cc:806] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.294342 28267 tablet_copy_client.cc:670] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.308246 28267 tablet_copy_client.cc:538] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:21.336629 28267 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:21.391788 28267 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:21.399372 28267 tablet_bootstrap.cc:492] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:21.400636 28267 ts_tablet_manager.cc:1403] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.017s
I20260709 13:10:21.404099 28267 raft_consensus.cc:359] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.405045 28267 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:21.405786 28267 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.424386 28267 ts_tablet_manager.cc:1434] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 13:10:21.442216 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-dd514c8b688c4f2e90b6ad46174723ef received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:21.442749 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-dd514c8b688c4f2e90b6ad46174723ef on tablet dd514c8b688c4f2e90b6ad46174723ef with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:21.494089 28267 ts_tablet_manager.cc:933] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:21.496310 28267 tablet_copy_client.cc:323] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:21.498035 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 06445e3c1bb74c8f862cf1af47256377 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:21.498651 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 06445e3c1bb74c8f862cf1af47256377 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-06445e3c1bb74c8f862cf1af47256377
I20260709 13:10:21.510561 27316 tablet_copy_source_session.cc:215] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.514206 28267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06445e3c1bb74c8f862cf1af47256377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.533692 28267 tablet_copy_client.cc:806] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.534437 28267 tablet_copy_client.cc:670] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.539635 28267 tablet_copy_client.cc:538] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:21.546623 28272 ts_tablet_manager.cc:933] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:21.554427 28267 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:21.561389 28272 tablet_copy_client.cc:323] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:21.564026 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 6e9a8d686c4b4ec199d64c6d3882b858 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:21.564688 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 6e9a8d686c4b4ec199d64c6d3882b858 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-6e9a8d686c4b4ec199d64c6d3882b858
I20260709 13:10:21.582475 27242 tablet_copy_source_session.cc:215] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.585577 28267 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:21.586704 28267 tablet_bootstrap.cc:492] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:21.587453 28267 ts_tablet_manager.cc:1403] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.004s
I20260709 13:10:21.590972 28267 raft_consensus.cc:359] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.591887 28267 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:21.592571 28267 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.605672 28267 ts_tablet_manager.cc:1434] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:10:21.607879 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-06445e3c1bb74c8f862cf1af47256377 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:21.608414 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-06445e3c1bb74c8f862cf1af47256377 on tablet 06445e3c1bb74c8f862cf1af47256377 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:21.637996 28272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a8d686c4b4ec199d64c6d3882b858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.645259 28267 ts_tablet_manager.cc:933] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:21.659731 28267 tablet_copy_client.cc:323] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:21.661599 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 93b895e250184ee283d78483d5fcae92 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:21.662434 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 93b895e250184ee283d78483d5fcae92 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-93b895e250184ee283d78483d5fcae92
I20260709 13:10:21.674676 28272 tablet_copy_client.cc:806] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.675449 28272 tablet_copy_client.cc:670] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.693512 27316 tablet_copy_source_session.cc:215] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.724191 28267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b895e250184ee283d78483d5fcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.793655 28267 tablet_copy_client.cc:806] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.794420 28267 tablet_copy_client.cc:670] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.797037 28272 tablet_copy_client.cc:538] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:21.812394 28272 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:21.818565 28267 tablet_copy_client.cc:538] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:21.851445 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 167267us
I20260709 13:10:21.876235 27837 raft_consensus.cc:1217] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:21.891453 28267 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:21.963423 27837 raft_consensus.cc:1217] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:21.987241 28272 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:21.988463 28272 tablet_bootstrap.cc:492] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:21.989272 28272 ts_tablet_manager.cc:1403] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.009s
I20260709 13:10:21.992565 28272 raft_consensus.cc:359] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:21.993479 28272 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:22.020941 28267 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:22.022033 28267 tablet_bootstrap.cc:492] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:22.025194 28272 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:22.043299 28272 ts_tablet_manager.cc:1434] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.006s
I20260709 13:10:22.051862 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-6e9a8d686c4b4ec199d64c6d3882b858 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:22.052392 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-6e9a8d686c4b4ec199d64c6d3882b858 on tablet 6e9a8d686c4b4ec199d64c6d3882b858 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:22.057843 28267 ts_tablet_manager.cc:1403] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.005s
I20260709 13:10:22.064209 28267 raft_consensus.cc:359] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:22.065155 28267 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:22.065824 28267 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:22.068506 28267 ts_tablet_manager.cc:1434] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:22.070729 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-93b895e250184ee283d78483d5fcae92 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:22.071229 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-93b895e250184ee283d78483d5fcae92 on tablet 93b895e250184ee283d78483d5fcae92 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:22.147223 27832 raft_consensus.cc:1217] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:22.311120 28277 raft_consensus.cc:1064] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:22.318673 28277 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:22.333256 27832 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.335659 27229 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.338455 27304 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.341854 28207 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.344026 28207 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:22.345120 28234 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.403930 28276 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.432351 27301 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.443425 27838 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.465323 27052 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.503818 27229 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.535632 27832 raft_consensus.cc:1217] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:22.571864 28080 raft_consensus.cc:1064] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:22.574681 28080 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:22.600241 27832 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.602150 27149 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:22.604990 28226 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.616688 27838 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:22.620048 28276 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:22.622160 27229 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:22.624663 28277 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:22.637387 28226 raft_consensus.cc:1064] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:22.636806 27838 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.665856 28285 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.668088 27226 raft_consensus.cc:2955] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.669821 27149 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.671499 28294 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:22.674357 28226 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:22.679493 27224 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:22.690644 27052 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.699735 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd514c8b688c4f2e90b6ad46174723ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:22.703698 28294 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:22.719928 28291 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:22.746225 27832 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:22.743923 28294 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:22.796676 28298 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:23.222396 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.361593 28307 raft_consensus.cc:1064] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:23.372570 28307 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:23.442102 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:23.442916 27301 raft_consensus.cc:606] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:23.446945 27833 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:23.447409 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:23.448072 27301 raft_consensus.cc:606] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
W20260709 13:10:23.448519 27271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.009s	sys 0.005s
W20260709 13:10:23.448998 27271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.006s
W20260709 13:10:23.449297 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 696431us
W20260709 13:10:23.455084 28226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.020s	sys 0.029s
W20260709 13:10:23.455510 28226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.021s	sys 0.030s
I20260709 13:10:23.457481 27152 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:23.459357 28309 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:23.461364 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet dd514c8b688c4f2e90b6ad46174723ef with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:23.470666 28309 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:23.472558 28318 tablet_replica.cc:333] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:23.473862 28318 raft_consensus.cc:2243] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:23.476915 28318 raft_consensus.cc:2272] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:23.480119 28318 ts_tablet_manager.cc:1916] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:23.482573 27226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:23.483320 27226 raft_consensus.cc:606] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
W20260709 13:10:23.485591 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.001s
W20260709 13:10:23.486116 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.008s	sys 0.001s
I20260709 13:10:23.486981 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:23.487672 27301 raft_consensus.cc:606] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
W20260709 13:10:23.494925 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.017s	sys 0.029s
W20260709 13:10:23.495318 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.017s	sys 0.029s
I20260709 13:10:23.505511 27230 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:23.521001 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:23.521853 27302 raft_consensus.cc:606] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:23.552093 27052 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.562263 27300 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:23.567340 27150 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.576026 27151 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:23.579200 28300 raft_consensus.cc:993] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:23.579659 28226 raft_consensus.cc:993] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:23.606798 28080 raft_consensus.cc:1081] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:23.620832 27841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:23.621582 27841 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.621958 27841 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.628592 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:23.629347 27300 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:23.631096 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:23.633002 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:23.647814 27152 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.651472 28305 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.638638 27841 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:23.658717 28312 raft_consensus.cc:1081] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:23.662653 27839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:23.663280 27839 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.663612 27839 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.665772 28321 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:10:23.680120 28318 ts_tablet_manager.cc:1929] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:23.688378 27839 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:23.684221 28285 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:23.691591 28318 log.cc:1199] T dd514c8b688c4f2e90b6ad46174723ef P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/dd514c8b688c4f2e90b6ad46174723ef
I20260709 13:10:23.692613 28285 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:23.692008 27841 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.701246 27839 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.719524 28285 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.720182 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:23.721441 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:23.724387 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:23.724756 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:23.725378 27226 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.726325 28285 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.709879 27224 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.736029 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:23.736666 27229 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.752823 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet dd514c8b688c4f2e90b6ad46174723ef (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:23.757153 27300 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:23.764412 28226 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.768069 27834 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:23.769930 28322 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:23.771194 27053 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.777727 27223 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.783689 27841 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.788003 28285 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:23.788602 28285 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:23.794420 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:23.797708 28307 raft_consensus.cc:993] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:23.798422 28309 raft_consensus.cc:1081] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:23.798030 28312 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.801211 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:10:23.802059 27152 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.803629 27839 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:23.809193 27832 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.818287 27226 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:23.821170 27229 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:23.802685 27152 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:23.835964 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.817305 27053 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.856484 28207 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:23.857191 28207 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:23.871639 28207 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.831897 28242 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:23.871937 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:23.883580 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:23.885426 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:10:23.887029 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 63928.1us
I20260709 13:10:23.890674 27230 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:23.875303 28285 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.894510 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:10:23.904809 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080008abe0 after lost signal to thread 26041
W20260709 13:10:23.906448 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080018f960 after lost signal to thread 27089
I20260709 13:10:23.895841 28207 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:23.895620 28277 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:23.921759 27834 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:23.919852 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06445e3c1bb74c8f862cf1af47256377 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:23.936386 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6a20 after lost signal to thread 27181
W20260709 13:10:23.937711 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9920 after lost signal to thread 27256
W20260709 13:10:23.938969 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800251d00 after lost signal to thread 27330
I20260709 13:10:23.939697 27122 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:10:23.940256 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08001d83a0 after lost signal to thread 27865
I20260709 13:10:23.941439 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:23.942180 28277 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:23.942875 28276 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.944888 28277 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:23.934140 28278 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:23.952090 27833 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:23.913278 28207 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:23.954366 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 143442us
W20260709 13:10:23.962337 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 71304.1us
I20260709 13:10:23.974416 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:23.958575 28234 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:23.969587 28242 raft_consensus.cc:993] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:23.992493 27229 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:23.996388 28080 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:23.960908 28278 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:23.985172 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:10:24.044940 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64515us
I20260709 13:10:24.035872 28234 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:10:24.030597 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 179204us
I20260709 13:10:24.062013 28306 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:10:24.048055 28294 raft_consensus.cc:1081] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:24.060775 28277 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:24.071815 28277 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.065063 28327 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.043192 28322 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:24.074085 28327 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:10:24.093945 26043 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9e0 after lost signal to thread 27271
I20260709 13:10:24.097630 28207 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.049291 28330 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:10:24.100935 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.049360 28278 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.098376 28327 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.100106 27152 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.100885 28329 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.101229 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.059823 28234 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.110095 28303 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:24.110666 28303 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:24.116792 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 143546us
I20260709 13:10:24.105875 27807 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:24.108270 28329 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:24.119982 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:24.121833 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:24.118386 27123 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:24.113133 28278 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.113718 28234 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.118461 28331 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.132261 27151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:24.132875 27151 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.133257 27151 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.146847 28303 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:24.149612 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:24.125676 28285 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.127731 28331 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:24.127763 28329 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.163053 28329 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.166069 27152 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.153333 27223 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.176103 28330 raft_consensus.cc:993] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:24.176882 28330 raft_consensus.cc:1081] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:24.181543 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:24.182404 27229 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.182790 27229 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:24.178711 28331 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.186834 27151 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.192299 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:24.194568 27223 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.198285 27151 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.195840 27229 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.202965 28321 raft_consensus.cc:993] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:24.203652 28321 raft_consensus.cc:1081] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:24.204456 27229 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:24.157845 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 160211us
I20260709 13:10:24.216154 27229 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:10:24.217178 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.222326 27223 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:24.223992 27832 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.229465 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:24.234908 28305 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:24.240458 28277 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.244515 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:24.250013 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:24.254091 28338 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.262603 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:24.254927 27834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:24.260394 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:24.265918 27834 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.263312 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:24.264310 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.267841 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.267140 27834 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.259028 27053 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.273948 27303 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.274420 27304 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.284269 27122 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:24.285012 27306 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:24.276633 27304 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:24.277689 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:24.267333 27223 raft_consensus.cc:2955] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.262023 28277 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.291107 27151 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.292054 28285 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.292390 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:24.294611 27122 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:24.262239 28338 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:24.304234 27304 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.307040 27152 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.304616 28277 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:24.307106 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:24.314622 28285 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.318851 27152 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.325978 27304 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.324906 28277 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.331938 28234 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.336326 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:24.337924 28342 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:24.352743 27303 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:24.380525 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 06445e3c1bb74c8f862cf1af47256377 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:24.399827 27154 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:24.401667 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 85926.6us
I20260709 13:10:24.373765 28338 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.405390 27304 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:10:24.430040 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52427.1us
W20260709 13:10:24.471649 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 168234us
W20260709 13:10:24.528465 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.536093 28306 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.548444 27223 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.548806 27832 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.555384 27302 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:24.561527 28331 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.574652 27154 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.533496 27834 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.521974 28326 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.597347 28349 tablet_replica.cc:333] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:24.603480 28349 raft_consensus.cc:2243] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.603986 27299 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.604434 28349 raft_consensus.cc:2272] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.609647 27834 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.610508 28331 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:24.616837 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.617537 27302 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.617871 27302 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:24.622793 27232 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.616547 27152 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.636920 27150 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:24.631038 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:24.627409 27302 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:24.648026 27302 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.650426 28349 ts_tablet_manager.cc:1916] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.657109 27223 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.636343 28331 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:24.658178 28329 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:24.655686 27051 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.659989 28334 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.661028 28334 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:24.661810 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:24.661899 28334 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.665115 28334 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.694139 27152 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:24.697238 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:24.703452 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:24.704229 27232 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.674405 27298 raft_consensus.cc:2955] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.710541 27054 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.716614 27306 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:24.724587 27232 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:24.728144 27306 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.731374 28303 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.740535 27302 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:24.726228 28327 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:10:24.743268 27123 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:24.753340 27053 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.755043 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:24.757308 28331 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.758296 27053 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:24.773488 27229 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.752313 28303 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.792373 28303 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:24.781313 28277 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:10:24.865814 28303 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:24.872319 27302 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.901490 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6e9a8d686c4b4ec199d64c6d3882b858 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:24.880445 28285 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:10:24.912856 27223 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
W20260709 13:10:24.919691 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49569.5us
I20260709 13:10:24.919188 28331 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:10:25.070652 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.072899 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88919.1us
I20260709 13:10:25.118142 27232 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.129782 28349 ts_tablet_manager.cc:1929] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.130379 28349 log.cc:1199] T 06445e3c1bb74c8f862cf1af47256377 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/06445e3c1bb74c8f862cf1af47256377
I20260709 13:10:25.148689 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9a8d686c4b4ec199d64c6d3882b858 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:25.150374 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 06445e3c1bb74c8f862cf1af47256377 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:25.149689 27051 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.164479 27299 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:25.087334 28331 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:25.172852 28368 tablet_replica.cc:333] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
W20260709 13:10:25.191002 28359 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:10:25.182116 28303 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:10:25.202765 28368 raft_consensus.cc:2243] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.206142 28368 raft_consensus.cc:2272] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.215510 28368 ts_tablet_manager.cc:1916] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.216676 27053 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.284300 28368 ts_tablet_manager.cc:1929] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.284932 28368 log.cc:1199] T 6e9a8d686c4b4ec199d64c6d3882b858 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/6e9a8d686c4b4ec199d64c6d3882b858
I20260709 13:10:25.287081 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 6e9a8d686c4b4ec199d64c6d3882b858 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:25.334937 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.355409 27299 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.356977 28338 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.376713 27299 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:25.394054 27224 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.398447 27054 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.401530 27832 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.402604 28303 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:25.404583 28322 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:10:25.448813 27154 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.461184 28080 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:25.506929 28373 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:10:25.498761 28372 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:25.535213 28294 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:25.537078 27152 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:25.554917 27832 raft_consensus.cc:2955] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:25.575554 27055 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:25.588713 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 93b895e250184ee283d78483d5fcae92 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:25.599925 28376 tablet_replica.cc:333] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:25.600641 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93b895e250184ee283d78483d5fcae92 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.615625 28376 raft_consensus.cc:2243] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.618228 28376 raft_consensus.cc:2272] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.621393 28376 ts_tablet_manager.cc:1916] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.635972 27299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:25.636772 27299 raft_consensus.cc:606] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:25.641224 27299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:25.641909 27299 raft_consensus.cc:606] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:25.645376 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:25.645984 27306 raft_consensus.cc:606] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:25.649164 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:25.649745 27306 raft_consensus.cc:606] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:25.652786 27229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:25.653355 27229 raft_consensus.cc:606] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:25.663924 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:25.664752 27306 raft_consensus.cc:606] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:25.666357 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:25.668326 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.673300 28376 ts_tablet_manager.cc:1929] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.673933 28376 log.cc:1199] T 93b895e250184ee283d78483d5fcae92 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/93b895e250184ee283d78483d5fcae92
I20260709 13:10:25.676457 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 93b895e250184ee283d78483d5fcae92 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:25.698945 27224 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.701565 28331 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.745648 28345 raft_consensus.cc:993] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.746383 28345 raft_consensus.cc:1081] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.748307 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:10:25.748854 27152 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.749020 27299 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.749230 27152 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.751930 28327 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.756779 27152 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:25.764227 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:25.764861 27299 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.765924 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:25.766559 27224 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:25.766845 27224 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:25.767633 27224 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:25.768739 27224 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.783826 27224 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:25.799821 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:25.801033 28338 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:25.801718 28338 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:25.802654 28338 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:25.811380 27152 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:25.817464 27299 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:25.830379 27054 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.856559 28336 raft_consensus.cc:993] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:25.857117 28336 raft_consensus.cc:1081] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:25.864380 28321 raft_consensus.cc:993] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:25.864880 28321 raft_consensus.cc:1081] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:25.866860 27224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:10:25.867414 27224 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.867766 27224 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.870469 27839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:25.871049 27839 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.871424 27839 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.909598 28336 raft_consensus.cc:993] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.910512 28329 raft_consensus.cc:1081] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.911021 28336 raft_consensus.cc:993] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.911705 28334 raft_consensus.cc:1081] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:25.913774 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:25.914441 27152 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.914878 27152 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.916013 27149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:25.916918 27149 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.917608 27149 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.905946 27224 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:25.931684 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:25.932272 27154 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.928501 27839 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:25.936272 27224 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:25.943984 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:25.944588 27150 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.948381 27154 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:25.949808 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:25.950523 27299 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:25.950827 27299 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:25.951747 27299 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:25.953033 27299 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.954370 27150 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:25.956140 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:25.956925 28327 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:25.957378 28327 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:25.958523 27839 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:25.960027 28327 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:25.967371 27299 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:25.978798 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:25.980221 28309 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:25.980929 28309 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:25.981846 28309 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.000615 27050 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.004544 27054 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.009248 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:26.009850 27299 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.010145 27299 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:26.010785 27299 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:26.005007 27149 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.022955 27152 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.026201 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:26.026793 27224 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.026935 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:26.026353 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:26.027642 27226 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.028385 27304 raft_consensus.cc:3055] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.029284 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:26.029176 27304 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:26.029873 27306 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.028663 27152 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:26.031070 27306 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:26.032157 27306 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.031091 27304 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.028383 27149 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:26.035439 27304 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.027595 27299 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.037748 27306 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.038022 27224 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.043200 27226 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.053740 27306 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.060482 27304 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.063791 27299 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:26.065804 27122 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:26.066841 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:26.067242 28338 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.068200 28285 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.069972 28338 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:26.070376 28285 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:26.071069 28338 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.071354 28285 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.116369 27050 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.118712 27050 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.171936 28294 raft_consensus.cc:993] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:26.172468 28321 raft_consensus.cc:1081] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:26.173938 27149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:26.174525 27149 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.174855 27149 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.181207 27149 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.185451 27149 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:26.185765 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:26.186457 27299 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.186774 27299 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:26.187529 27299 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.188498 27299 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.191205 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:26.191761 27224 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.199272 27299 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.200938 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:26.205675 28285 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.206252 28285 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:26.207109 28285 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:26.256004 27050 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.261466 27224 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:26.393972 27304 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.396476 28338 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.415678 27152 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.417544 28309 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.438776 27224 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.458343 28338 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:26.477187 27306 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.488252 28276 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.492439 27306 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:26.494227 28389 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:26.497565 27232 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.504916 28338 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.518502 27298 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.529749 27152 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:26.543777 28326 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.568701 27226 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:26.573453 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56385.6us
I20260709 13:10:26.578183 28327 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:26.588991 28276 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:10:26.656677 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46372us
I20260709 13:10:26.669613 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:26.739243 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 132684us
W20260709 13:10:26.742861 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 133801us
W20260709 13:10:26.758776 28401 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:10:26.785681 27224 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:26.875386 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 71566.1us
W20260709 13:10:26.949602 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 141458us
W20260709 13:10:26.947151 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 62560.5us
I20260709 13:10:26.978642 27299 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:26.946920 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 148033us
I20260709 13:10:26.987316 28425 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:10:27.008919 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56217.7us
I20260709 13:10:27.045600 28422 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:10:27.063380 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.093044 27298 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:27.108481 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75244.3us
I20260709 13:10:27.150071 28285 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:27.163429 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52440.2us
I20260709 13:10:27.202664 27232 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:27.313668 27154 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:27.316192 27197 consensus_peers.cc:597] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcf276ae949142ce87f50371f8505b9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.318039 28326 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.363880 27300 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:27.368247 28421 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.370018 27154 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.372929 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:27.373980 27300 raft_consensus.cc:606] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:27.396253 27055 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.405577 27232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e37f81c47354aae99c01542f682acef"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:27.406386 27232 raft_consensus.cc:606] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:27.410817 27232 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:27.423058 27197 consensus_peers.cc:597] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bd98a20f7c24448860d680b91e30ab5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.425201 27152 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.428081 28326 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.439666 28420 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.442157 28396 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.443534 27154 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.459226 27149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432318984ae54d3b86d6f16faa526523"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:27.460000 27149 raft_consensus.cc:606] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:27.466398 27154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:27.467310 27154 raft_consensus.cc:606] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:27.474896 27299 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.484869 27149 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:27.491122 27154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:27.491796 27154 raft_consensus.cc:606] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:27.489787 27050 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.494928 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:27.495543 27150 raft_consensus.cc:606] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:27.496942 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:27.496925 28326 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.499264 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:27.501144 27300 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.512849 28338 raft_consensus.cc:993] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.513411 28338 raft_consensus.cc:1081] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.515583 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:27.517747 27833 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.518188 27833 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.520905 27299 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.536152 27833 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.540740 27833 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:27.542595 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:27.543573 27224 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.555161 27224 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.556815 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:27.558012 28389 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.558535 28389 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:27.559511 28389 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:27.579439 27122 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd31e5d20c484a9facfe437706e9bd6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.583528 27298 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.589011 28423 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.669071 28399 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.672291 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:27.672933 27149 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.673210 27149 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:27.673982 27149 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.676373 27149 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.679750 27300 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:27.698724 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 59722us
I20260709 13:10:27.708547 27149 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.710837 27224 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.725507 28423 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.728176 28423 raft_consensus.cc:993] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.729146 28413 raft_consensus.cc:1081] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.731434 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:27.732064 27833 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.732429 27833 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.734584 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.741518 27833 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.747788 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:27.748430 27226 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.753010 27050 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.751565 27833 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:27.770714 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:27.771368 27149 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.771665 27149 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:27.772400 27149 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.773824 27226 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.773751 27149 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.775149 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:27.780961 28389 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.784487 27300 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:27.785175 28389 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:27.786613 27232 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:27.796600 28285 raft_consensus.cc:993] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:27.797142 28285 raft_consensus.cc:1081] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:27.794023 28389 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.806273 27226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:27.806870 27226 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.812134 27226 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:27.822467 27271 consensus_peers.cc:597] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6a8841c8bb041a1a423a427ed084489. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.826071 28420 raft_consensus.cc:993] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:27.826642 28420 raft_consensus.cc:1081] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:27.828402 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e37f81c47354aae99c01542f682acef"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:10:27.829022 27150 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.829406 27150 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.829500 27154 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:27.833822 28402 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.837098 27150 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.837574 27226 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.840360 27232 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:27.849062 27226 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:27.849912 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:27.850733 27300 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.851624 27150 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:27.854482 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:27.855118 27152 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.855389 27152 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:27.856406 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:27.856199 27152 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.856958 27298 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.857391 27152 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.868098 27050 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.882632 28451 ts_tablet_manager.cc:933] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:27.886576 28285 raft_consensus.cc:993] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.887339 28285 raft_consensus.cc:1081] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.889458 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "432318984ae54d3b86d6f16faa526523"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:27.890241 27833 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.890657 27833 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.899376 27833 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.903292 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:27.905367 27226 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.905674 27226 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:27.907823 27226 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.914503 27226 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.923053 28429 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:27.928686 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:27.929384 27150 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:27.929451 27298 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:27.929710 27150 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:27.931169 28451 tablet_copy_client.cc:323] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:27.930635 27150 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.932277 27150 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.932327 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:27.932794 27226 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:27.933018 27232 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.931429 27833 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:27.938846 27123 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:27.939814 28285 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.940342 28285 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:27.826658 27149 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.941277 28285 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.943688 27150 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.947826 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet fcf276ae949142ce87f50371f8505b9d from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:27.948438 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:27.948614 27226 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:27.948591 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet fcf276ae949142ce87f50371f8505b9d from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-fcf276ae949142ce87f50371f8505b9d
I20260709 13:10:27.953353 28389 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:27.957717 28389 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.958287 28389 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:27.959290 28389 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:27.970675 27152 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:27.973361 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:27.974542 28396 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.976711 27232 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.978622 28396 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:27.982259 28396 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:27.988350 28429 raft_consensus.cc:993] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.988987 28429 raft_consensus.cc:1081] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:27.990769 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:27.991387 27833 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.991803 27833 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.996793 28242 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:28.021759 27833 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:28.022910 27050 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.025099 28457 ts_tablet_manager.cc:933] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:28.043359 27833 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:28.078192 27153 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:28.080928 28389 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:28.081723 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:28.082803 27151 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.100183 28464 ts_tablet_manager.cc:933] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:28.114356 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:28.115171 27298 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:28.115585 27298 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:28.116456 27298 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:28.117758 27298 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.114272 28457 tablet_copy_client.cc:323] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:28.114519 28464 tablet_copy_client.cc:323] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:28.127161 27232 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:28.129575 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet bd31e5d20c484a9facfe437706e9bd6b from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:28.130136 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet bd31e5d20c484a9facfe437706e9bd6b from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-bd31e5d20c484a9facfe437706e9bd6b
I20260709 13:10:28.066953 27149 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:28.139758 27298 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:28.139147 27167 tablet_copy_source_session.cc:215] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:28.156433 27151 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:27.982290 27300 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:28.160230 27055 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.181824 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:28.182484 27156 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:28.184628 28389 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:28.185431 28389 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:28.186568 28389 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:28.195013 27050 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:28.207248 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47968.5us
I20260709 13:10:28.175948 27242 tablet_copy_source_session.cc:215] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:28.212118 28464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd31e5d20c484a9facfe437706e9bd6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:28.236375 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 91340.7us
W20260709 13:10:28.237696 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 79640.4us
I20260709 13:10:28.248389 27055 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.285673 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 2bd98a20f7c24448860d680b91e30ab5 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:28.286419 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 2bd98a20f7c24448860d680b91e30ab5 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-2bd98a20f7c24448860d680b91e30ab5
I20260709 13:10:28.326403 27298 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:28.353523 28419 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:28.365950 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 122671us
W20260709 13:10:28.390249 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 145865us
I20260709 13:10:28.480417 28451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf276ae949142ce87f50371f8505b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.489950 28474 ts_tablet_manager.cc:933] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:28.501096 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:28.501497 27224 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:28.514087 27152 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:28.514248 27242 tablet_copy_source_session.cc:215] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:28.531395 27152 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:28.538228 28396 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:28.575371 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 72726.3us
I20260709 13:10:28.578145 27229 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:28.584264 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 86728.5us
W20260709 13:10:28.591183 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 45831.7us
I20260709 13:10:28.599048 28474 tablet_copy_client.cc:323] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:28.614420 28464 tablet_copy_client.cc:806] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:28.615319 28464 tablet_copy_client.cc:670] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:28.617456 28457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd98a20f7c24448860d680b91e30ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.636240 28484 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:28.642908 28490 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:28.653977 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 50799.5us
W20260709 13:10:28.670435 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73904.9us
I20260709 13:10:28.689046 27303 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:28.688216 27055 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.699587 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet d6a8841c8bb041a1a423a427ed084489 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:28.700235 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet d6a8841c8bb041a1a423a427ed084489 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-d6a8841c8bb041a1a423a427ed084489
W20260709 13:10:28.730269 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 194120us
I20260709 13:10:28.748435 27150 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:28.793354 28327 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:10:28.798362 28387 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:10:28.846271 28464 tablet_copy_client.cc:538] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:28.848321 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 185622us
I20260709 13:10:28.863637 27152 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:28.858384 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 105042us
W20260709 13:10:28.878532 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 111267us
I20260709 13:10:28.885912 27316 tablet_copy_source_session.cc:215] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:28.855546 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73436.5us
W20260709 13:10:28.934695 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53051.1us
I20260709 13:10:28.922845 28457 tablet_copy_client.cc:806] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:28.947603 28497 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:28.978701 28471 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:10:28.976402 28457 tablet_copy_client.cc:670] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:10:29.004732 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 214187us
I20260709 13:10:29.007802 27224 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:29.007804 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 76308.2us
I20260709 13:10:29.093314 28474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a8841c8bb041a1a423a427ed084489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.081025 28502 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:10:29.171339 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61545.2us
I20260709 13:10:29.196616 28451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35860 (request call id 130) took 1325 ms. Trace:
I20260709 13:10:29.197239 28451 rpcz_store.cc:276] 0709 13:10:27.871623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.874190 (+  2567us) service_pool.cc:224] Handling call
0709 13:10:27.883167 (+  8977us) ts_tablet_manager.cc:934] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
0709 13:10:28.386431 (+503264us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:28.823873 (+437442us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:28.824045 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:29.187237 (+363192us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:29.196091 (+  8854us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:29.196440 (+   349us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:29.196508 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":264,"tablet-copy.queue_time_us":7653,"thread_start_us":54098,"threads_started":2}
I20260709 13:10:29.177386 28464 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:29.230401 28457 tablet_copy_client.cc:538] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:29.236858 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 168078us
I20260709 13:10:29.233407 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:29.289253 28457 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:29.263824 28451 tablet_copy_client.cc:806] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:29.333346 28451 tablet_copy_client.cc:670] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:10:29.366755 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 392807us
I20260709 13:10:29.411229 28451 tablet_copy_client.cc:538] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:29.432747 27301 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.448557 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:29.449275 27301 raft_consensus.cc:606] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:29.451467 28474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 444) took 1201 ms. Trace:
I20260709 13:10:29.483981 28327 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:29.481833 27223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a6d314618684d688b91fe535777e47b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:29.460378 28474 rpcz_store.cc:276] 0709 13:10:28.249644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.249775 (+   131us) service_pool.cc:224] Handling call
0709 13:10:28.502212 (+252437us) ts_tablet_manager.cc:934] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:29.082004 (+579792us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:29.386355 (+304351us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:29.386500 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:29.450634 (+ 64134us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:29.450991 (+   357us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:29.451346 (+   355us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:29.451406 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":18133,"spinlock_wait_cycles":1929600,"tablet-copy.queue_time_us":161417,"thread_start_us":43259,"threads_started":2}
I20260709 13:10:29.563597 28474 tablet_copy_client.cc:806] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:29.564363 28474 tablet_copy_client.cc:670] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:29.525844 27223 raft_consensus.cc:606] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:29.578275 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b895e250184ee283d78483d5fcae92"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:29.579005 27300 raft_consensus.cc:606] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:29.581481 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:29.583563 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:29.585929 28474 tablet_copy_client.cc:538] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:29.597267 28451 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:29.736526 28474 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:29.752781 28402 raft_consensus.cc:993] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:29.753392 28402 raft_consensus.cc:1081] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:29.755722 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b895e250184ee283d78483d5fcae92"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:29.756296 27152 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.756654 27152 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.773708 27152 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:29.789726 27152 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:29.792222 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:29.792932 27302 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.793251 27302 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:29.794173 27302 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:29.795388 27302 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.806195 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:29.808267 27832 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.821574 28469 raft_consensus.cc:993] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:29.822259 28472 raft_consensus.cc:1081] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:29.824715 28464 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:29.825876 28464 tablet_bootstrap.cc:492] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:29.826716 28464 ts_tablet_manager.cc:1403] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.718s	user 0.030s	sys 0.014s
I20260709 13:10:29.831957 27832 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:29.834337 27300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a6d314618684d688b91fe535777e47b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:29.834966 27300 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.835407 27300 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.835523 28457 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:29.836611 28457 tablet_bootstrap.cc:492] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:29.834857 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:29.837447 28457 ts_tablet_manager.cc:1403] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.554s	user 0.026s	sys 0.011s
I20260709 13:10:29.839546 28482 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.842619 28242 raft_consensus.cc:993] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:29.843101 28428 raft_consensus.cc:1081] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:29.843888 28457 raft_consensus.cc:359] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:29.845762 28457 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:29.846235 27154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:29.845345 28482 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:29.846771 28457 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:29.858881 27154 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.858037 28464 raft_consensus.cc:359] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:29.859359 27154 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.858281 28482 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:29.864172 28457 ts_tablet_manager.cc:1434] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:10:29.869647 28464 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:29.875862 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-2bd98a20f7c24448860d680b91e30ab5 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:29.877964 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-2bd98a20f7c24448860d680b91e30ab5 on tablet 2bd98a20f7c24448860d680b91e30ab5 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:29.878225 28464 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:29.899364 27300 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:29.902258 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:29.902865 27150 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.910658 27150 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:29.929471 27154 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:29.930433 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:29.938572 28511 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.938704 28464 ts_tablet_manager.cc:1434] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.004s
I20260709 13:10:29.913699 27302 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:29.947651 27154 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:29.949492 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-bd31e5d20c484a9facfe437706e9bd6b received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:29.949995 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-bd31e5d20c484a9facfe437706e9bd6b on tablet bd31e5d20c484a9facfe437706e9bd6b with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:29.943125 28511 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:29.953083 27300 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:29.964104 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:29.966719 27231 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.976203 28511 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:29.977833 28451 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:29.978961 28451 tablet_bootstrap.cc:492] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:29.979799 28451 ts_tablet_manager.cc:1403] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.383s	user 0.023s	sys 0.024s
I20260709 13:10:29.980196 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:29.982784 27223 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.983112 27223 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:29.984002 27223 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:29.985363 27223 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.989835 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:29.990510 27302 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.990850 27302 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:29.991847 27302 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:29.993302 27302 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.027068 27231 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:30.028359 27223 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:30.030861 27054 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:30.032567 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55223.4us
I20260709 13:10:30.045257 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:30.051074 28486 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.051625 28486 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:30.061400 28451 raft_consensus.cc:359] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:30.062355 28451 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:30.063014 28451 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:30.065213 28451 ts_tablet_manager.cc:1434] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:10:30.060056 28486 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:30.077813 27833 raft_consensus.cc:1217] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:30.099784 27055 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.119416 28474 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:30.120361 28474 tablet_bootstrap.cc:492] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:30.121181 28474 ts_tablet_manager.cc:1403] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.385s	user 0.020s	sys 0.008s
I20260709 13:10:30.131430 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-fcf276ae949142ce87f50371f8505b9d received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:30.142447 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-fcf276ae949142ce87f50371f8505b9d on tablet fcf276ae949142ce87f50371f8505b9d with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:30.145736 27833 raft_consensus.cc:1217] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:30.164506 28474 raft_consensus.cc:359] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:30.165529 28474 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:30.166250 28474 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:30.169472 28474 ts_tablet_manager.cc:1434] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.005s
I20260709 13:10:30.171383 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-d6a8841c8bb041a1a423a427ed084489 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:30.171833 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-d6a8841c8bb041a1a423a427ed084489 on tablet d6a8841c8bb041a1a423a427ed084489 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:30.153978 27302 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:30.208580 27054 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.262481 27833 raft_consensus.cc:1217] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:30.294811 27833 raft_consensus.cc:1217] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:30.392685 27150 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.394615 28511 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.403822 27302 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:30.413728 27833 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:30.418196 28484 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:30.419896 28484 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:30.493403 27223 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.495019 28419 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.524937 27229 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.527904 28511 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.574028 27304 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.578279 28486 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:30.585454 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:30.630282 28468 raft_consensus.cc:1064] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:30.633211 28468 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:30.640853 28498 raft_consensus.cc:1064] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:30.648061 28486 raft_consensus.cc:1064] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:10:30.705242 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 53031.3us
W20260709 13:10:30.704239 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52352.1us
I20260709 13:10:30.648783 28498 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:30.737600 28486 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:30.835855 28547 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:10:30.859470 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 141941us
W20260709 13:10:30.960826 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 69346.2us
W20260709 13:10:31.100744 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 190865us
W20260709 13:10:31.236227 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 77917.8us
W20260709 13:10:31.262084 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 242005us
W20260709 13:10:31.342188 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75967.1us
W20260709 13:10:31.366990 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 271211us
I20260709 13:10:31.035027 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:31.435904 28553 raft_consensus.cc:1064] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:31.527252 28553 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:31.557395 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 275640us
I20260709 13:10:31.575304 27833 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:10:31.588461 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99414.3us
W20260709 13:10:31.672717 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 70052.9us
I20260709 13:10:31.677028 28468 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:31.677745 28468 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:31.680660 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 72733.4us
I20260709 13:10:31.680205 28468 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:31.596531 28581 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:10:31.696470 28581 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:31.750349 28603 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:31.842610 28581 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:31.752038 28543 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:31.845583 27839 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:31.845702 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:31.845964 28543 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:31.846959 28567 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:31.847543 28567 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:31.848510 28608 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:31.848925 28543 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:31.849633 28567 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:10:31.852402 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 104403us
I20260709 13:10:31.751106 28603 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:31.852757 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:10:31.854424 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 95499.5us
I20260709 13:10:31.861346 28468 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:10:31.880621 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 156788us
I20260709 13:10:31.878676 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:31.890038 28584 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:31.890413 28599 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:31.872864 28552 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:31.892230 28610 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:31.896528 28585 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.014408 28599 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.014737 28585 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.016976 28585 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:31.897290 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.017462 28552 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:31.899212 28593 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.018750 28593 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.019752 28552 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:31.938992 28601 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.021164 28593 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.022280 28584 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:31.861605 28577 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:31.706476 28582 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.169s
W20260709 13:10:31.917272 27270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.036s	sys 0.110s
I20260709 13:10:31.867534 28586 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:31.918797 28598 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:10:31.974776 28562 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.017050 28599 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.021119 28601 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.014524 27306 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:32.014433 28610 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:31.899583 28590 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:10:32.026176 27270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.037s	sys 0.110s
I20260709 13:10:31.870566 28468 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.098212 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:10:32.104375 28498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.010s	sys 0.073s
I20260709 13:10:32.113030 28583 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:10:32.142205 28498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.011s	sys 0.073s
I20260709 13:10:32.150614 28559 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:10:32.151239 28559 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.155069 28552 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.155884 28552 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:10:32.161269 28589 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.162166 28589 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.167151 28498 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.172909 28498 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.176011 28498 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.186107 28610 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.187013 28609 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.193295 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:32.194103 27306 raft_consensus.cc:606] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:32.114779 28590 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.210235 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.213788 28596 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.214629 28596 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.187705 28609 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.111793 28586 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.116323 28598 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.105490 28577 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:32.139235 28562 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.217617 28559 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.355093 28609 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.423698 28420 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.424355 28420 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:32.425890 28553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.050s	sys 0.166s
W20260709 13:10:32.426316 28553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.050s	sys 0.166s
I20260709 13:10:32.426905 28420 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.427578 28420 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.428131 28420 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.430866 28605 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.431394 28605 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.431667 28420 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.433346 28605 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.358188 28596 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.361209 28562 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.256984 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.435681 27152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:32.436326 27152 raft_consensus.cc:606] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.227644 28602 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.437678 28602 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.439764 28602 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.363731 28598 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.327260 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.365358 27226 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:32.367323 28577 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.195919 28583 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:10:32.442253 28583 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.292197 28584 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.371022 28586 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.281965 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.306505 28468 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.322969 28603 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.376451 28610 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.377305 27150 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:32.381330 27302 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:32.384001 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.384155 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.444095 28610 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.444501 27299 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:10:32.445514 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.446681 28610 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.337405 28601 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:10:32.415171 27121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.172s	sys 0.212s
I20260709 13:10:32.313738 28419 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:10:32.447422 27121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.172s	sys 0.213s
W20260709 13:10:32.422207 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.044s	sys 0.076s
W20260709 13:10:32.422523 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 71293us
I20260709 13:10:32.447654 28419 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.466728 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.468276 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.464213 28420 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:10:32.464322 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.045s	sys 0.076s
W20260709 13:10:32.470551 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 595874us
I20260709 13:10:32.474995 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.494869 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.497720 28497 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.498333 28497 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.500264 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.501744 28497 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.502337 28497 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:32.502799 28497 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.504767 28497 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.513079 28552 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.514628 28589 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.515868 28590 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.527123 28419 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:10:32.533361 27271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.009s
W20260709 13:10:32.533771 27271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.009s
W20260709 13:10:32.534423 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 671335us
I20260709 13:10:32.537381 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.539013 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.551879 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.554672 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.553061 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.563681 27148 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:32.577865 28592 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.581951 28592 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.590590 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.591868 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.592327 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.593262 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.593353 27148 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:10:32.595516 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.596225 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.598405 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.598701 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.600711 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.602869 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.605724 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.609917 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.611940 28592 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.585078 28585 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:10:32.586024 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 114855us
I20260709 13:10:32.612900 28585 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.615162 28585 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.618228 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.619431 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.620096 27223 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:32.621353 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.621753 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.626175 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.630517 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.639918 27195 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:32.641947 28590 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.642419 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:10:32.578959 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 127728us
I20260709 13:10:32.650666 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.650774 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.655073 28606 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:32.655627 28606 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.657440 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:32.657938 28606 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:32.660061 28576 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:32.660159 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.660553 28576 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:32.660841 27226 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:32.661006 28576 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.665273 28596 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:32.670199 28589 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.670872 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.670773 28589 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.674135 28589 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.665836 28596 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.677196 28596 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:10:32.580996 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 129260us
I20260709 13:10:32.680482 28621 raft_consensus.cc:993] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:32.680971 28621 raft_consensus.cc:1081] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:32.685343 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.686762 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.686496 28576 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:32.687793 28620 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.688550 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.689853 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.692900 27225 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:32.705274 28568 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.702083 28590 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.713399 28590 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.701658 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.713995 28598 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:32.716228 28590 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.716574 28619 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.717455 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.718945 27272 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.719444 28568 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.722447 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.724640 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.711943 28618 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:10:32.727586 28613 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.728482 27195 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:10:32.712738 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55377.8us
I20260709 13:10:32.732406 28620 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.733521 28486 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:32.734508 28568 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.737571 27272 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:32.711596 28576 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.738503 28618 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.739030 28618 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:32.740200 28620 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:32.742486 28618 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:32.742676 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.743348 28565 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:32.743790 28565 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:32.744208 28565 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.744328 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 136398us
I20260709 13:10:32.745895 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.747354 28497 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.748607 27839 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:32.750172 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.750379 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:32.752350 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.754112 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.755218 27226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:32.755795 27226 raft_consensus.cc:606] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:32.755847 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.756943 28596 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:32.758690 28596 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.759078 28596 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.772945 27832 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:32.777546 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.778832 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:32.778383 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.779410 27300 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.779035 27154 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:32.791239 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.792362 27300 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:32.794503 27150 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:10:32.729010 27269 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:10:32.797171 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 68220.6us
I20260709 13:10:32.798547 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.795998 27055 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:32.822453 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 84938.8us
I20260709 13:10:32.823464 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.826716 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.828218 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.794917 28565 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.846774 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:32.847807 28619 raft_consensus.cc:2764] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:32.848774 28562 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:32.850903 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53079us
I20260709 13:10:32.862802 27225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:32.863687 27225 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.864207 27225 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.864372 28602 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.866434 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:32.869784 28613 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:32.842914 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.876330 28618 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.878072 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.879174 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:32.879729 28565 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:32.884794 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:32.886128 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:10:32.950632 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 65925.9us
I20260709 13:10:32.893378 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.934634 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.936090 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.939210 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.940398 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:32.942600 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.942574 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.943699 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.944876 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.957828 28576 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:32.958449 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.958632 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.945086 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.959372 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.945621 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:10:32.949455 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 71493.7us
W20260709 13:10:32.962211 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 76191.5us
I20260709 13:10:32.965046 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.965487 28613 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:32.965937 28613 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:32.966354 28613 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.964354 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.973372 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:32.939098 27225 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:32.955595 28618 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.978118 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.982856 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.976265 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:32.967445 28576 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:32.988583 27804 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.989866 27303 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:10:32.990355 27123 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.991061 28497 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.000172 28497 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.975363 28511 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.005659 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:33.004295 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:33.007221 27150 raft_consensus.cc:606] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.009152 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.988361 28583 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.014158 27123 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.996963 28585 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.985767 28619 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:10:33.006640 28608 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.024588 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:32.984874 28598 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:33.014879 28620 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:33.054523 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66071.8us
I20260709 13:10:33.057454 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:33.034976 28566 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.040371 28614 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.078783 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.080156 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:33.080508 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.085068 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.088313 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.089737 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:33.042970 28596 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:33.091377 28565 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.064565 28576 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:33.092525 28596 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:33.094612 27300 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:10:33.095155 28559 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.096271 28598 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.097615 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:33.111351 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:33.113016 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.122287 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.116670 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:33.122679 28632 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:33.125207 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.100860 27225 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:33.128899 27148 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.129431 28632 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.145602 27226 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.147212 28632 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:33.112215 28565 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.117655 28618 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.111195 28553 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:10:33.151242 28553 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.153530 28553 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:33.127281 28589 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.140802 27148 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:33.154897 27148 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.156033 27148 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.168521 27148 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:33.173192 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:33.174793 28590 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.175410 28590 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:33.176435 28590 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.180986 28613 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.185237 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:33.186420 28589 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.187050 28589 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:33.188182 28589 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:33.198071 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 157225us
W20260709 13:10:33.202648 28631 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.004s
I20260709 13:10:33.203773 28588 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.204900 28588 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.205245 28588 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:10:33.208220 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 154873us
I20260709 13:10:33.215903 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:10:33.219975 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 94904.4us
I20260709 13:10:33.220774 27197 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.224292 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.227825 27123 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:33.229874 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:33.232079 27197 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.233052 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:33.244652 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:33.245312 27300 raft_consensus.cc:606] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:33.206044 28588 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.247778 28420 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.248210 28588 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.226826 28559 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.229991 28598 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.252949 28598 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:33.229266 28618 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.235894 28583 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.244865 28600 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:33.302893 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.253635 28598 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.317739 27269 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:33.243831 28621 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:10:33.327862 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:33.331430 28511 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.335646 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:33.335647 28596 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:33.347536 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 115531us
W20260709 13:10:33.346592 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69226.6us
I20260709 13:10:33.348937 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.354899 28613 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:33.356858 28590 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.358209 28585 raft_consensus.cc:993] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
W20260709 13:10:33.365151 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 131143us
I20260709 13:10:33.359043 28511 raft_consensus.cc:993] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:33.373632 27300 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.378983 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.380829 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:33.385414 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49490.8us
I20260709 13:10:33.385640 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:33.360224 28589 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.393833 28599 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.395850 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.396245 28599 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.396651 28599 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:33.397324 28642 raft_consensus.cc:993] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:33.397842 28642 raft_consensus.cc:1081] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:33.369645 28598 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:33.376988 28585 raft_consensus.cc:1081] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:33.412606 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:33.413158 28602 raft_consensus.cc:1081] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:33.397472 28599 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.383133 28565 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.419718 28599 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.429579 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.460258 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47725.9us
I20260709 13:10:33.400481 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.462484 28553 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:33.463122 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 62702.1us
I20260709 13:10:33.463322 28583 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.464118 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:33.464946 28420 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.466466 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:33.467538 28644 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.415686 28486 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:33.470398 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 53114.9us
I20260709 13:10:33.473870 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:33.487890 27305 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.477166 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:33.478950 27300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:33.488660 27300 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.489032 27300 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.480610 27154 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:33.497038 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:33.504549 27305 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:33.499595 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:33.503357 27148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:33.510028 27148 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.510479 27148 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.469146 27225 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.487591 28486 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:33.522480 27054 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.523646 28486 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:33.525354 28486 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.469141 28644 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:33.547541 28492 raft_consensus.cc:993] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:33.548100 28492 raft_consensus.cc:1081] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:33.537355 27834 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:33.532517 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:33.595840 27152 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.596326 27152 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.541005 27051 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.613874 27152 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.618917 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:10:33.622594 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 128089us
I20260709 13:10:33.625967 27832 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:33.629459 27300 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.640240 27304 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:33.550213 27298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34456
I20260709 13:10:33.614972 27231 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:33.650538 27300 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:33.651819 27148 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.654274 27298 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.654773 27298 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.625676 27230 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:33.664260 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:33.666893 27152 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:33.669452 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:33.669574 28583 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:33.670141 27300 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.670454 27300 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:33.674010 27833 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.674268 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.674476 27300 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.674994 27228 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.675343 27228 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:33.679829 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:10:33.745151 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71931.3us
I20260709 13:10:33.667788 27148 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:33.768929 27298 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.752539 27301 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:10:33.771440 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 123525us
I20260709 13:10:33.761373 27833 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:10:33.756327 27150 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:33.667444 28420 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.774242 27301 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:33.779588 27833 pending_rounds.cc:85] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 2
I20260709 13:10:33.783735 27300 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:33.788383 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108466us
I20260709 13:10:33.800463 27300 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:33.801652 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:33.779923 27833 pending_rounds.cc:107] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:10:33.805439 27833 raft_consensus.cc:2917] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:10:33.809620 27833 raft_consensus.cc:2889] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.812657 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:33.817616 27301 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.820619 27301 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.806522 28611 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.836000 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.836190 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.836606 27224 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.836790 27232 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.817276 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:33.843248 27226 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:10:33.843660 27226 pending_rounds.cc:85] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 2
I20260709 13:10:33.844009 27226 pending_rounds.cc:107] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:10:33.844236 27226 raft_consensus.cc:2917] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:10:33.844551 27226 raft_consensus.cc:2889] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.852949 27148 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.854024 27224 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:33.838424 28636 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.862833 27304 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:33.835587 28574 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:10:33.868062 28642 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:33.868949 28636 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:33.873670 28599 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:33.874485 28636 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.877601 27298 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:33.883028 27154 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.887024 27301 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:33.888345 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:33.890074 27232 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:33.896051 27228 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.897578 27228 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.898422 28574 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.898970 28574 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:33.899943 28574 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.916406 27304 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.881767 27148 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:33.884847 28559 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.939061 28621 consensus_queue.cc:1059] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.940238 28621 raft_consensus.cc:3055] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.940588 28621 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:10:33.942482 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.941423 28621 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:33.949327 28621 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.945686 27228 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
W20260709 13:10:33.966207 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.968724 27232 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.972548 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:33.973451 27232 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.989861 27232 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:34.017045 28599 raft_consensus.cc:1064] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:10:34.017589 28599 raft_consensus.cc:1068] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Unable to promote non-voter f4afe81810944d70bc2cc31754392f3d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:34.021911 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:34.031129 27269 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:10:34.053210 27272 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:34.059170 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:34.053021 28584 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.059285 28596 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.060297 28652 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.068548 28584 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:34.084709 28596 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:34.085951 28596 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:34.096794 28584 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:34.109300 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.094928 28652 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:34.116132 28652 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:10:34.154990 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 317637us
I20260709 13:10:34.226270 28568 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:34.259940 27055 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.280506 27150 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:34.287487 27232 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.306555 28621 raft_consensus.cc:1064] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:34.336372 27305 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.351121 28608 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:34.309506 28621 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:34.364424 28608 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:34.378903 27304 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:34.379242 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:34.371256 28608 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:34.414193 28642 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:34.383983 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:34.409528 28621 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:10:34.334731 28658 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.422042 27834 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:34.436287 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:34.441109 28673 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:34.467165 27054 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:34.498802 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49796.9us
I20260709 13:10:34.500281 28606 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:34.500859 28606 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:34.505234 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:34.505960 27148 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:34.507656 28606 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:34.508575 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:34.512284 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:34.513466 27305 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.516773 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:34.517747 28606 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.519156 27148 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.518692 27298 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:34.524224 28596 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.525532 27232 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.526974 28606 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.533541 28610 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:34.539254 27834 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:34.543213 28585 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.546190 28606 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:34.550751 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 138644us
I20260709 13:10:34.552532 27232 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.558091 27230 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.559465 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:34.561203 27230 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:34.565847 27223 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.571986 27834 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.578514 27230 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.578148 27055 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.580063 27055 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:34.580840 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46191.5us
I20260709 13:10:34.583817 27832 raft_consensus.cc:2955] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.585492 28574 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.591369 27223 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.593664 28553 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.620021 27123 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:34.621192 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6a8841c8bb041a1a423a427ed084489 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:34.624686 28486 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.625569 28486 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:34.637066 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55129.7us
I20260709 13:10:34.638051 27230 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.629849 27055 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.663056 27152 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.579373 27304 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.663573 28606 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.679545 28606 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.650388 28610 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:34.672900 27148 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.683964 28574 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.684262 27230 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.684052 28606 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.686103 28619 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.711238 28632 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:34.711967 28632 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:34.721161 28632 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:34.721751 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:34.722810 27298 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:34.726655 28658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46398 (request call id 71) took 1310 ms. Trace:
I20260709 13:10:34.727130 28658 rpcz_store.cc:276] 0709 13:10:33.419983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.421620 (+  1637us) service_pool.cc:224] Handling call
0709 13:10:33.516930 (+ 95310us) log.cc:844] Serialized 508 byte log entry
0709 13:10:34.726541 (+1209611us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1243,"raft.run_cpu_time_us":987,"raft.run_wall_time_us":987}
I20260709 13:10:34.728993 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2bd98a20f7c24448860d680b91e30ab5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:34.729627 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:34.730569 27150 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:34.741380 27304 raft_consensus.cc:2955] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.769667 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:34.770517 27300 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.781200 28619 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.781769 28619 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:34.783918 28619 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:34.784441 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet d6a8841c8bb041a1a423a427ed084489 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:34.787520 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:34.788237 27150 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:10:34.789240 27269 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:34.796512 27054 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:10:34.802887 28640 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.804178 27807 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:34.823191 28686 tablet_replica.cc:333] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:34.824522 28686 raft_consensus.cc:2243] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.803354 28640 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:34.830566 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44122us
I20260709 13:10:34.830853 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:34.840687 27227 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:34.803351 28566 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.829221 28632 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.846815 27832 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.846738 28600 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.858307 28686 raft_consensus.cc:2272] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.835841 28640 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.872291 28686 ts_tablet_manager.cc:1916] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:34.871696 27227 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.913635 27050 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.915827 27050 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.891621 28640 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:34.960050 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:34.960793 27223 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.963495 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:34.964151 27150 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.971130 27305 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.974550 27223 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:34.975505 27150 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:34.975955 27272 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:34.978752 28596 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.979280 28596 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:34.980172 28596 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:34.984414 28632 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.990477 27051 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 2 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:34.988204 27055 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.031502 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd98a20f7c24448860d680b91e30ab5 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:35.026171 28640 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:35.070941 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.070307 27055 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.017931 28686 ts_tablet_manager.cc:1929] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:35.093585 28686 log.cc:1199] T d6a8841c8bb041a1a423a427ed084489 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/d6a8841c8bb041a1a423a427ed084489
I20260709 13:10:35.095808 28686 tablet_replica.cc:333] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:35.096956 28686 raft_consensus.cc:2243] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.096959 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet d6a8841c8bb041a1a423a427ed084489 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:35.097906 28686 raft_consensus.cc:2272] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.110343 28686 ts_tablet_manager.cc:1916] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.185807 28565 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:35.187840 28565 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.209194 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:35.209957 27152 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.212358 28565 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:35.213065 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:35.213863 27305 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:35.214752 28640 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.215221 28640 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:35.217386 28640 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:35.218734 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:35.219636 27150 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:10:35.219182 27148 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.218765 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:35.221796 27230 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:10:35.222872 27272 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:35.223596 28553 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:35.225159 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:35.225790 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.227200 27197 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:35.228803 28641 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.229208 28641 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:35.229580 28641 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.237605 28686 ts_tablet_manager.cc:1929] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:35.238098 28686 log.cc:1199] T 2bd98a20f7c24448860d680b91e30ab5 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/2bd98a20f7c24448860d680b91e30ab5
I20260709 13:10:35.239975 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 2bd98a20f7c24448860d680b91e30ab5 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:35.256669 27832 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:35.260062 28566 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.260475 27230 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:35.262220 28621 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.238721 28641 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.273031 28641 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:35.274667 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:35.275492 27298 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:10:35.279870 28610 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:35.286938 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:35.286989 27841 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:35.300153 27230 raft_consensus.cc:2955] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:35.306459 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:35.335067 27055 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:35.371774 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.378666 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcf276ae949142ce87f50371f8505b9d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.385311 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:35.386034 27305 raft_consensus.cc:606] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:35.387401 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet fcf276ae949142ce87f50371f8505b9d with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:35.396183 27152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:35.396910 27152 raft_consensus.cc:606] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:35.420773 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:35.421458 27305 raft_consensus.cc:606] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:35.424193 27152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:35.424777 27152 raft_consensus.cc:606] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:35.429463 27152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:35.429966 27152 raft_consensus.cc:606] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:35.433337 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:35.435276 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:35.436272 28690 tablet_replica.cc:333] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:35.436890 27148 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.437484 27152 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:35.438377 27195 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:35.440388 28658 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:35.440888 28658 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:35.445866 28619 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:35.441926 28658 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.459857 27230 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:35.464949 28553 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:35.472807 28690 raft_consensus.cc:2243] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.473613 28690 raft_consensus.cc:2272] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.500686 28690 ts_tablet_manager.cc:1916] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.512006 28619 raft_consensus.cc:993] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:35.512648 28619 raft_consensus.cc:1081] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:35.515618 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:35.516175 27150 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.516534 27150 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.519512 27054 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.544960 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:35.545619 27230 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:10:35.547873 27150 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.548818 28566 raft_consensus.cc:993] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:35.550360 28614 raft_consensus.cc:1081] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:35.550954 27152 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:35.553138 27834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:35.553735 27834 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.554111 27834 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.554951 28640 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.555843 28640 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:35.556183 28640 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:35.557053 28640 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.567931 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:35.568667 27227 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.569526 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:35.570382 27150 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:35.578583 28690 ts_tablet_manager.cc:1929] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:35.585595 28690 log.cc:1199] T fcf276ae949142ce87f50371f8505b9d P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/fcf276ae949142ce87f50371f8505b9d
I20260709 13:10:35.588025 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet fcf276ae949142ce87f50371f8505b9d (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:35.604151 27834 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.615262 28640 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:35.626839 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 93540.2us
I20260709 13:10:35.655452 27227 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:10:35.656922 27123 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:35.657876 28614 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:35.658429 28614 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:35.659394 28614 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.677623 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:35.678923 27230 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:10:35.680325 27042 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for bd31e5d20c484a9facfe437706e9bd6b already in progress [suppressed 3 similar messages]
I20260709 13:10:35.703059 27055 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.708796 28619 raft_consensus.cc:993] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:35.709414 28553 raft_consensus.cc:1081] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:35.711056 27832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:10:35.711635 27832 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.711992 27832 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.744702 28566 raft_consensus.cc:993] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:35.745334 28566 raft_consensus.cc:1081] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:35.749186 27230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:35.749756 27230 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.750133 27230 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.756789 28610 raft_consensus.cc:993] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:35.757395 28610 raft_consensus.cc:1081] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:35.759719 27223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:35.760326 27223 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.760680 27223 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.776397 27298 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:10:35.778558 27042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 98268us
I20260709 13:10:35.778260 27223 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.780453 27227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:35.781154 27227 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:10:35.783438 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:35.784035 27150 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:35.784384 27150 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:35.784967 27150 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.785915 27150 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.786360 27223 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:10:35.788228 27103 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:10:35.788236 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:10:35.788960 27103 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for bd31e5d20c484a9facfe437706e9bd6b already in progress
I20260709 13:10:35.789109 27298 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:35.789304 27103 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for bd31e5d20c484a9facfe437706e9bd6b already in progress
I20260709 13:10:35.795552 27150 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.800773 27298 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.802865 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:35.804136 28658 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:35.804663 28658 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:35.804841 27832 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.808182 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:35.808904 27152 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.811830 27230 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.817595 27834 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:35.819257 27832 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:35.814040 27230 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:35.821980 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:35.822667 27154 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.822961 27154 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:35.823707 27154 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.825168 27154 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.825317 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:35.825875 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:35.826176 27298 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.826504 27223 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.826661 27298 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:35.829133 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:35.832823 27154 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:35.832994 27300 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.805783 28658 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.830574 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:35.834959 27148 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:35.835304 27148 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:35.836102 27148 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.837445 27148 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.838024 27223 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:35.838419 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:35.839686 28632 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:35.840160 28632 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:35.841082 28632 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.862465 27152 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:35.877218 27298 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.880406 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:35.883553 27298 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.883741 28632 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:35.881560 27148 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.881281 27054 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.882282 27300 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:35.886346 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:35.887769 28632 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:35.889256 28632 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:35.887213 28565 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:35.892598 27298 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:10:35.895026 28565 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:35.905409 28565 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:35.903167 27055 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.932716 27054 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.943161 27148 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:35.946353 28674 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.959594 27152 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:35.977336 27300 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:35.979638 28565 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:35.991168 27298 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:36.015761 28565 raft_consensus.cc:993] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:36.016284 28698 raft_consensus.cc:1081] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:36.017968 27152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:10:36.018565 27152 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.018939 27152 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.030289 27055 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.026809 27152 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.043701 27152 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:36.045536 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:36.047286 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:36.049175 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:36.049953 27832 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.069412 27230 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:36.085909 28566 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:36.099872 27832 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:10:36.101033 27834 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:36.116977 28565 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:36.129881 27298 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:36.131495 28610 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.132143 28698 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:36.132532 28698 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:36.133010 27148 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:36.133409 28698 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.135226 28565 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.138543 27832 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:36.148492 28698 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.169592 27223 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:10:36.184069 27123 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:36.185459 28614 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:36.186014 28614 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:36.186960 28614 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.210345 27054 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.288648 27300 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:36.291399 28698 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:36.314520 27148 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.322150 28624 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:36.336776 27150 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:36.340299 27300 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.342490 28632 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.339799 28658 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:36.436338 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.440706 27298 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:36.443145 28658 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.453146 27230 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.454530 27151 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.462604 28714 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.465121 28714 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.496161 27150 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:36.497761 28658 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.581864 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.653106 27298 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.654176 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:36.654861 27230 raft_consensus.cc:606] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:36.663137 27298 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:36.664700 28566 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:36.668953 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b62a963093f641fa81d5d816797099e1"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:36.669526 27301 raft_consensus.cc:606] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:36.675896 28640 raft_consensus.cc:993] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:36.676362 28640 raft_consensus.cc:1081] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:36.677525 27148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:36.678323 27148 raft_consensus.cc:606] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:36.679677 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:36.680311 27151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b62a963093f641fa81d5d816797099e1"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:36.680946 27151 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.681295 27151 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.681528 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:36.691540 27230 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:36.695147 28566 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.706465 27151 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.709503 27151 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:36.714437 27834 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:36.715620 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:36.716313 27832 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.752632 28610 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:36.772418 28610 raft_consensus.cc:993] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:36.799917 28610 raft_consensus.cc:1081] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:36.775416 27841 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:36.775722 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:36.811800 27298 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.812213 27298 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:36.813222 27298 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.814779 27298 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.816018 27305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34456
I20260709 13:10:36.816635 27305 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.817020 27305 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.826965 27832 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:36.848466 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:36.851131 28614 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.851699 28614 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:36.852634 28614 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.863413 28565 raft_consensus.cc:993] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:36.864075 28565 raft_consensus.cc:1081] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:36.895920 27301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:36.896543 27301 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.896890 27301 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.904556 27301 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:36.906544 27301 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:36.912788 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:36.913462 27227 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.913767 27227 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:36.914544 27227 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:36.915696 27227 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.923362 27227 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:36.932284 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:36.938390 28619 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.939015 28619 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:36.940035 28619 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:36.947150 27305 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:36.986819 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:36.990721 27150 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.997499 27305 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:36.998533 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:37.027060 27841 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.028328 27298 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:37.000998 27150 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:37.007545 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:37.030912 27148 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.031292 27148 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:37.032181 27148 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:37.033615 27148 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.044222 27841 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:37.045532 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:37.046969 28553 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.047472 28553 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:37.052651 27148 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:37.055539 28553 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:37.009681 27054 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:37.068874 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55271.4us
I20260709 13:10:37.368544 27050 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:37.403419 28628 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.100s	user 0.004s	sys 0.013s
I20260709 13:10:37.509972 27148 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.610162 27303 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:37.628036 27226 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:37.645785 28553 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:37.628016 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 84268.8us
I20260709 13:10:37.666965 27151 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:37.667387 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.675930 28745 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:37.678056 27301 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:37.680159 27832 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:37.685097 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.690176 27301 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:37.692713 28738 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:37.693959 27832 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:10:37.696730 27271 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5d526be8aec49c8863369b60c8e884c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:37.702663 28736 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.710044 28736 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.718183 27230 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:37.732512 28553 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:10:37.742774 27832 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:37.750242 28553 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.759503 28614 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:37.762413 27303 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:37.780548 28738 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:37.838186 27833 raft_consensus.cc:2955] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:37.858110 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd31e5d20c484a9facfe437706e9bd6b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:37.869863 28553 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:37.875988 27229 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:37.886802 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 4 to 7, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.930642 27154 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:37.931717 27152 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:37.949747 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet bd31e5d20c484a9facfe437706e9bd6b with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:37.961742 27300 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.011839 28553 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:38.019472 28745 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:10:38.061259 27271 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51fed810b66a4d09868add1d38749c15. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.106462 28759 tablet_replica.cc:333] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:38.107860 28759 raft_consensus.cc:2243] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:38.111465 28759 raft_consensus.cc:2272] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:38.114622 27230 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.116468 28759 ts_tablet_manager.cc:1916] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:38.130342 28708 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.163877 27054 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.168983 28619 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.187331 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:38.180189 27226 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.235855 28769 ts_tablet_manager.cc:933] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:38.236892 28759 ts_tablet_manager.cc:1929] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:10:38.237617 28759 log.cc:1199] T bd31e5d20c484a9facfe437706e9bd6b P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/bd31e5d20c484a9facfe437706e9bd6b
I20260709 13:10:38.245913 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet bd31e5d20c484a9facfe437706e9bd6b (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:38.247735 27152 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.263085 27230 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.267957 27055 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.285096 28769 tablet_copy_client.cc:323] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:38.287766 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet f5d526be8aec49c8863369b60c8e884c from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:38.288432 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet f5d526be8aec49c8863369b60c8e884c from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-f5d526be8aec49c8863369b60c8e884c
I20260709 13:10:38.300661 27316 tablet_copy_source_session.cc:215] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:38.318928 28769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d526be8aec49c8863369b60c8e884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.322503 28763 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.357513 27151 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.357525 27300 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:38.360112 28743 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.361702 28739 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:38.368085 27197 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36d9f53e5fed4e948f0828f157789667. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.374722 27148 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.401219 28769 tablet_copy_client.cc:806] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:38.404266 28769 tablet_copy_client.cc:670] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:38.420892 28769 tablet_copy_client.cc:538] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:38.422786 27150 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.439796 28743 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.456290 27300 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.471303 28769 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:38.475368 28777 ts_tablet_manager.cc:933] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:38.479696 27148 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.504217 27151 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.505060 27054 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.568619 27300 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:38.570370 28614 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:38.575486 27226 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:38.578125 28762 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:10:38.583530 27122 consensus_peers.cc:597] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b36513461a9483c98c7adda698d5dad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:38.584045 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:38.585306 27150 raft_consensus.cc:606] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:38.596390 27223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:38.597038 27223 raft_consensus.cc:606] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:38.613464 28777 tablet_copy_client.cc:323] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:38.623286 27304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:38.625927 27304 raft_consensus.cc:606] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:38.628201 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 51fed810b66a4d09868add1d38749c15 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:38.628770 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 51fed810b66a4d09868add1d38749c15 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-51fed810b66a4d09868add1d38749c15
I20260709 13:10:38.636376 28762 raft_consensus.cc:993] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:38.637452 28762 raft_consensus.cc:1081] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:38.639748 28737 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.641836 27304 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.644268 27316 tablet_copy_source_session.cc:215] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:38.639276 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:38.646667 27300 raft_consensus.cc:606] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:38.653685 27229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:38.654809 27229 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.655160 27229 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.659137 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:38.661481 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:38.666276 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fed810b66a4d09868add1d38749c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.667068 27229 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:38.670339 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:38.671021 27150 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.671303 27150 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:38.672098 27150 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:38.674835 27150 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.688473 27229 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:38.691006 27150 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:38.692566 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:38.695518 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:38.696370 28743 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.697021 28743 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:38.698045 28743 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:38.700721 28650 raft_consensus.cc:993] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:38.701187 28650 raft_consensus.cc:1081] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:38.704543 27298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:38.704697 27300 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.705062 27298 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.705454 27298 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.713316 27229 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.718377 28769 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.712234 27054 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:38.719460 28769 tablet_bootstrap.cc:492] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:38.727730 28769 ts_tablet_manager.cc:1403] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.257s	user 0.033s	sys 0.000s
I20260709 13:10:38.731488 28769 raft_consensus.cc:359] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.732457 28769 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:38.733134 28769 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.739006 27300 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:38.743889 28769 ts_tablet_manager.cc:1434] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:10:38.748912 27298 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:38.757376 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-f5d526be8aec49c8863369b60c8e884c received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:38.757956 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-f5d526be8aec49c8863369b60c8e884c on tablet f5d526be8aec49c8863369b60c8e884c with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:38.759377 27298 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:38.759248 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:38.771490 27229 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.771863 27229 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:38.772730 27229 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:38.773975 27229 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.759302 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:38.776110 27832 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.778589 28777 tablet_copy_client.cc:806] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:38.779313 28777 tablet_copy_client.cc:670] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:38.791517 27834 raft_consensus.cc:1217] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:38.797706 28777 tablet_copy_client.cc:538] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:38.799636 27832 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:38.800976 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:38.804615 28745 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.804757 27229 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:38.805163 28745 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:38.806146 28745 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:38.819216 27054 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.825233 28777 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:38.857252 27055 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.881536 28777 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:38.882663 28777 tablet_bootstrap.cc:492] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:38.883450 28777 ts_tablet_manager.cc:1403] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.028s
I20260709 13:10:38.888420 28777 raft_consensus.cc:359] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.889367 28777 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:38.890115 28777 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:38.897311 28777 ts_tablet_manager.cc:1434] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:38.900388 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-51fed810b66a4d09868add1d38749c15 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:38.900826 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-51fed810b66a4d09868add1d38749c15 on tablet 51fed810b66a4d09868add1d38749c15 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:38.935707 28777 ts_tablet_manager.cc:933] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:38.950901 28777 tablet_copy_client.cc:323] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:38.953050 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet 36d9f53e5fed4e948f0828f157789667 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:38.953723 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet 36d9f53e5fed4e948f0828f157789667 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-36d9f53e5fed4e948f0828f157789667
I20260709 13:10:38.965909 27242 tablet_copy_source_session.cc:215] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:38.970319 28777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d9f53e5fed4e948f0828f157789667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:38.984828 28745 raft_consensus.cc:993] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:38.985452 28745 raft_consensus.cc:1081] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:39.005995 28777 tablet_copy_client.cc:806] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.006803 28777 tablet_copy_client.cc:670] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.011363 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:39.011989 27150 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.012344 27150 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.018152 28777 tablet_copy_client.cc:538] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.028074 28777 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:39.041630 27150 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:39.044768 27150 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:39.045867 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:39.046666 27300 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.047034 27300 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:39.047923 27300 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:39.050659 27300 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.072419 28777 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.073745 28777 tablet_bootstrap.cc:492] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:39.074620 28777 ts_tablet_manager.cc:1403] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.006s
I20260709 13:10:39.078044 28777 raft_consensus.cc:359] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:39.078999 28777 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:39.079816 28777 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:39.083079 28777 ts_tablet_manager.cc:1434] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:39.090502 28769 ts_tablet_manager.cc:933] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:39.094657 27300 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:39.095994 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:39.096920 28762 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.097448 28762 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:39.098762 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:39.099340 27226 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.098382 28762 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:39.119732 27226 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:39.121554 27242 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-36d9f53e5fed4e948f0828f157789667 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:39.122747 27242 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-36d9f53e5fed4e948f0828f157789667 on tablet 36d9f53e5fed4e948f0828f157789667 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:39.133080 28745 raft_consensus.cc:993] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:39.133581 28745 raft_consensus.cc:1081] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:39.143394 27229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:10:39.144011 27229 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:39.144362 27229 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.150055 28769 tablet_copy_client.cc:323] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:39.153748 27054 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.155396 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 2b36513461a9483c98c7adda698d5dad from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:39.156086 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 2b36513461a9483c98c7adda698d5dad from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-2b36513461a9483c98c7adda698d5dad
I20260709 13:10:39.159789 27229 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.162103 27229 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:39.165781 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:39.166344 27298 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.166644 27298 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:39.167435 27298 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.168745 27298 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.171239 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:39.171870 27834 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.176965 27167 tablet_copy_source_session.cc:215] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:39.177183 27298 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:39.180377 27834 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:39.182109 28769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b36513461a9483c98c7adda698d5dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.192516 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:39.195354 28743 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.196761 28743 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:39.197770 28743 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.199503 27298 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:39.201622 28658 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.225857 27151 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:39.231062 28658 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.233906 28769 tablet_copy_client.cc:806] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.234707 28769 tablet_copy_client.cc:670] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.238917 28769 tablet_copy_client.cc:538] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:39.259284 28769 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:39.295930 27226 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:39.307754 28745 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:39.315462 27054 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.317368 28769 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:39.321614 28769 tablet_bootstrap.cc:492] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:39.324033 28745 raft_consensus.cc:1064] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:39.334604 27834 raft_consensus.cc:1217] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.334481 28745 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.359247 27834 raft_consensus.cc:1217] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:39.361479 28769 ts_tablet_manager.cc:1403] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.102s	user 0.028s	sys 0.003s
I20260709 13:10:39.422163 27832 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:39.423724 28619 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:39.426316 28769 raft_consensus.cc:359] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:39.427250 28769 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:39.427999 28769 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:39.430539 28769 ts_tablet_manager.cc:1434] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:10:39.433622 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-2b36513461a9483c98c7adda698d5dad received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:39.434098 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-2b36513461a9483c98c7adda698d5dad on tablet 2b36513461a9483c98c7adda698d5dad with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:39.454605 27151 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.460757 28708 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.466346 27226 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.476934 28708 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.509802 28801 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.478890 27832 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.520359 28763 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.523502 27150 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.542598 27229 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.564970 27300 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.566103 27055 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.567118 28735 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:39.581007 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52516.1us
I20260709 13:10:39.614539 27833 raft_consensus.cc:1217] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:10:39.670967 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.676991 27300 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:39.688094 28743 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:39.688788 27226 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.696347 28735 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.669674 27832 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.730249 27833 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:39.732249 28658 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:39.757929 28763 raft_consensus.cc:1064] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:39.760811 28763 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.800361 27150 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.803210 28619 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.804262 27226 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.806636 28801 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.811705 27832 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.814132 28708 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.839411 28658 raft_consensus.cc:1064] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:39.846627 28658 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.858441 28763 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.869712 27230 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.883445 27832 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.886693 27150 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.908891 27055 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.926316 27304 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:39.941601 27154 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:39.943724 27832 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:39.943439 28763 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:39.946341 28708 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:39.961820 27834 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.965368 27304 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.967963 28739 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:39.967635 28801 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.973381 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.986630 27833 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:39.994259 27148 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:39.996052 28658 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:40.010950 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43789.3us
I20260709 13:10:40.012866 28764 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:40.047319 27148 raft_consensus.cc:2955] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.050220 27154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:40.115722 27154 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:40.052490 27298 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.119874 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:40.059381 28762 raft_consensus.cc:1064] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:40.131072 28762 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.112957 27054 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.057753 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51fed810b66a4d09868add1d38749c15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:40.134866 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 77269.7us
I20260709 13:10:40.138782 27841 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.140326 28745 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:40.148214 27230 raft_consensus.cc:606] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:40.153677 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 51fed810b66a4d09868add1d38749c15 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:40.155184 27833 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.165838 27151 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.183169 28801 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:40.273730 28827 tablet_replica.cc:333] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
W20260709 13:10:40.274463 28817 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:10:40.275190 28827 raft_consensus.cc:2243] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.276155 28827 raft_consensus.cc:2272] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.178386 28745 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:40.323748 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 142638us
W20260709 13:10:40.340370 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 102589us
I20260709 13:10:40.344254 28827 ts_tablet_manager.cc:1916] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.346289 28658 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.364452 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:40.379063 27050 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 1 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.384084 27154 raft_consensus.cc:2955] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.421859 27305 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:40.424147 27833 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:40.430549 27148 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.442217 28827 ts_tablet_manager.cc:1929] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.448164 27223 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:40.442761 28827 log.cc:1199] T 51fed810b66a4d09868add1d38749c15 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/51fed810b66a4d09868add1d38749c15
I20260709 13:10:40.475880 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5d526be8aec49c8863369b60c8e884c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:40.475862 28826 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:40.478163 28735 raft_consensus.cc:993] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:40.479321 28735 raft_consensus.cc:1081] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:40.484645 27301 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.495206 27300 raft_consensus.cc:606] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:40.497335 28825 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:40.461606 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 51fed810b66a4d09868add1d38749c15 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:40.497879 27833 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:40.510360 27042 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48785.3us
I20260709 13:10:40.507993 28807 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:40.513365 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet f5d526be8aec49c8863369b60c8e884c with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:40.529708 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:40.531986 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:40.533987 28827 tablet_replica.cc:333] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:40.535200 27305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34456
I20260709 13:10:40.536288 27305 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.536765 27305 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.540035 27054 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.554028 28831 raft_consensus.cc:993] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:40.554683 28831 raft_consensus.cc:1081] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:40.567734 27300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:40.568419 27300 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.568845 27300 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.573344 27305 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.600414 27305 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:40.601011 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:40.604801 27148 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:40.605113 27148 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:40.606720 27300 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:40.605929 27148 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.614130 27148 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.622413 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:40.623183 27151 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.623821 27300 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:40.601517 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:40.631577 27832 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.625996 28826 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.630420 27230 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.639757 28827 raft_consensus.cc:2243] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.640908 28827 raft_consensus.cc:2272] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.626297 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:40.641963 27223 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.642881 27226 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:40.643196 27226 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:40.644166 28827 ts_tablet_manager.cc:1916] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.644028 27226 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:40.645311 27226 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.657120 27148 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:10:40.658499 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:40.659368 28708 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:40.659868 28708 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:40.660558 27833 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.660739 28708 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.663632 27150 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:40.664974 28658 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:40.665832 28827 ts_tablet_manager.cc:1929] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.666424 28827 log.cc:1199] T f5d526be8aec49c8863369b60c8e884c P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/f5d526be8aec49c8863369b60c8e884c
I20260709 13:10:40.657322 27834 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.674345 28821 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.682956 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet f5d526be8aec49c8863369b60c8e884c (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:40.682960 27150 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.687672 28831 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:40.693723 27832 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:10:40.699335 27151 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:10:40.701540 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:40.702457 28708 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:40.702975 28708 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:40.703904 28708 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:40.707304 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36d9f53e5fed4e948f0828f157789667 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:40.710963 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 4 to 5, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.714273 27226 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:10:40.715281 27834 raft_consensus.cc:2955] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.720093 27300 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.707063 27054 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.765453 27151 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.786247 27834 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:40.788432 28807 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:40.789186 27230 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:40.798831 28735 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:40.800032 27051 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.802484 28825 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.803895 27834 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.836162 28619 raft_consensus.cc:993] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:40.836671 28619 raft_consensus.cc:1081] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:40.838258 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:40.838843 27150 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:40.839191 27150 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.807566 27050 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 4, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 4 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:40.860110 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 36d9f53e5fed4e948f0828f157789667 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:40.875896 27150 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.879024 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:40.879671 27305 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:40.878647 27226 raft_consensus.cc:2955] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.879967 27305 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:40.880849 27305 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.882026 27305 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.891297 27305 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:40.892875 28842 tablet_replica.cc:333] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:40.898663 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:40.899531 28826 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:40.900019 28826 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:40.900707 28842 raft_consensus.cc:2243] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:40.900863 28826 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:40.902200 28842 raft_consensus.cc:2272] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:40.917982 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b36513461a9483c98c7adda698d5dad with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:40.935652 27050 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 5 to 6, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:40.944631 27054 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.955137 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b36513461a9483c98c7adda698d5dad with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:40.957854 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:40.958619 27834 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.962260 27150 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:40.964645 28842 ts_tablet_manager.cc:1916] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:40.989220 28842 ts_tablet_manager.cc:1929] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:40.989795 28842 log.cc:1199] T 36d9f53e5fed4e948f0828f157789667 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/36d9f53e5fed4e948f0828f157789667
I20260709 13:10:40.990638 27834 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:40.997391 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 36d9f53e5fed4e948f0828f157789667 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:41.001438 28842 tablet_replica.cc:333] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:41.002559 28842 raft_consensus.cc:2243] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.003400 28842 raft_consensus.cc:2272] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:41.007380 28842 ts_tablet_manager.cc:1916] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:41.022912 28842 ts_tablet_manager.cc:1929] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:10:41.023344 28842 log.cc:1199] T 2b36513461a9483c98c7adda698d5dad P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/2b36513461a9483c98c7adda698d5dad
I20260709 13:10:41.024987 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 2b36513461a9483c98c7adda698d5dad (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:41.153497 27150 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.155179 28708 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:41.167687 27230 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:41.175906 28708 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:41.203490 27154 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:41.204813 27834 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:41.214617 28619 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:41.217528 28847 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:41.300858 27834 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:41.302582 28829 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:41.319002 27305 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:41.335812 28807 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:41.533159 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:41.835882 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:41.900702 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:41.901394 27305 raft_consensus.cc:606] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:41.904170 27226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:41.904654 27226 raft_consensus.cc:606] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:41.906985 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:41.907456 27305 raft_consensus.cc:606] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:41.910008 27152 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:41.910511 27152 raft_consensus.cc:606] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:41.911603 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:41.912907 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:41.990685 28619 raft_consensus.cc:993] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:41.991220 28619 raft_consensus.cc:1081] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:41.994895 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:41.995504 27150 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.995862 27150 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.003386 27150 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.005908 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:42.006420 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:42.006510 27226 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.007031 27305 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:42.007408 27305 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:42.014547 27226 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:42.016091 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:42.016932 28826 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:42.008172 27305 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.017488 28826 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:42.019199 28826 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.029873 28831 raft_consensus.cc:993] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:42.018131 27305 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.036525 28831 raft_consensus.cc:1081] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:42.016949 27150 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:42.039750 27300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:42.040359 27300 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.040896 27300 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.051008 27305 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:42.060194 27300 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.062327 27300 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:42.064850 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:42.065554 27226 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:42.065878 27226 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:42.066702 27226 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.067916 27226 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.071190 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:42.071887 27150 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.077152 27230 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:42.065888 27054 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.081250 27150 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:42.086652 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:42.089267 28801 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:42.089418 27226 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:10:42.089838 28801 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:42.090768 28801 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:42.098210 27150 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:10:42.100924 27197 consensus_peers.cc:597] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c02ecf580b8f4657acdf790942e85fd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.101585 28831 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.102022 27300 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:42.115612 28856 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:42.124537 28856 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.126741 27151 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.120368 27051 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:42.156196 27300 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.162319 28847 raft_consensus.cc:993] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:42.163028 28847 raft_consensus.cc:1081] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:42.164745 27230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:10:42.165277 27230 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.165592 27230 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.167424 27151 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:42.175412 27230 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:42.182861 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:42.183511 27305 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:42.183847 27305 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:42.184031 27230 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:42.184742 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:42.184630 27305 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:42.185285 27833 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.185861 27305 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.196617 27833 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:42.198411 27305 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:10:42.207034 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:42.208302 28856 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:42.208873 28856 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:42.209967 28856 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:42.232425 27122 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe318d32db494aafa007d9cb3d4cf02a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.232653 27305 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:42.232519 27054 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.233989 28807 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.237730 27226 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:42.241073 28826 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.252112 28826 raft_consensus.cc:993] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:42.252665 28826 raft_consensus.cc:1081] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:42.265134 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:42.264484 27051 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.265759 27833 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.266189 27833 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.274891 28829 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.277887 27305 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.287388 27230 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.293340 27833 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:42.321909 27051 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.328737 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:42.331262 27151 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.331594 27151 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:42.332410 27151 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:42.333669 27151 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.334545 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:42.335172 27230 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.324486 27833 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:42.345060 27226 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:42.346310 27151 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:42.348356 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:42.349471 27230 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:42.349946 28828 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:42.350714 28828 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:42.351648 28828 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:42.356175 27305 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:42.356333 27197 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d64b1a67a0cc42479c0519e68bc68492. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.357507 28862 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.359907 27151 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:42.364461 28862 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.385354 28856 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.390304 27150 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.394191 27305 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.420737 27051 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.431876 27305 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:42.444260 27054 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:42.466532 27271 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 006b4229b8b346a4b6e1de5910f7b5a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.468691 27226 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:42.470996 28847 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.475162 27150 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:42.476569 28801 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.496258 28619 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.498910 27226 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.516731 27051 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:42.519507 27151 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:42.586701 27151 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.588503 28619 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.641594 27300 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:42.651659 28658 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:42.652740 27300 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.725610 28881 ts_tablet_manager.cc:933] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:42.784693 28881 tablet_copy_client.cc:323] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
I20260709 13:10:42.918285 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.928839 27155 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:42.931057 28884 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:42.934326 27226 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.938593 28847 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:42.975212 27226 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.976576 27832 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:43.048638 28891 ts_tablet_manager.cc:933] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:10:43.053928 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 100059us
W20260709 13:10:43.074951 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 65460.9us
I20260709 13:10:43.105235 28897 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:43.118273 27230 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:43.124577 28909 ts_tablet_manager.cc:933] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:43.126224 28910 ts_tablet_manager.cc:933] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:43.151612 28913 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.131374 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet c02ecf580b8f4657acdf790942e85fd5 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:43.165311 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet c02ecf580b8f4657acdf790942e85fd5 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-c02ecf580b8f4657acdf790942e85fd5
I20260709 13:10:43.189898 28904 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:43.191175 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 83338.8us
I20260709 13:10:43.195353 28905 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:43.158820 28891 tablet_copy_client.cc:323] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:43.225356 27242 tablet_copy_source_session.cc:215] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:43.232167 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 115254us
W20260709 13:10:43.238734 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 43852.3us
I20260709 13:10:43.384585 28881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02ecf580b8f4657acdf790942e85fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:43.389151 28909 tablet_copy_client.cc:323] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:43.258132 28910 tablet_copy_client.cc:323] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.130:33347
W20260709 13:10:43.460716 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50351.4us
I20260709 13:10:43.480298 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 006b4229b8b346a4b6e1de5910f7b5a4 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:43.480965 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 006b4229b8b346a4b6e1de5910f7b5a4 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-006b4229b8b346a4b6e1de5910f7b5a4
W20260709 13:10:43.560904 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81522.6us
W20260709 13:10:43.562419 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 73002.2us
W20260709 13:10:43.777182 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 215109us
W20260709 13:10:43.779567 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 53986us
I20260709 13:10:43.780233 27316 tablet_copy_source_session.cc:215] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:43.795810 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 298392us
W20260709 13:10:43.797582 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 290294us
W20260709 13:10:43.880479 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 99364.2us
W20260709 13:10:43.900370 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 442644us
W20260709 13:10:43.903311 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 443114us
I20260709 13:10:43.908931 28881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35860 (request call id 295) took 1255 ms. Trace:
W20260709 13:10:43.910203 28929 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.457s	user 0.001s	sys 0.002s
W20260709 13:10:43.895689 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 78168.9us
I20260709 13:10:43.950003 27242 tablet_copy_service.cc:140] P 9bc1278c649846e998b312b374274d08: Received BeginTabletCopySession request for tablet d64b1a67a0cc42479c0519e68bc68492 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:39166)
I20260709 13:10:43.950747 27242 tablet_copy_service.cc:161] P 9bc1278c649846e998b312b374274d08: Beginning new tablet copy session on tablet d64b1a67a0cc42479c0519e68bc68492 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:39166: session id = f4afe81810944d70bc2cc31754392f3d-d64b1a67a0cc42479c0519e68bc68492
W20260709 13:10:43.972958 28928 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:43.909512 28881 rpcz_store.cc:276] 0709 13:10:42.662348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.678902 (+ 16554us) service_pool.cc:224] Handling call
0709 13:10:42.759386 (+ 80484us) ts_tablet_manager.cc:934] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
0709 13:10:43.383145 (+623759us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:43.505420 (+122275us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:43.505619 (+   199us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:43.906929 (+401310us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:43.908308 (+  1379us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:43.908753 (+   445us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:43.908827 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5584,"tablet-copy.queue_time_us":31365,"thread_start_us":47969,"threads_started":2}
I20260709 13:10:43.983392 28881 tablet_copy_client.cc:806] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:43.984102 28881 tablet_copy_client.cc:670] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:10:44.004827 28927 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
W20260709 13:10:44.034358 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8060 after lost signal to thread 26041
W20260709 13:10:44.035737 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8740 after lost signal to thread 27089
W20260709 13:10:44.037228 27862 debug-util.cc:398] Leaking SignalData structure 0x7b0800356720 after lost signal to thread 27181
W20260709 13:10:44.038568 27862 debug-util.cc:398] Leaking SignalData structure 0x7b080036a280 after lost signal to thread 27256
W20260709 13:10:44.039866 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002439e0 after lost signal to thread 27330
W20260709 13:10:44.041692 27862 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d20 after lost signal to thread 27865
W20260709 13:10:44.057128 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87491us
I20260709 13:10:44.065909 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet fe318d32db494aafa007d9cb3d4cf02a from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:44.066617 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet fe318d32db494aafa007d9cb3d4cf02a from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-fe318d32db494aafa007d9cb3d4cf02a
I20260709 13:10:44.055764 27242 tablet_copy_source_session.cc:215] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.069779 28881 tablet_copy_client.cc:538] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:43.891103 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:44.134883 27167 tablet_copy_source_session.cc:215] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:44.136838 28891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006b4229b8b346a4b6e1de5910f7b5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.208537 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64b1a67a0cc42479c0519e68bc68492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.209941 28881 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:44.210469 28909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe318d32db494aafa007d9cb3d4cf02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:44.263796 28891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 687) took 1317 ms. Trace:
I20260709 13:10:44.264861 28891 rpcz_store.cc:276] 0709 13:10:42.946536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.994136 (+ 47600us) service_pool.cc:224] Handling call
0709 13:10:43.049438 (+ 55302us) ts_tablet_manager.cc:934] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:44.135326 (+1085888us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:44.187065 (+ 51739us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:44.187196 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:44.262780 (+ 75584us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:44.263186 (+   406us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:44.263615 (+   429us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:44.263707 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":53333,"tablet-copy.queue_time_us":53923,"thread_start_us":108556,"threads_started":2}
I20260709 13:10:44.266690 28891 tablet_copy_client.cc:806] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.267409 28891 tablet_copy_client.cc:670] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.287456 28891 tablet_copy_client.cc:538] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.310632 28909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35852 (request call id 463) took 1190 ms. Trace:
I20260709 13:10:44.311286 28909 rpcz_store.cc:276] 0709 13:10:43.120113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.121632 (+  1519us) service_pool.cc:224] Handling call
0709 13:10:43.135897 (+ 14265us) ts_tablet_manager.cc:934] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
0709 13:10:44.190613 (+1054716us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:44.250432 (+ 59819us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:44.250555 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:44.292030 (+ 41475us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:44.292402 (+   372us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:44.292788 (+   386us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:44.292860 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":318,"tablet-copy.queue_time_us":2379,"thread_start_us":193627,"threads_started":2}
I20260709 13:10:44.331586 28909 tablet_copy_client.cc:806] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.333446 28910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35860 (request call id 299) took 1210 ms. Trace:
I20260709 13:10:44.333683 28909 tablet_copy_client.cc:670] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.334120 28910 rpcz_store.cc:276] 0709 13:10:43.122953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.123715 (+   762us) service_pool.cc:224] Handling call
0709 13:10:43.148600 (+ 24885us) ts_tablet_manager.cc:934] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
0709 13:10:44.199369 (+1050769us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:44.218989 (+ 19620us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:44.219125 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:44.316125 (+ 97000us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:44.316479 (+   354us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:44.333303 (+ 16824us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:44.333378 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5516,"tablet-copy.queue_time_us":1943,"thread_start_us":82460,"threads_started":2}
I20260709 13:10:44.350152 28910 tablet_copy_client.cc:806] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:44.350955 28910 tablet_copy_client.cc:670] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:44.351588 28891 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:44.388487 28881 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.389607 28881 tablet_bootstrap.cc:492] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:44.401161 28881 ts_tablet_manager.cc:1403] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.192s	user 0.027s	sys 0.017s
I20260709 13:10:44.415992 28881 raft_consensus.cc:359] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.417016 28881 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:44.417789 28881 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.421084 28881 ts_tablet_manager.cc:1434] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:10:44.432899 27227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:44.433646 27227 raft_consensus.cc:606] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
W20260709 13:10:44.512773 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 59070.7us
I20260709 13:10:44.556732 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:44.557623 27302 raft_consensus.cc:606] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:44.568455 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:44.671943 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:44.687516 28891 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.688839 28891 tablet_bootstrap.cc:492] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:44.689734 28891 ts_tablet_manager.cc:1403] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.338s	user 0.033s	sys 0.007s
I20260709 13:10:44.693379 28891 raft_consensus.cc:359] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.711011 28891 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:44.724035 28910 tablet_copy_client.cc:538] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:44.732510 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 139067us
I20260709 13:10:44.754161 28910 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:44.713119 28891 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.768438 28891 ts_tablet_manager.cc:1434] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:10:44.770651 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-006b4229b8b346a4b6e1de5910f7b5a4 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:44.771071 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-006b4229b8b346a4b6e1de5910f7b5a4 on tablet 006b4229b8b346a4b6e1de5910f7b5a4 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:44.786751 27241 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-c02ecf580b8f4657acdf790942e85fd5 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:44.787348 27241 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-c02ecf580b8f4657acdf790942e85fd5 on tablet c02ecf580b8f4657acdf790942e85fd5 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:44.823091 28910 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:44.824301 28910 tablet_bootstrap.cc:492] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:44.825138 28910 ts_tablet_manager.cc:1403] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.011s
W20260709 13:10:44.828264 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 231379us
I20260709 13:10:44.829103 28910 raft_consensus.cc:359] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.830109 28910 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:44.830904 28910 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:44.835772 28910 ts_tablet_manager.cc:1434] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:44.860616 28934 raft_consensus.cc:993] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:44.861205 28934 raft_consensus.cc:1081] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:44.863193 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:44.863772 27155 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.864146 27155 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:44.870836 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 136176us
I20260709 13:10:44.904981 28909 tablet_copy_client.cc:538] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:44.900275 27155 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:44.915598 27155 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:44.917317 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:44.920197 27304 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.920607 27304 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:44.921491 27304 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:44.922809 27304 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.930280 28909 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:44.934753 28915 raft_consensus.cc:993] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:44.936321 28915 raft_consensus.cc:1081] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
I20260709 13:10:44.951376 27833 raft_consensus.cc:1217] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:44.976675 27304 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:44.978181 27122 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:44.982921 28922 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.983516 28922 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:44.984431 28922 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:44.985666 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:44.986400 27230 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.995409 27230 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:44.998239 27241 tablet_copy_service.cc:342] P 9bc1278c649846e998b312b374274d08: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-d64b1a67a0cc42479c0519e68bc68492 received from {username='slave'} at 127.0.0.1:39166
I20260709 13:10:44.998721 27241 tablet_copy_service.cc:434] P 9bc1278c649846e998b312b374274d08: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-d64b1a67a0cc42479c0519e68bc68492 on tablet d64b1a67a0cc42479c0519e68bc68492 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:45.012174 27832 raft_consensus.cc:1217] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:10:45.020027 27302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34440
I20260709 13:10:45.020732 27302 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:45.021139 27302 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.039781 27051 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.053850 27302 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:45.056401 27302 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:10:45.060186 28909 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:45.061379 28909 tablet_bootstrap.cc:492] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:45.062245 28909 ts_tablet_manager.cc:1403] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.132s	user 0.030s	sys 0.003s
I20260709 13:10:45.068598 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:45.076416 27230 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:45.076812 27230 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:45.077747 27230 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:45.079099 27230 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.088065 27832 raft_consensus.cc:1217] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:45.097939 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:45.098867 27155 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.105623 28909 raft_consensus.cc:359] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:45.106709 28909 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:45.107443 28909 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:45.135807 28909 ts_tablet_manager.cc:1434] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:10:45.137898 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-fe318d32db494aafa007d9cb3d4cf02a received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:45.138391 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-fe318d32db494aafa007d9cb3d4cf02a on tablet fe318d32db494aafa007d9cb3d4cf02a with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:45.140198 27155 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:10:45.141631 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:45.142520 28847 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:45.144351 27230 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:10:45.144465 28847 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:45.146548 28847 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:45.189457 27051 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 4, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 4 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:45.265578 28894 raft_consensus.cc:1064] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:45.268667 28894 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:45.293151 27833 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:45.294541 27302 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:45.297994 28957 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:45.300184 28957 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:45.294683 27155 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:45.303874 28958 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:45.343354 28915 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.427328 27833 raft_consensus.cc:1217] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:45.468737 27227 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:45.485023 28934 raft_consensus.cc:1064] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:45.485117 27150 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.488523 28934 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:45.521283 27833 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:45.522953 28948 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.530689 27155 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:45.536614 27230 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:45.547255 27302 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.542042 28934 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:10:45.555853 28948 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.543602 28902 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:10:45.560034 27304 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:45.562685 28899 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:45.580567 28958 raft_consensus.cc:1064] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:10:45.609716 27327 debug-util.cc:398] Leaking SignalData structure 0x7b08000becc0 after lost signal to thread 26041
W20260709 13:10:45.612195 27327 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5f40 after lost signal to thread 27089
W20260709 13:10:45.613715 27327 debug-util.cc:398] Leaking SignalData structure 0x7b0800375d00 after lost signal to thread 27181
W20260709 13:10:45.616312 27327 debug-util.cc:398] Leaking SignalData structure 0x7b0800359c00 after lost signal to thread 27256
W20260709 13:10:45.617655 27327 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ba0 after lost signal to thread 27330
W20260709 13:10:45.619071 27327 debug-util.cc:398] Leaking SignalData structure 0x7b0800295c60 after lost signal to thread 27865
I20260709 13:10:45.636245 28934 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.637373 27223 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.631085 27051 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:45.584496 28958 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:45.657497 27155 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:45.659552 27833 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:45.667840 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 123361us
W20260709 13:10:45.728811 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59891.2us
I20260709 13:10:45.732441 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:45.748510 27150 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:45.750228 27223 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:45.763959 28934 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:45.767236 28976 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:45.767982 28942 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:45.805836 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 164042us
W20260709 13:10:45.808461 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53954.8us
W20260709 13:10:45.844583 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 208711us
I20260709 13:10:45.911185 27833 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:45.992250 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50634us
W20260709 13:10:45.997603 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 84294.3us
W20260709 13:10:46.000430 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61717.4us
I20260709 13:10:46.007205 27832 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.008531 27148 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.015039 28958 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:46.030169 27303 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:46.096414 28977 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:46.114615 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71707.5us
I20260709 13:10:46.120684 28950 raft_consensus.cc:1064] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:46.123672 28950 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:46.130662 28984 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:46.133435 27054 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:46.175911 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 133274us
W20260709 13:10:46.183040 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 143432us
I20260709 13:10:46.256167 27303 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:46.301043 27223 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:46.304642 27223 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:46.308879 27832 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:46.310395 27833 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:46.312083 28951 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.322295 29007 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:46.326012 27303 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:46.327876 28951 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.336177 29005 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:46.337714 28977 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:46.344861 29007 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.364622 27227 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.380312 27834 raft_consensus.cc:2955] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.395440 27832 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:46.409540 27306 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:46.411659 28998 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:46.422772 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 006b4229b8b346a4b6e1de5910f7b5a4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:46.425654 27229 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:46.437119 28951 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.456424 28977 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:46.463164 27304 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.470392 27055 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 4 to 5, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.475057 28991 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:46.506364 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 78374us
I20260709 13:10:46.514711 28862 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.512820 29003 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.527809 27833 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.545722 27834 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.568475 27833 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.571998 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 006b4229b8b346a4b6e1de5910f7b5a4 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:46.581441 29014 tablet_replica.cc:333] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:46.583056 29014 raft_consensus.cc:2243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.585515 27151 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.589946 27306 raft_consensus.cc:2955] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.543702 27054 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.600665 27303 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.608038 29014 raft_consensus.cc:2272] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.630003 27227 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.639616 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c02ecf580b8f4657acdf790942e85fd5 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:46.643975 29014 ts_tablet_manager.cc:1916] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.663452 27148 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:46.675583 27832 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:46.677078 28950 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:46.687220 27303 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:46.688894 28991 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:46.692655 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43676.9us
I20260709 13:10:46.698269 28950 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:46.702165 27832 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.709332 27304 raft_consensus.cc:2955] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.759315 29014 ts_tablet_manager.cc:1929] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:46.765256 29014 log.cc:1199] T 006b4229b8b346a4b6e1de5910f7b5a4 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/006b4229b8b346a4b6e1de5910f7b5a4
I20260709 13:10:46.772326 27051 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.768781 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 006b4229b8b346a4b6e1de5910f7b5a4 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:46.814798 27055 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:46.817921 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 97615.8us
I20260709 13:10:46.826999 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet c02ecf580b8f4657acdf790942e85fd5 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45788
I20260709 13:10:46.828099 29014 tablet_replica.cc:333] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:10:46.839273 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe318d32db494aafa007d9cb3d4cf02a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:46.842451 29014 raft_consensus.cc:2243] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.843529 29014 raft_consensus.cc:2272] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.859968 27055 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.857349 29014 ts_tablet_manager.cc:1916] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.885366 27227 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:46.896883 27832 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:46.897456 27151 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:46.899084 28894 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.901010 28894 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:46.918210 29014 ts_tablet_manager.cc:1929] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:10:46.918803 29014 log.cc:1199] T c02ecf580b8f4657acdf790942e85fd5 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/c02ecf580b8f4657acdf790942e85fd5
I20260709 13:10:46.916180 28957 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.920394 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet c02ecf580b8f4657acdf790942e85fd5 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:46.933315 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet fe318d32db494aafa007d9cb3d4cf02a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:46.942741 27832 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.947978 27042 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d64b1a67a0cc42479c0519e68bc68492 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:46.948724 27151 raft_consensus.cc:2955] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:46.963829 29016 tablet_replica.cc:333] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:46.970221 27051 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:46.975579 29016 raft_consensus.cc:2243] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:46.976660 29016 raft_consensus.cc:2272] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:46.983954 29016 ts_tablet_manager.cc:1916] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:46.993999 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet d64b1a67a0cc42479c0519e68bc68492 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:47.014099 29017 tablet_replica.cc:333] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:47.016027 29017 raft_consensus.cc:2243] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.016899 29017 raft_consensus.cc:2272] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.027146 29017 ts_tablet_manager.cc:1916] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:47.048218 29017 ts_tablet_manager.cc:1929] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:47.049062 29017 log.cc:1199] T d64b1a67a0cc42479c0519e68bc68492 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/d64b1a67a0cc42479c0519e68bc68492
I20260709 13:10:47.052158 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet d64b1a67a0cc42479c0519e68bc68492 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:47.076833 29016 ts_tablet_manager.cc:1929] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:47.077567 29016 log.cc:1199] T fe318d32db494aafa007d9cb3d4cf02a P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/fe318d32db494aafa007d9cb3d4cf02a
I20260709 13:10:47.079701 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet fe318d32db494aafa007d9cb3d4cf02a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:47.199329 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:47.394479 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:47.395216 27150 raft_consensus.cc:606] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:47.401721 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:47.402395 27306 raft_consensus.cc:606] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:47.419313 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:47.419968 27150 raft_consensus.cc:606] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:47.423777 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:47.425900 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:47.557255 29006 raft_consensus.cc:993] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:47.558822 29008 raft_consensus.cc:1081] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:47.565646 27150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:47.567384 27150 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.567960 27150 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.600414 27150 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.605631 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:47.606609 27306 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.607023 27306 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:47.607450 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:47.608278 27832 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.608367 27306 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.610416 27306 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.605620 27150 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:47.631579 29021 raft_consensus.cc:993] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:47.632565 28905 raft_consensus.cc:1081] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:47.635416 27834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:47.636106 27834 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.636531 27834 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.650676 29021 raft_consensus.cc:993] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:47.651583 29021 raft_consensus.cc:1081] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:47.660149 27227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:47.660856 27227 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.661230 27227 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.661811 27832 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:47.656251 27306 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:47.663329 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:47.664217 28905 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:47.665055 28905 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:47.665089 27834 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.666432 28905 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.669261 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:47.669930 27150 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:47.670168 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:47.670276 27150 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:47.671693 27306 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.672399 27150 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.673875 27150 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.679347 27834 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:47.682870 27227 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:47.689390 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:47.690127 27148 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:47.690429 27148 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:47.691447 27148 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:47.693017 27148 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.710214 27150 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:47.710726 27227 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:47.715075 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:47.714241 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:47.715812 27302 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.716481 28994 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:47.717008 28994 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:47.718030 28994 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:47.723308 27148 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:47.725016 27306 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:47.726792 27302 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:47.730679 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:47.731966 28957 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:47.732625 28957 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:47.733793 28957 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:47.804643 27055 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:47.817695 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50816.1us
I20260709 13:10:47.849502 27054 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.867264 27051 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.169571 27151 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:48.172974 28894 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.169793 27832 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:48.177421 28905 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:48.228579 27150 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:48.241981 29024 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:48.260354 27302 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:48.325076 27306 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:48.328503 29025 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:48.343008 27306 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:48.398355 28905 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:48.427320 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:48.515496 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 97970us
I20260709 13:10:48.570583 29040 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.620244 27148 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:48.671451 27122 consensus_peers.cc:597] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa050ea82d9b4a729f786c4fd23f4904. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.677508 27302 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:48.679255 29020 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:48.707898 27306 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.710692 29020 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.714434 27230 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:48.717196 29021 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.800074 27150 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:48.809832 27051 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.817499 27306 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:48.822134 27122 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd61db1ee95e4b8baf0a3057db7c4d2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.823652 28951 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.835698 27227 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:48.838547 27230 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.848169 29020 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.876573 29020 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.893427 27302 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.911785 27232 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:48.921087 27306 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:48.952389 27051 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 2, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:49.001657 27271 consensus_peers.cc:597] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e37f81c47354aae99c01542f682acef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.007105 27148 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:49.009614 27232 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:49.009867 29035 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:49.015892 28996 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:10:49.049041 28996 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.054023 27232 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.078864 27150 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.121312 27148 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:49.142032 27051 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:49.168851 27122 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1366d63dcc6742608d7574eb132c123a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:49.171664 27306 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:49.173300 28951 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.204635 29062 ts_tablet_manager.cc:933] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:49.212001 27232 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:49.213922 29020 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.262277 29020 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.272698 27232 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.289817 27306 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.307063 27051 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:49.334383 29062 tablet_copy_client.cc:323] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:49.343894 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet aa050ea82d9b4a729f786c4fd23f4904 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:49.344596 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet aa050ea82d9b4a729f786c4fd23f4904 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-aa050ea82d9b4a729f786c4fd23f4904
I20260709 13:10:49.381852 27167 tablet_copy_source_session.cc:215] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.401032 29062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa050ea82d9b4a729f786c4fd23f4904. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:49.577243 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54970.5us
W20260709 13:10:49.617812 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70917.3us
I20260709 13:10:49.686112 29065 ts_tablet_manager.cc:933] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:49.703284 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.762729 29065 tablet_copy_client.cc:323] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:49.837339 29073 ts_tablet_manager.cc:933] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:10:49.864557 27232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:10:49.865528 27232 raft_consensus.cc:606] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:49.881615 29059 raft_consensus.cc:993] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:49.882292 29059 raft_consensus.cc:1081] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:49.886510 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:10:49.887256 27155 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:49.887684 27155 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.923064 27155 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:49.931587 27148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b62a963093f641fa81d5d816797099e1"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:49.932416 27148 raft_consensus.cc:606] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:10:49.936362 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet dd61db1ee95e4b8baf0a3057db7c4d2a from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:49.936920 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet dd61db1ee95e4b8baf0a3057db7c4d2a from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-dd61db1ee95e4b8baf0a3057db7c4d2a
I20260709 13:10:49.946656 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:10:49.947407 27232 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.947728 27232 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:49.948578 27232 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:49.949806 27232 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.939149 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:49.954885 27155 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:49.954164 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:49.959565 29073 tablet_copy_client.cc:323] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:10:49.964399 27167 tablet_copy_source_session.cc:215] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:49.975045 29062 tablet_copy_client.cc:806] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:49.975903 29062 tablet_copy_client.cc:670] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:49.984196 27232 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:49.987757 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:49.996615 29079 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.997210 29079 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:49.998266 29079 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:50.013646 29080 ts_tablet_manager.cc:933] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:50.036633 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 1366d63dcc6742608d7574eb132c123a from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:10:50.037317 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 1366d63dcc6742608d7574eb132c123a from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-1366d63dcc6742608d7574eb132c123a
I20260709 13:10:50.065773 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:50.069656 27304 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.094556 29065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd61db1ee95e4b8baf0a3057db7c4d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.104750 27304 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:10:50.126437 27167 tablet_copy_source_session.cc:215] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:50.094383 29080 tablet_copy_client.cc:323] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:50.129810 29020 raft_consensus.cc:993] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 897d8be8580141d1ad3bb17946d3da89 to start an election
W20260709 13:10:50.137389 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 376457us
I20260709 13:10:50.130451 29020 raft_consensus.cc:1081] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 897d8be8580141d1ad3bb17946d3da89 to start an election
W20260709 13:10:50.154810 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 77436.1us
I20260709 13:10:50.158969 29062 tablet_copy_client.cc:538] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:50.162636 27302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b62a963093f641fa81d5d816797099e1"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:34456
I20260709 13:10:50.163456 27302 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.163933 27302 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.165037 27051 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.214500 29073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1366d63dcc6742608d7574eb132c123a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.231562 27302 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:50.235587 27302 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:50.235905 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:50.236590 27838 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.241118 29062 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:50.248556 27838 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:50.251057 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:50.253062 29085 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.253659 29085 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:50.254667 29085 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:50.265955 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 1e37f81c47354aae99c01542f682acef from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:50.266637 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 1e37f81c47354aae99c01542f682acef from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-1e37f81c47354aae99c01542f682acef
I20260709 13:10:50.284108 27316 tablet_copy_source_session.cc:215] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:50.303727 29073 tablet_copy_client.cc:806] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:50.304509 29073 tablet_copy_client.cc:670] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:50.310633 29080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e37f81c47354aae99c01542f682acef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.289281 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:50.313112 27151 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.313526 27151 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:50.318305 27151 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:50.320329 27151 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.331507 29073 tablet_copy_client.cc:538] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:50.355834 29065 tablet_copy_client.cc:806] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:50.356572 29065 tablet_copy_client.cc:670] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:50.370954 29065 tablet_copy_client.cc:538] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:50.384014 27055 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.391173 29073 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:50.391786 27151 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:10:50.426759 29065 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:50.432710 29080 tablet_copy_client.cc:806] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:50.433434 29080 tablet_copy_client.cc:670] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:50.437757 29080 tablet_copy_client.cc:538] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:50.446300 29062 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:50.447486 29062 tablet_bootstrap.cc:492] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:50.448339 29062 ts_tablet_manager.cc:1403] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.018s
I20260709 13:10:50.453006 29062 raft_consensus.cc:359] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.453919 29062 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:50.454711 29062 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.474488 29062 ts_tablet_manager.cc:1434] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.006s
I20260709 13:10:50.476331 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-aa050ea82d9b4a729f786c4fd23f4904 received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:50.476889 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-aa050ea82d9b4a729f786c4fd23f4904 on tablet aa050ea82d9b4a729f786c4fd23f4904 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:50.487784 27227 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.491446 28905 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.493283 27302 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.495074 28905 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.558032 29065 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:50.566941 29065 tablet_bootstrap.cc:492] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:50.568452 29065 ts_tablet_manager.cc:1403] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.030s
I20260709 13:10:50.684477 29065 raft_consensus.cc:359] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.686719 29065 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:50.687520 29065 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.694229 29065 ts_tablet_manager.cc:1434] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.125s	user 0.014s	sys 0.006s
I20260709 13:10:50.696496 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-dd61db1ee95e4b8baf0a3057db7c4d2a received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:50.696916 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-dd61db1ee95e4b8baf0a3057db7c4d2a on tablet dd61db1ee95e4b8baf0a3057db7c4d2a with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:50.725988 29080 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:10:50.769716 27151 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:50.772604 29073 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:50.773772 29073 tablet_bootstrap.cc:492] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:50.773661 29083 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:50.774819 29073 ts_tablet_manager.cc:1403] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.384s	user 0.027s	sys 0.010s
I20260709 13:10:50.819725 27838 raft_consensus.cc:1217] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:50.845072 29073 raft_consensus.cc:359] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.886518 29073 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:50.887583 29073 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:50.857020 27838 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:50.895994 28996 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:50.896914 27253 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf840 after lost signal to thread 26041
W20260709 13:10:50.898262 27253 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca260 after lost signal to thread 27089
W20260709 13:10:50.903175 27253 debug-util.cc:398] Leaking SignalData structure 0x7b0800107560 after lost signal to thread 27181
W20260709 13:10:50.904551 27253 debug-util.cc:398] Leaking SignalData structure 0x7b080029e000 after lost signal to thread 27256
W20260709 13:10:50.905833 27253 debug-util.cc:398] Leaking SignalData structure 0x7b0800257e00 after lost signal to thread 27330
W20260709 13:10:50.913993 27253 debug-util.cc:398] Leaking SignalData structure 0x7b080031ad80 after lost signal to thread 27865
I20260709 13:10:50.935407 29073 ts_tablet_manager.cc:1434] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.160s	user 0.005s	sys 0.004s
I20260709 13:10:50.937474 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-1366d63dcc6742608d7574eb132c123a received from {username='slave'} at 127.0.0.1:47438
I20260709 13:10:50.937920 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-1366d63dcc6742608d7574eb132c123a on tablet 1366d63dcc6742608d7574eb132c123a with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:50.956931 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:51.003803 29080 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:51.004982 29080 tablet_bootstrap.cc:492] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:10:51.005775 29080 ts_tablet_manager.cc:1403] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 0.280s	user 0.029s	sys 0.004s
I20260709 13:10:51.045220 29080 raft_consensus.cc:359] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:51.046182 29080 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:10:51.046979 29080 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:51.049738 29080 ts_tablet_manager.cc:1434] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:10:51.051635 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-1e37f81c47354aae99c01542f682acef received from {username='slave'} at 127.0.0.1:40558
I20260709 13:10:51.052073 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-1e37f81c47354aae99c01542f682acef on tablet 1e37f81c47354aae99c01542f682acef with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:51.072315 27839 raft_consensus.cc:1217] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:51.171113 27838 raft_consensus.cc:1217] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:10:51.245467 27838 raft_consensus.cc:1217] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:51.432606 28951 raft_consensus.cc:1064] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:51.435683 28951 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:51.495901 27838 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:51.496966 27306 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:51.498225 28905 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.502677 28905 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:51.580674 29106 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:51.598852 28905 raft_consensus.cc:1064] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:51.599040 27306 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:51.613602 27839 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:51.601500 28905 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:51.626519 27051 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.669811 27227 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:51.706305 28951 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.708846 27304 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:51.710824 29107 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.711490 27839 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:51.713132 29107 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.727358 27224 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:51.741842 29107 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:51.744146 29106 raft_consensus.cc:1064] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:51.748044 29106 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:51.817145 27229 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:51.839125 29113 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:51.845074 27306 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:51.843191 28951 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:51.853063 27833 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:51.855417 27304 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:51.856547 28905 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:51.884012 29106 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:10:51.992553 28996 raft_consensus.cc:1064] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:10:51.995821 28996 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:52.061144 29111 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.173s	user 0.004s	sys 0.005s
I20260709 13:10:52.095425 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:52.128907 29116 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:10:52.130415 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 141396us
W20260709 13:10:52.162473 29124 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:10:52.169502 29118 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:10:52.212926 27148 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:52.215073 27229 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:10:52.226183 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 127205us
I20260709 13:10:52.235133 29129 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:52.237986 28996 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:52.257591 27834 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:52.256003 27833 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:52.318696 29130 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:52.342798 27229 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:52.344293 27224 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:52.449716 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86554.3us
W20260709 13:10:52.429340 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55726.1us
I20260709 13:10:52.519107 29121 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:52.572564 29086 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:52.583021 27304 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:52.987555 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 46576.8us
I20260709 13:10:52.959731 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:10:53.010020 27300 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:10:52.952875 27055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 362) took 1331 ms. Trace:
I20260709 13:10:53.005074 27054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 229) took 1285 ms. Trace:
I20260709 13:10:52.946604 27051 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 366) took 1325 ms. Trace:
W20260709 13:10:53.014560 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 70937.8us
I20260709 13:10:53.012224 27054 rpcz_store.cc:276] 0709 13:10:51.719238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.719398 (+   160us) service_pool.cc:224] Handling call
0709 13:10:51.730660 (+ 11262us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:10:53.004986 (+1274326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8662,"reported_tablets":1,"spinlock_wait_cycles":20324096}
I20260709 13:10:53.021430 27155 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.027747 27151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:53.028343 27151 raft_consensus.cc:606] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:53.011686 27055 rpcz_store.cc:276] 0709 13:10:51.621437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.621586 (+   149us) service_pool.cc:224] Handling call
0709 13:10:52.952787 (+1331201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12708,"reported_tablets":1}
I20260709 13:10:53.031924 27050 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 320) took 1192 ms. Trace:
I20260709 13:10:53.032354 27050 rpcz_store.cc:276] 0709 13:10:51.839176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.839298 (+   122us) service_pool.cc:224] Handling call
0709 13:10:51.849428 (+ 10130us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b540022ff10. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec130b2 00007f9a57b8ca89 00007f9a57b24da6 00007f9a57af6088 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc
0709 13:10:53.031717 (+1182289us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":3426560}
I20260709 13:10:53.053807 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:53.055917 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:53.063938 27225 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.013026 27051 rpcz_store.cc:276] 0709 13:10:51.621063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.621216 (+   153us) service_pool.cc:224] Handling call
0709 13:10:52.946507 (+1325291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:51.688967 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:51.689542 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:51.689576 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:51.689594 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:51.689942 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:51.690017 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:51.690066 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:51.701084 (+ 11018us) tablet.cc:701] Row locks acquired
0709 13:10:51.702441 (+  1357us) write_op.cc:260] PREPARE: finished
0709 13:10:51.729224 (+ 26783us) write_op.cc:270] Start()
0709 13:10:51.745861 (+ 16637us) write_op.cc:276] Timestamp: P: 1783602651729127 usec, L: 0
0709 13:10:51.745886 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.746638 (+   752us) log.cc:844] Serialized 603 byte log entry
0709 13:10:52.273165 (+526527us) op_driver.cc:464] REPLICATION: finished
0709 13:10:52.349375 (+ 76210us) write_op.cc:301] APPLY: starting
0709 13:10:52.349464 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.349570 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.349701 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:52.349931 (+   230us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:52.350164 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:52.350212 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:52.350437 (+   225us) log.cc:844] Serialized 23 byte log entry
0709 13:10:52.350616 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.350707 (+    91us) write_op.cc:454] Released schema lock
0709 13:10:52.350745 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:52.363276 (+ 12531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.384661 (+ 21385us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":523117,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":75925,"apply.run_cpu_time_us":1728,"apply.run_wall_time_us":1727,"num_ops":1,"prepare.queue_time_us":57474,"prepare.run_cpu_time_us":33866,"prepare.run_wall_time_us":110068,"raft.queue_time_us":142693,"raft.run_cpu_time_us":10758,"raft.run_wall_time_us":174242,"replication_time_us":527044,"thread_start_us":314881,"threads_started":4,"wal-append.queue_time_us":140959}]]}
W20260709 13:10:53.108590 29147 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.418s	user 0.011s	sys 0.000s
I20260709 13:10:53.132740 27055 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 2 to 3, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.115366 29040 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:53.157829 29040 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:10:53.177578 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 128562us
W20260709 13:10:53.179136 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 79283.1us
I20260709 13:10:53.191192 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:53.242246 29128 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:53.249938 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.263747 29122 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:10:53.264611 29122 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:53.312682 27839 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:53.319334 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 139284us
W20260709 13:10:53.325793 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 166805us
I20260709 13:10:53.344770 27304 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:53.338040 29040 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:53.347779 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:53.362504 29122 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:53.397073 27838 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:10:53.400045 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57476.3us
I20260709 13:10:53.407898 27840 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:53.412949 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 94505.6us
I20260709 13:10:53.421990 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:53.429641 27054 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 4, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.433391 29130 raft_consensus.cc:993] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:53.433934 29130 raft_consensus.cc:1081] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:10:53.437786 29162 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:53.438246 28905 raft_consensus.cc:993] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:10:53.439787 28905 raft_consensus.cc:1081] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
W20260709 13:10:53.456765 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46396.7us
I20260709 13:10:53.461122 27232 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.499820 27151 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.508435 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:10:53.509141 27155 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.509497 27155 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.510464 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:10:53.525118 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35852
I20260709 13:10:53.525810 27833 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.526258 27833 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.528239 27155 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.530318 27155 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:53.531250 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:53.532347 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:10:53.535017 27833 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.536108 28905 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:53.537681 27833 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:53.538755 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:53.539346 27306 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:53.539645 27306 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:10:53.540417 27306 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.543068 27306 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.545631 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:10:53.546270 27841 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.542996 29086 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:53.564867 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:53.565843 27306 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:10:53.572327 27055 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 4 to 5, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.581030 27841 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:10:53.583593 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:53.584203 27306 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.582448 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:10:53.602988 27306 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:53.581210 29149 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:53.618533 29133 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:53.629812 29133 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:53.630935 29133 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.624904 27155 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.605798 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:53.636926 27152 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:53.637283 27152 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:53.604396 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:10:53.645977 27306 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:53.657902 27152 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.659660 27152 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.662101 29074 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:53.662716 29074 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:10:53.663724 29074 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.667593 29140 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.677438 27152 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:10:53.679071 27299 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.687562 27306 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.707640 27841 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.711879 29121 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:53.715308 27841 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:53.717240 27229 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:53.722573 29137 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:53.724452 29159 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:53.733029 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa050ea82d9b4a729f786c4fd23f4904 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:53.739794 27229 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.737444 29159 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.745461 27841 raft_consensus.cc:2955] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.748114 27055 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.788725 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet aa050ea82d9b4a729f786c4fd23f4904 with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46398
I20260709 13:10:53.791666 27050 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 6, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:53.823343 29166 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:53.830386 27054 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 5 to 6, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.868903 29171 tablet_replica.cc:333] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:10:53.877230 29006 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:10:53.878021 29006 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:53.881253 29006 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:53.882321 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:53.896696 29121 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:53.900076 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:53.908603 27226 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:53.909991 27055 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.870404 29171 raft_consensus.cc:2243] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:54.037503 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 127928us
W20260709 13:10:54.052254 29170 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:10:54.058622 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.039150 29171 raft_consensus.cc:2272] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.076462 27148 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:54.120179 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e37f81c47354aae99c01542f682acef with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.129567 27833 raft_consensus.cc:2955] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:54.148244 29171 ts_tablet_manager.cc:1916] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:54.151046 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:10:54.154356 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd61db1ee95e4b8baf0a3057db7c4d2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:54.160138 28996 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.198818 27148 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:10:54.200038 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 283127us
I20260709 13:10:54.212193 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e37f81c47354aae99c01542f682acef with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45788
W20260709 13:10:54.218163 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46866.2us
I20260709 13:10:54.220675 27839 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:54.224705 27841 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:54.234552 27838 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:54.245208 29181 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:54.211486 29175 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:10:54.276736 27050 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 1 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.288740 27299 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:54.294503 29154 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:54.301333 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 60505.6us
I20260709 13:10:54.313294 29107 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:54.349128 27226 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:54.377522 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74121.7us
I20260709 13:10:54.383044 29185 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:54.415648 27223 raft_consensus.cc:2955] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:54.444182 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet dd61db1ee95e4b8baf0a3057db7c4d2a with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:54.470649 27305 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:54.473616 29139 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:54.496003 29190 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:54.508213 29171 ts_tablet_manager.cc:1929] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:54.509034 29171 log.cc:1199] T aa050ea82d9b4a729f786c4fd23f4904 P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/aa050ea82d9b4a729f786c4fd23f4904
W20260709 13:10:54.744757 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 294724us
I20260709 13:10:54.772462 29187 tablet_replica.cc:333] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
W20260709 13:10:54.903692 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 77377.3us
I20260709 13:10:54.908211 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet aa050ea82d9b4a729f786c4fd23f4904 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
W20260709 13:10:54.909260 27042 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 78780.5us
W20260709 13:10:54.953510 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 420098us
I20260709 13:10:54.988752 29187 raft_consensus.cc:2243] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:54.990134 29187 raft_consensus.cc:2272] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:54.994040 29187 ts_tablet_manager.cc:1916] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:55.011059 29193 tablet_replica.cc:333] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:55.010727 29197 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:10:55.055799 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 82810.4us
W20260709 13:10:55.064854 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 141850us
W20260709 13:10:55.065913 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 142555us
W20260709 13:10:55.073007 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 98521.2us
I20260709 13:10:55.045200 29197 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:55.112994 29193 raft_consensus.cc:2243] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.113955 29193 raft_consensus.cc:2272] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.114974 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 45760.7us
I20260709 13:10:55.118264 29162 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.113957 29139 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:55.173040 29158 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:10:55.173771 29158 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:10:55.195916 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:55.199198 29197 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:55.216308 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:10:55.233460 27227 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:55.246842 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:55.248574 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:10:55.254482 29193 ts_tablet_manager.cc:1916] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:55.272732 27841 raft_consensus.cc:2955] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:55.275758 27269 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:55.279166 27269 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:10:55.282836 29161 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:55.285006 27269 raft_consensus.cc:2686] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:55.278587 29158 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:10:55.320943 29187 ts_tablet_manager.cc:1929] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:10:55.325759 29187 log.cc:1199] T 1e37f81c47354aae99c01542f682acef P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/1e37f81c47354aae99c01542f682acef
I20260709 13:10:55.330497 29187 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45788 (request call id 85) took 1118 ms. Trace:
I20260709 13:10:55.346481 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:55.366108 29139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45788 (request call id 84) took 1471 ms. Trace:
I20260709 13:10:55.368898 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:10:55.337049 29187 rpcz_store.cc:276] 0709 13:10:54.211743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.211899 (+   156us) service_pool.cc:224] Handling call
0709 13:10:54.711862 (+499963us) ts_tablet_manager.cc:1151] Deleting tablet 1e37f81c47354aae99c01542f682acef
0709 13:10:54.730842 (+ 18980us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:55.108923 (+378081us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:55.320789 (+211866us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:55.330422 (+  9633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48318,"tablet-delete.queue_time_us":320334,"thread_start_us":134886,"threads_started":1}
I20260709 13:10:55.400584 29139 rpcz_store.cc:276] 0709 13:10:53.896657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.899103 (+  2446us) service_pool.cc:224] Handling call
0709 13:10:54.075250 (+176147us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b180015fde0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d7273d 00007f9a51d3df3f 00007f9a51d3d6b3 00007f9a51d359fa 00007f9a56cfd4c9 00007f9a50279c54 00007f9a50279be2 00007f9a50279b11 00007f9a50279a8c 00007f9a50278d42
0709 13:10:54.094480 (+ 19230us) log.cc:844] Serialized 508 byte log entry
0709 13:10:55.364367 (+1269887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2223,"raft.queue_time_us":4410,"raft.run_cpu_time_us":1064,"raft.run_wall_time_us":1062,"spinlock_wait_cycles":20444416,"thread_start_us":75654,"threads_started":1,"wal-append.queue_time_us":92599,"wal-append.run_cpu_time_us":1877,"wal-append.run_wall_time_us":1002281}
I20260709 13:10:55.432336 27050 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 4 to 5, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:10:55.467765 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet 1e37f81c47354aae99c01542f682acef (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:55.468641 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1366d63dcc6742608d7574eb132c123a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:55.482687 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 192312us
I20260709 13:10:55.632397 29193 ts_tablet_manager.cc:1929] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:55.671149 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.690426 29193 log.cc:1199] T dd61db1ee95e4b8baf0a3057db7c4d2a P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/dd61db1ee95e4b8baf0a3057db7c4d2a
I20260709 13:10:55.724524 29193 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34430 (request call id 90) took 1309 ms. Trace:
I20260709 13:10:55.734927 29193 rpcz_store.cc:276] 0709 13:10:54.421442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.443781 (+ 22339us) service_pool.cc:224] Handling call
0709 13:10:54.971125 (+527344us) ts_tablet_manager.cc:1151] Deleting tablet dd61db1ee95e4b8baf0a3057db7c4d2a
0709 13:10:54.974820 (+  3695us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:55.464488 (+489668us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:55.632205 (+167717us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:55.724400 (+ 92195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":499476,"thread_start_us":215905,"threads_started":1}
I20260709 13:10:55.745661 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet dd61db1ee95e4b8baf0a3057db7c4d2a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:55.748319 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 1366d63dcc6742608d7574eb132c123a with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34430
I20260709 13:10:55.759145 29193 tablet_replica.cc:333] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:10:55.770644 29193 raft_consensus.cc:2243] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.771615 29193 raft_consensus.cc:2272] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.818197 29193 ts_tablet_manager.cc:1916] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:55.850629 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:10:55.851495 27150 raft_consensus.cc:606] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:10:55.853498 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:55.855883 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:55.937708 29214 raft_consensus.cc:993] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:55.938634 29162 raft_consensus.cc:1081] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:10:55.941239 27225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:10:55.941893 27225 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:55.942327 27225 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.966606 27225 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:55.977990 27225 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:55.979645 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:10:55.980397 27150 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:55.980723 27150 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:10:55.981607 27150 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:55.982867 27150 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.995251 29193 ts_tablet_manager.cc:1929] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:56.000581 27150 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:56.004422 29193 log.cc:1199] T 1366d63dcc6742608d7574eb132c123a P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/1366d63dcc6742608d7574eb132c123a
I20260709 13:10:56.005906 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:10:56.006851 29152 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.007357 29152 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:10:56.011117 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:10:56.014297 27305 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.013809 29152 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:10:56.018589 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 1366d63dcc6742608d7574eb132c123a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:10:56.036310 27305 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:10:56.068773 27055 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:56.429900 27155 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:56.433640 29152 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:56.542445 27305 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:56.554616 29059 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:56.857424 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.018087 27306 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:57.051191 27271 consensus_peers.cc:597] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e466225c5a147b9b31f11fea1bcf893. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.054370 27225 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.056149 27150 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.056306 29202 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.058213 29221 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.143178 29232 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.181927 27224 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.209890 27305 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:57.216447 27055 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:57.232858 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 84079.4us
I20260709 13:10:57.250144 27155 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:57.273314 27271 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d87c41315a07486aa13067ad7c47c34a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.279887 27224 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:57.284153 29202 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:57.320529 29235 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.345140 27224 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.354151 27155 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:57.363780 29235 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:57.377622 27305 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:10:57.406791 27155 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:10:57.458037 29242 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:10:57.460742 27271 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a6d314618684d688b91fe535777e47b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.461815 27224 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.463922 27150 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:57.469135 29235 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.470983 29232 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.523067 27054 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 4, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.581640 29230 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.583781 27224 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.655365 29254 ts_tablet_manager.cc:933] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:57.676066 29254 tablet_copy_client.cc:323] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:57.721680 27054 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.728902 27150 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:10:57.733711 27148 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:10:57.831562 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74916.8us
I20260709 13:10:57.835530 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 9e466225c5a147b9b31f11fea1bcf893 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:57.836567 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 9e466225c5a147b9b31f11fea1bcf893 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-9e466225c5a147b9b31f11fea1bcf893
I20260709 13:10:57.939044 27316 tablet_copy_source_session.cc:215] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:57.947819 29254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e466225c5a147b9b31f11fea1bcf893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:57.984881 29264 ts_tablet_manager.cc:933] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:57.990649 27226 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:58.021958 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.022749 29265 ts_tablet_manager.cc:933] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:10:58.040243 27302 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:10:58.047725 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53788.9us
I20260709 13:10:58.080078 29262 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:58.080511 29264 tablet_copy_client.cc:323] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
I20260709 13:10:58.134357 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet 1a6d314618684d688b91fe535777e47b from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:58.135005 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet 1a6d314618684d688b91fe535777e47b from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-1a6d314618684d688b91fe535777e47b
I20260709 13:10:58.150544 27316 tablet_copy_source_session.cc:215] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:58.156497 29264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6d314618684d688b91fe535777e47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:58.168000 29086 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:58.212767 29265 tablet_copy_client.cc:323] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
W20260709 13:10:58.210619 27122 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f9dfa4361254d838c2b61576ada60f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:58.273715 27316 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet d87c41315a07486aa13067ad7c47c34a from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:10:58.274452 27316 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet d87c41315a07486aa13067ad7c47c34a from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-d87c41315a07486aa13067ad7c47c34a
I20260709 13:10:58.292308 27316 tablet_copy_source_session.cc:215] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:59.830675 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800155c60 after lost signal to thread 26041
I20260709 13:10:58.828295 29262 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:11:00.102910 29262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47436 (request call id 13) took 2376 ms. Trace:
I20260709 13:11:00.172303 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1570) took 1861 ms. Trace:
I20260709 13:11:00.173285 27227 rpcz_store.cc:276] 0709 13:10:58.311213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.315193 (+  3980us) service_pool.cc:224] Handling call
0709 13:10:58.316668 (+  1475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.171722 (+1855054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.171759 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.171806 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:00.171840 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.171942 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.172088 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.199942 29234 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.200804 29234 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.215962 29234 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.216713 29234 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.217296 29234 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.255999 29275 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.266748 29234 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.267486 29234 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.268112 29234 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.288266 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1885) took 2021 ms. Trace:
I20260709 13:11:00.288990 27155 rpcz_store.cc:276] 0709 13:10:58.266997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.267144 (+   147us) service_pool.cc:224] Handling call
0709 13:11:00.281802 (+2014658us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800005198. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:00.287218 (+  5416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.287502 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.287530 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.287723 (+   193us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:00.287771 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.287844 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.288026 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29645696}
I20260709 13:11:00.276624 29275 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.293996 29275 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.294745 29275 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.295444 29275 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.293848 29059 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.296562 29059 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.298081 29272 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.301131 29275 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.304437 29059 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.304610 29275 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.305280 29059 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.306587 29277 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.319983 29277 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.299465 29234 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.310281 29272 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.324939 29272 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.325331 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 703) took 2018 ms. Trace:
I20260709 13:11:00.326205 29277 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.325942 27840 rpcz_store.cc:276] 0709 13:10:58.306910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.308221 (+  1311us) service_pool.cc:224] Handling call
0709 13:11:00.324338 (+2016117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.324642 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.324703 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.324764 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.324811 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.324889 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.325045 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.329718 29254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 938) took 2694 ms. Trace:
I20260709 13:11:00.331725 29059 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.340824 29254 rpcz_store.cc:276] 0709 13:10:57.634974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.635104 (+   130us) service_pool.cc:224] Handling call
0709 13:10:57.660675 (+ 25571us) ts_tablet_manager.cc:934] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:57.945797 (+285122us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:58.137509 (+191712us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:58.137649 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:58.272977 (+135328us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:58.273397 (+   420us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:00.321775 (+2048378us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec132b8 00007f9a4ec131db 00007f9a57b54bb9 00007f9a56c85d88 00007f9a56d4c973 00007f9a56d4870f 00007f9a56d4a2d3 00007f9a56d7bf4e 00007f9a56d60fdd 00007f9a56d60f89
0709 13:11:00.329283 (+  7508us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:00.329557 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":460,"spinlock_wait_cycles":12423552,"tablet-copy.queue_time_us":19372,"thread_start_us":36457,"threads_started":2}
I20260709 13:11:00.337324 29281 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.343011 29254 tablet_copy_client.cc:806] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:00.344527 29254 tablet_copy_client.cc:670] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:00.344902 29252 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.343251 29059 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.345777 29059 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.345656 29252 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.346369 29059 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.348129 29252 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.348486 29059 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.348655 29252 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.349104 29059 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.352761 29278 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.353508 29278 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.349337 29252 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.349635 29059 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.355207 29275 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.362625 29277 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.364123 29278 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.343488 29281 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.372176 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 951) took 2101 ms. Trace:
I20260709 13:11:00.376205 29252 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.382501 29283 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:00.390754 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080030c3a0 after lost signal to thread 27089
I20260709 13:11:00.398977 27833 rpcz_store.cc:276] 0709 13:10:58.270148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.282731 (+ 12583us) service_pool.cc:224] Handling call
0709 13:11:00.370848 (+2088117us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:00.371181 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.371494 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.371534 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.371593 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.371655 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.371733 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.371907 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4049152}
W20260709 13:11:00.402624 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad940 after lost signal to thread 27103
I20260709 13:11:00.103546 29262 rpcz_store.cc:276] 0709 13:10:57.726207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.727054 (+   847us) service_pool.cc:224] Handling call
0709 13:10:57.740036 (+ 12982us) log.cc:844] Serialized 513 byte log entry
0709 13:10:57.853983 (+113947us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b18000e6f20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:00.102725 (+2248742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89404,"raft.queue_time_us":98512,"raft.run_cpu_time_us":2647,"raft.run_wall_time_us":41200,"spinlock_wait_cycles":15239168,"thread_start_us":68325,"threads_started":2,"wal-append.queue_time_us":71475,"wal-append.run_cpu_time_us":2623,"wal-append.run_wall_time_us":1012659}
I20260709 13:11:00.406489 29275 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.407318 29272 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.403569 29277 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.407999 29272 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.408205 29262 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.409013 29283 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.411017 29272 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.411736 29272 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.412776 29277 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.413367 29277 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.413587 29279 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.403715 29252 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.414739 29252 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.414529 29279 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.409881 29262 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.412418 29272 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.422631 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 952) took 2134 ms. Trace:
I20260709 13:11:00.422935 29263 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.423707 29263 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.424870 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 705) took 2114 ms. Trace:
I20260709 13:11:00.425273 27839 rpcz_store.cc:276] 0709 13:10:58.310407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.310543 (+   136us) service_pool.cc:224] Handling call
0709 13:11:00.424203 (+2113660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.424406 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.424432 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.424477 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:00.424517 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.424571 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.424669 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.427114 29283 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.427734 29283 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.428300 29283 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.428733 29234 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.429455 29234 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.431936 29059 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.423121 27837 rpcz_store.cc:276] 0709 13:10:58.287706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.287856 (+   150us) service_pool.cc:224] Handling call
0709 13:11:00.421849 (+2133993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.422112 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.422137 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.422185 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.422225 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.422279 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.422401 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.462890 29279 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.467849 29272 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.469695 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1574) took 2150 ms. Trace:
I20260709 13:11:00.470238 27229 rpcz_store.cc:276] 0709 13:10:58.319003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.459482 (+2140479us) service_pool.cc:224] Handling call
0709 13:11:00.468835 (+  9353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.469173 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.469201 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.469246 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:00.469308 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.469374 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.469502 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.413873 29277 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.485253 29236 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.486253 29280 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.486207 29236 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.486945 29280 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.488852 29236 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.489202 29280 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.479590 29275 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.489851 29275 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.492214 29275 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.493112 29283 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.494138 29283 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.494699 29283 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.496716 29283 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.493608 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 704) took 2171 ms. Trace:
I20260709 13:11:00.497205 27838 rpcz_store.cc:276] 0709 13:10:58.307284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.308511 (+  1227us) service_pool.cc:224] Handling call
0709 13:11:00.459889 (+2151378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.460172 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.460211 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.460277 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:00.460325 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.460417 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.479083 (+ 18666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.498437 29284 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.499267 29284 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.502432 29263 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.504073 29277 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.505036 29272 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.505398 29282 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.505563 29272 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.505965 29282 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.489818 29280 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.523065 29280 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.524559 29282 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.506204 29263 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.525396 29280 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.527452 29272 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.527635 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2471) took 2211 ms. Trace:
I20260709 13:11:00.528095 27148 rpcz_store.cc:276] 0709 13:10:58.315811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.316044 (+   233us) service_pool.cc:224] Handling call
0709 13:11:00.526978 (+2210934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.527208 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.527238 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.527291 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:00.527344 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.527407 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.527537 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.536298 29059 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.537074 29280 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.537328 29059 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.537900 29280 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.536398 29286 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.525471 29263 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.540751 29059 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.540882 29280 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.540886 29286 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.498430 29283 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.589954 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2473) took 2272 ms. Trace:
I20260709 13:11:00.603547 27150 rpcz_store.cc:276] 0709 13:10:58.317409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.317884 (+   475us) service_pool.cc:224] Handling call
0709 13:11:00.542174 (+2224290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.542454 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.542494 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.542550 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:00.542600 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.542674 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.589858 (+ 47184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58752}
I20260709 13:11:00.533550 29282 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.594542 29184 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.613471 29202 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.614157 29202 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.615113 29184 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.616626 29202 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.617393 29184 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.617606 27054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 377) took 2477 ms. Trace:
I20260709 13:11:00.545821 29234 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.619581 29270 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.620195 29270 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.618808 27054 rpcz_store.cc:276] 0709 13:10:58.139764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.163210 (+ 23446us) service_pool.cc:224] Handling call
0709 13:11:00.617509 (+2454299us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:11:00.544411 29284 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.617393 29230 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.617576 29235 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.637413 29059 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.637960 29059 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.607199 29283 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:00.633458 29270 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.628767 29282 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.654851 29264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 944) took 2801 ms. Trace:
I20260709 13:11:00.655156 29236 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.662264 29236 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.662781 29286 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.674295 29282 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.675220 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.655436 29278 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.681268 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.691304 29278 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.692210 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.693349 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.693646 29278 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.681790 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.694375 27228 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:00.695079 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.683116 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.693907 27232 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:00.683853 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.684962 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.685352 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.699666 27224 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:00.686800 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.687470 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.688511 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.645112 29230 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.708516 29263 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.710847 29230 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.711771 29281 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.671761 29275 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.641948 29235 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:00.712585 29275 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:00.713137 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800264e40 after lost signal to thread 27181
I20260709 13:11:00.714564 29235 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:00.715322 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080008afe0 after lost signal to thread 27256
I20260709 13:11:00.660887 29279 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.686793 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.700515 27229 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:00.716761 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800190ca0 after lost signal to thread 27330
W20260709 13:11:00.723413 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800330880 after lost signal to thread 27331
W20260709 13:11:00.724982 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800208d40 after lost signal to thread 27865
W20260709 13:11:00.725565 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080022c240 after lost signal to thread 29237
W20260709 13:11:00.725878 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800300a80 after lost signal to thread 29238
W20260709 13:11:00.726184 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080029c520 after lost signal to thread 29239
W20260709 13:11:00.728492 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08003308e0 after lost signal to thread 29240
I20260709 13:11:00.721589 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:00.670042 29236 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:00.736730 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080022c580 after lost signal to thread 29243
W20260709 13:11:00.737382 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080034a7a0 after lost signal to thread 29265
I20260709 13:11:00.725915 29279 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.739078 29059 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.727733 29262 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.755638 29262 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.755788 29234 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:00.756099 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 443914us
I20260709 13:11:00.756512 29234 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.758982 29234 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.756425 29262 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:00.761446 29260 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.763180 29283 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.763368 29235 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.762809 27302 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:11:00.764076 29275 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.763937 29235 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.765786 29252 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.766176 29235 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.766335 29221 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.761512 29290 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.659302 29264 rpcz_store.cc:276] 0709 13:10:57.853331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.853885 (+   554us) service_pool.cc:224] Handling call
0709 13:10:57.985563 (+131678us) ts_tablet_manager.cc:934] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:58.154542 (+168979us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:58.237523 (+ 82981us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:58.237698 (+   175us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:58.289472 (+ 51774us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:58.289733 (+   261us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:00.650150 (+2360417us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:00.654756 (+  4606us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":350,"tablet-copy.queue_time_us":130114,"thread_start_us":168232,"threads_started":2}
I20260709 13:11:00.766908 29221 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.767493 29264 tablet_copy_client.cc:806] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:00.767319 29290 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.768126 29264 tablet_copy_client.cc:670] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:00.769191 29221 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.769564 29290 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.772713 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.773399 27155 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:11:00.763234 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.774729 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.775384 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.775538 27157 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:00.775997 27154 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:00.774756 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.774791 27306 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:11:00.776950 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.779592 29262 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.766701 29235 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.780980 29265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87c41315a07486aa13067ad7c47c34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:00.780740 29235 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.782754 29235 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.783463 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.784860 29246 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.785427 29246 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.787492 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.788098 27299 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:11:00.788321 29246 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.788858 29246 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.789345 29230 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.791424 29274 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.791982 29274 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.792302 29251 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.792869 29251 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.798969 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.804500 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.808636 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.804754 29262 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.808645 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.809754 29262 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.810235 27304 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:00.810880 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.810288 29232 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.810213 29270 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.813710 29232 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.814275 29262 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.814092 29270 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.799345 29274 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.762042 29260 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.821322 29270 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.789891 29230 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.822929 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.807631 29283 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.812423 29290 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.789340 29246 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.841148 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.849427 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.832396 29253 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.833045 29281 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.840723 29290 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.851557 29293 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:00.866374 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.866766 29293 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.867651 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.868232 27148 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:00.837193 29283 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.851859 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.859244 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.861197 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.861676 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.856526 29284 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:00.872694 27156 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:00.873016 29284 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.853595 29228 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.860280 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.875571 27151 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:00.854189 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.859830 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.862442 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.860746 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.875016 29228 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.884058 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.885613 29260 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.859148 27231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:00.886611 27231 raft_consensus.cc:606] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:00.854099 29209 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.889679 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.882205 27837 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:11:00.894789 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.853951 29291 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.897109 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.852176 29202 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.875281 29284 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.863488 29246 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.900858 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.902222 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.902627 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.902874 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.903224 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.903504 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.910712 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:00.904126 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.911962 27157 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:00.912673 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.905495 29202 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.863111 29281 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.870810 29232 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.854229 29261 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.906354 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:00.918648 27227 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:00.906766 29270 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.854980 29251 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.888238 29209 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.925055 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.921976 29260 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.915768 29296 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.929991 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.862787 29253 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.932839 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.932629 29260 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.922150 29232 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.923314 29235 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.924901 29270 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.938346 29202 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.939073 29270 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.939656 29273 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.928646 29274 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.947615 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.948518 29295 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:00.927170 29261 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.951222 29295 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.897338 29291 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.947536 29289 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.956730 29274 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.946388 29235 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.956489 29279 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.940196 29273 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.964272 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.966518 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.945711 29228 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:00.980739 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:00.969640 29246 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:00.986508 29283 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.986966 29246 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:00.956568 29260 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.989796 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:00.972819 27839 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:00.989383 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:00.957206 29289 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.991004 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:00.996757 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86968us
I20260709 13:11:00.998116 29289 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:00.952387 29232 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:00.999058 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:00.972136 29249 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.000443 29279 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.001392 29281 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:00.973048 29251 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.021337 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.027706 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:00.949014 29296 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.035063 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.036255 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.038532 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.023084 27297 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:01.018535 29293 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.040037 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.025238 29279 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.046389 29230 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.046998 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.049494 29274 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.031335 29275 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.055240 29253 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:01.056152 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.059587 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.060261 27299 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:01.061132 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.062405 29290 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.064770 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.042997 29236 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.066444 29236 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.066874 29236 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.057739 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.069161 27304 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:01.070251 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.068137 29275 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.072391 29275 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.034157 29251 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.045121 29279 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.080531 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.081408 27834 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:01.083629 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.084316 27303 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:01.070875 27305 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:01.084738 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.085256 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.085371 27231 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:11:01.037644 29262 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.085907 27305 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:01.089561 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49583.5us
I20260709 13:11:01.089141 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:01.092419 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.091223 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.090250 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.094574 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.096932 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.097445 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.098242 29209 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.103324 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.106364 27302 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:01.099539 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.100304 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.100827 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.112138 29273 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.112406 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.101330 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.099561 29246 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:01.115243 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.102358 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.117367 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.135424 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.137190 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.140069 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.141028 29302 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.141431 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.105048 29235 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.142131 29251 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.144232 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.093580 29234 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.091187 29262 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.146744 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.117777 29277 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.174760 27304 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:01.143381 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.072398 29291 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.037854 29249 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.158788 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.159142 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.159515 29232 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:01.159669 29292 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.195510 29292 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.196043 29292 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.160328 29278 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.155853 29209 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.166882 29236 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:01.169971 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.134552 29263 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.170791 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.178107 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.138558 29295 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.247716 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.175431 29262 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.245680 29209 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.253492 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.253942 29236 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:01.254528 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 74280.8us
I20260709 13:11:01.256232 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.256296 27304 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:01.262176 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:01.174432 29234 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.197451 29276 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.266917 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.274029 29276 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.274552 29276 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.197690 27227 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:11:01.255223 29263 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.295917 29263 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.297259 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.298249 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.301664 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.175664 29277 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.297725 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.308923 29251 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.310715 29251 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.311924 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.280236 29265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 946) took 3388 ms. Trace:
I20260709 13:11:01.287674 29234 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.320093 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.320039 29246 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.328719 29246 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.329914 29251 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.330899 29246 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:01.331089 29261 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.331542 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.282307 29209 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:01.327179 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.307216 29277 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.335492 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.336771 29251 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.337550 29249 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.337368 29251 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.339659 29251 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.348397 29275 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:01.349766 27154 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:01.348532 27054 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 3, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.354979 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.355931 29291 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.356352 29291 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.356763 29291 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.359691 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.360405 27837 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:11:01.361209 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.361405 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.361773 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.362514 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.363371 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.313573 29295 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.364833 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.365319 29295 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.361950 27834 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:11:01.365885 29295 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.375495 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.377552 29296 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.376720 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.397222 29291 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.322293 29265 rpcz_store.cc:276] 0709 13:10:57.878141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.878466 (+   325us) service_pool.cc:224] Handling call
0709 13:10:58.023206 (+144740us) ts_tablet_manager.cc:934] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:11:00.779540 (+2756334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:00.913441 (+133901us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:00.913591 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:01.118952 (+205361us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:01.156767 (+ 37815us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:01.256498 (+ 99731us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:01.266166 (+  9668us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10017,"tablet-copy.queue_time_us":143412,"thread_start_us":230516,"threads_started":2}
I20260709 13:11:01.400043 29265 tablet_copy_client.cc:806] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:01.400172 29291 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.413731 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.401218 29283 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.252063 29302 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.402245 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:01.418278 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 91609us
W20260709 13:11:01.384204 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 208263us
I20260709 13:11:01.411971 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.412990 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.412190 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:01.412483 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 277145us
I20260709 13:11:01.357497 29276 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.438623 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.438715 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.403882 27195 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.400956 29265 tablet_copy_client.cc:670] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:01.423213 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:01.444492 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.448581 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.449713 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.449848 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.451490 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.452936 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:01.453996 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:01.421916 29283 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.460050 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.464960 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.438906 29184 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.462337 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.471355 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.473199 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.474246 29275 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.469732 29184 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.475198 29184 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.468585 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:01.481014 29284 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.460911 29282 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.460593 29272 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.487596 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.457098 29236 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.459391 29281 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.481704 29284 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.463282 29278 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.463230 29283 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.495451 27832 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:11:01.499425 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:01.503870 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.462042 29305 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.491746 29202 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.509702 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:01.510828 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.511296 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.494865 29282 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.497341 29272 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.498518 29304 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.501803 29278 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.506808 29305 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.518536 29232 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.539237 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.542704 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.543354 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:01.549028 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:01.512439 29291 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.546253 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:01.548550 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75979.3us
I20260709 13:11:01.560367 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:01.554718 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 134939us
I20260709 13:11:01.560274 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.561447 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.501005 29281 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.535137 29282 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.567474 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.569952 29059 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.537623 29272 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.549719 29278 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.538367 29304 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.598969 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.619983 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.620841 27227 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:01.622638 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.623093 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.552991 29290 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.628672 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:01.630044 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 62702.2us
W20260709 13:11:01.624119 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59291.8us
I20260709 13:11:01.632207 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.632416 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:01.592108 29230 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.591691 29202 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.640120 29202 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.640641 29202 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.645998 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:01.634233 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72401.7us
I20260709 13:11:01.591794 29281 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.647502 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:01.649312 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:01.649385 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 88014.4us
W20260709 13:11:01.651400 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 85955.8us
I20260709 13:11:01.653522 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.656891 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.556777 29232 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.549599 29305 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.598873 29300 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.556701 29291 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.624987 29304 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.672963 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:01.644569 29290 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.674366 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:01.678550 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.648000 29289 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.687664 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.648650 29302 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:01.691061 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.670433 29291 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.663995 29232 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.663089 29236 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.651845 29270 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.678228 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.615666 29263 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:01.716742 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.763358 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.693053 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:01.764421 27154 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.718786 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.671957 29230 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:01.719518 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.692137 29290 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.695099 29276 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:01.689343 29289 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.678960 29309 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:01.766268 29292 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.009s
W20260709 13:11:01.787237 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 139824us
I20260709 13:11:01.788203 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.763012 29235 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.790707 27152 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:01.769397 29230 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:01.819222 29059 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:01.837734 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 163438us
I20260709 13:11:01.905239 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.905781 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:01.795514 29235 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.792930 29273 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.797257 29236 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.846190 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.868956 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.870519 29246 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.883095 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:01.782466 29289 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:01.847375 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 156394us
I20260709 13:11:01.933763 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.913259 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.842978 29307 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:01.921238 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.933805 27301 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.944375 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:01.915179 29235 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.910190 29261 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:01.909304 29230 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:01.926999 29236 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.915460 29314 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:01.797832 29292 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:01.947824 29246 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:01.950491 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:01.977872 29317 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.940763 29273 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:01.987474 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.988363 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.991555 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.981456 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.007386 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.007567 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.008630 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.008805 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.009181 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.009509 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:01.950572 29307 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:01.960407 29261 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.009692 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.117089 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.239365 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.028556 27153 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.197525 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.199517 27301 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:02.060940 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.202347 29327 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:02.273593 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:02.203723 29292 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.276093 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:02.287195 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:02.289713 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:02.269073 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:02.067796 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 415082us
I20260709 13:11:02.276285 29284 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:02.011150 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.358743 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.121423 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:02.136386 29277 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.001s
I20260709 13:11:02.061121 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.279363 29307 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.002529 29273 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:02.017777 29184 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.542s	user 0.017s	sys 0.000s
I20260709 13:11:02.283684 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.273386 29327 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.257745 29291 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:02.027896 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.116856 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:01.964740 29236 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.965097 29314 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:02.052070 27122 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.509s (SENT)
I20260709 13:11:02.262615 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:02.357286 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85299us
W20260709 13:11:02.419061 27154 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.000s
I20260709 13:11:02.419480 27154 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:02.360813 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:02.366225 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 384829us
W20260709 13:11:02.421561 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60792.2us
I20260709 13:11:02.282791 27157 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.371896 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2491) took 1063 ms. Trace:
W20260709 13:11:02.136480 29279 consensus_meta.cc:287] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.055s	user 0.013s	sys 0.000s
I20260709 13:11:02.438295 29279 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.440502 29279 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.440989 29296 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:02.441172 27150 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:02.428025 27153 rpcz_store.cc:276] 0709 13:11:01.308602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.308709 (+   107us) service_pool.cc:224] Handling call
0709 13:11:01.310530 (+  1821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.354940 (+1044410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.371570 (+ 16630us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b5400138b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:02.371825 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650690944}
W20260709 13:11:02.443359 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 249003us
I20260709 13:11:02.389426 29301 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.389424 29316 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:02.102510 29263 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:02.399127 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 115530us
I20260709 13:11:02.259706 29320 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.370348 29325 ts_tablet_manager.cc:933] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
I20260709 13:11:02.258167 29246 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:02.406351 29291 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.407791 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.416002 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.422930 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:02.269065 29262 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.987s	user 0.010s	sys 0.004s
I20260709 13:11:02.433323 29318 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:02.435896 29232 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.018s
I20260709 13:11:02.425199 29300 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.469666 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:02.381402 29284 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.466491 29302 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:02.479609 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 427570us
I20260709 13:11:02.475549 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.449141 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:02.441615 29296 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:02.484412 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 190037us
I20260709 13:11:02.480937 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.487003 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:02.402467 29184 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.478374 27151 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:02.381695 29277 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.515515 27223 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.500566 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2485) took 1216 ms. Trace:
I20260709 13:11:02.516631 27150 rpcz_store.cc:276] 0709 13:11:01.283663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.283780 (+   117us) service_pool.cc:224] Handling call
0709 13:11:01.300574 (+ 16794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.441613 (+1141039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.500319 (+ 58706us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400139a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:02.500501 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622656256}
W20260709 13:11:02.501101 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72983.2us
W20260709 13:11:02.501230 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52273.7us
I20260709 13:11:02.417817 29314 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.518617 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.502995 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.508615 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.513202 29303 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:02.521039 29303 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.480329 29209 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:02.524824 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.539572 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.514721 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.550107 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.546298 27149 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:02.569037 27154 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.518455 29291 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:02.571519 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47765.3us
I20260709 13:11:02.487450 29262 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.582746 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.597422 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:02.600728 27805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.018s	sys 0.027s
W20260709 13:11:02.601208 27805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.018s	sys 0.028s
I20260709 13:11:02.500120 29232 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:02.571738 29234 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.203s	user 0.023s	sys 0.005s
I20260709 13:11:02.608253 29234 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.604519 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:02.511648 29316 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.607146 29261 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.573552 29317 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.607390 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.604915 29291 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:02.616780 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:02.605785 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 87258.2us
I20260709 13:11:02.611963 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:02.612860 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:02.573238 29279 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:02.616974 27148 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.620934 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.621299 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.623278 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.624603 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.624737 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.626802 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 476) took 1366 ms. Trace:
I20260709 13:11:02.545452 29209 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.629196 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.634755 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.627182 27149 rpcz_store.cc:276] 0709 13:11:01.260161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.260284 (+   123us) service_pool.cc:224] Handling call
0709 13:11:01.262134 (+  1850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.568690 (+1306556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.626562 (+ 57872us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400069fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:02.626741 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952673664}
W20260709 13:11:02.616588 29295 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.250s	user 0.015s	sys 0.000s
W20260709 13:11:02.617430 29202 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.976s	user 0.009s	sys 0.009s
I20260709 13:11:02.638346 29315 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.613951 29302 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:02.615351 29234 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.652491 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.660706 27151 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.629846 29318 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.622684 29184 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.627437 29263 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.627244 29319 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.653791 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.663636 29310 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.664337 29328 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.633121 29270 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.642275 29279 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:02.615980 29329 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.163s
I20260709 13:11:02.686638 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.696084 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.697862 29059 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:02.687290 29289 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.004s
I20260709 13:11:02.700042 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:02.649909 29295 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:02.641175 29320 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:11:02.703161 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74038.8us
I20260709 13:11:02.655555 29202 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.687959 29261 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:02.706622 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:02.705166 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 70545.7us
I20260709 13:11:02.715498 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.658097 29332 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:02.720000 27304 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:02.724390 29262 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:02.725657 29278 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.082s	user 0.009s	sys 0.001s
I20260709 13:11:02.727481 29276 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.728332 29277 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.730124 29202 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.730204 29284 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.714248 29291 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.768316 29232 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:02.766515 29270 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.769615 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:02.730688 29326 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.731205 29261 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.732456 29318 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:02.778295 29318 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:02.778373 29209 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.671914 29302 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.735571 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.736696 29311 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.737144 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:02.737138 29184 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:02.738931 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1908) took 1696 ms. Trace:
I20260709 13:11:02.745726 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.780591 27148 rpcz_store.cc:276] 0709 13:11:01.042111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.042258 (+   147us) service_pool.cc:224] Handling call
0709 13:11:01.045916 (+  3658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.621260 (+1575344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.738676 (+117416us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003a0cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:02.738856 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3612542848}
I20260709 13:11:02.748035 29295 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:02.748994 29281 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.077s	user 0.004s	sys 0.009s
I20260709 13:11:02.750214 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:02.787070 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51589.5us
I20260709 13:11:02.787946 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:02.751305 29235 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.002s
W20260709 13:11:02.751454 29282 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.127s	user 0.014s	sys 0.011s
I20260709 13:11:02.752049 29332 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:02.752758 29305 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.033s	user 0.000s	sys 0.014s
I20260709 13:11:02.753906 29236 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:02.754881 29283 consensus_meta.cc:287] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.221s	user 0.013s	sys 0.000s
I20260709 13:11:02.755371 29296 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.755571 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:02.756572 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50002.6us
I20260709 13:11:02.760994 29303 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.762213 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:02.762220 29272 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.111s	user 0.010s	sys 0.005s
W20260709 13:11:02.763357 29230 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.798s	user 0.008s	sys 0.003s
I20260709 13:11:02.732699 29325 tablet_copy_client.cc:323] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.129:38249
I20260709 13:11:02.781407 29184 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:02.784152 29302 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.784180 29284 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:02.788955 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:02.833143 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44246us
I20260709 13:11:02.705286 29289 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.786235 29312 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:02.790475 29327 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.762776 29279 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.851179 29236 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.801223 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.779333 29318 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.802438 29303 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:02.856534 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 55400.5us
I20260709 13:11:02.802312 29283 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:02.802644 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 91926.7us
I20260709 13:11:02.857344 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:02.860992 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.798929 29305 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.794790 29282 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:02.791857 29329 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:02.795352 29235 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.806566 29332 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.870334 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.871030 27154 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:02.795719 29281 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:02.807672 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:02.767364 29278 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.817850 27156 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.834661 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:02.821069 29184 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:02.840958 29321 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.821900 29230 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.863096 29295 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:02.871627 29304 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.154s	user 0.014s	sys 0.004s
I20260709 13:11:02.862949 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:02.848866 29312 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:02.855429 29290 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.064s	user 0.011s	sys 0.003s
I20260709 13:11:02.869120 29235 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:02.870561 27299 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.869791 29270 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:02.879349 27155 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.880378 27232 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:02.881397 29283 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:02.882781 27157 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:02.888262 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 53737.5us
I20260709 13:11:02.861557 27153 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:02.861634 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.040822 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:03.042693 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:02.872213 29273 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.016403 27227 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:02.869638 29261 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:03.026489 27150 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
I20260709 13:11:02.870373 29232 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:11:02.807116 29272 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:02.866775 29314 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:03.043853 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 182259us
I20260709 13:11:02.869131 29330 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.044977 29059 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.061558 29059 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:03.062019 29059 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.032838 29317 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:03.024341 29329 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.057533 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.082932 27153 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 2: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:03.082607 29317 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.084048 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.084642 27149 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.084997 29317 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.055075 29322 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.085588 29322 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:02.866319 29326 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.174s
I20260709 13:11:03.085899 29272 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.086637 29326 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.059387 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.087075 27226 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.088140 29314 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.088626 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.028764 29312 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:03.060745 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.057938 29333 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:03.034889 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.092600 27154 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:03.030455 29318 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.064198 29339 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.065245 29232 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:03.096985 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 381594us
I20260709 13:11:03.099052 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.066592 29305 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.045310 29303 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.067582 29289 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.068043 29295 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:03.030015 29304 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:03.038901 29290 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.088085 29327 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.064369 29316 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.085269 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.065949 29230 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.102788 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.090734 29312 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:03.087059 29326 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:03.113946 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.124611 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 463) took 1136 ms. Trace:
I20260709 13:11:03.113381 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:03.086016 29322 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.126505 27153 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:03.118669 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.108515 29209 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:03.126483 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.125000 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.125003 27226 rpcz_store.cc:276] 0709 13:11:01.988300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.988418 (+   118us) service_pool.cc:224] Handling call
0709 13:11:02.061703 (+ 73285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.087618 (+1025915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.124390 (+ 36772us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001ba154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:03.124551 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359212416}
I20260709 13:11:03.106419 29330 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:03.127821 27150 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:03.116763 29295 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:03.114476 29236 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.132189 29282 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:03.132440 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.134584 27152 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:03.128842 29281 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:03.130174 29254 tablet_copy_client.cc:538] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:03.111866 29337 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.123903 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.121315 29311 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.111714 29232 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.123175 29333 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.175995 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.152781 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.156211 27300 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.183841 29059 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.159490 27298 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.156905 27302 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.150601 29303 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:03.132483 29305 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.167325 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.187572 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.167799 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.115451 29302 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:11:03.193128 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.201787 29059 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.202435 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.160209 29282 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.211047 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2445) took 1521 ms. Trace:
I20260709 13:11:03.211510 27227 rpcz_store.cc:276] 0709 13:11:01.689319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.698274 (+  8955us) service_pool.cc:224] Handling call
0709 13:11:01.698681 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.046568 (+1347887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.210823 (+164255us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001dabd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:03.210985 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3029746944}
I20260709 13:11:03.207878 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.207991 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1916) took 1548 ms. Trace:
I20260709 13:11:03.150990 29304 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:03.213024 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:03.209585 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 96275.9us
I20260709 13:11:03.154264 29312 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.212152 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.212627 27155 rpcz_store.cc:276] 0709 13:11:01.660028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.660470 (+   442us) service_pool.cc:224] Handling call
0709 13:11:01.660856 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.046876 (+1386020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.207756 (+160880us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400099054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:03.207930 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2801568128}
I20260709 13:11:03.180439 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.213598 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.214283 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1492) took 1222 ms. Trace:
I20260709 13:11:03.218266 29273 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.212874 27303 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:03.218626 27306 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.175854 29184 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.219015 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.241627 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.262805 27301 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.263839 29184 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.219233 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.224135 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.201301 29236 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.226712 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.227365 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.227890 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.276191 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.234601 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:03.278352 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 43983.7us
I20260709 13:11:03.279342 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:03.280546 27301 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:03.238864 27150 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.234440 27299 rpcz_store.cc:276] 0709 13:11:01.984631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.984738 (+   107us) service_pool.cc:224] Handling call
0709 13:11:02.005655 (+ 20917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.032982 (+1027327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.206600 (+173618us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54000ea454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:03.206804 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988600576}
I20260709 13:11:03.258667 29331 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.281663 29331 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:03.282028 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.282894 27299 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:03.283831 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.283842 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.283020 29331 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:03.284477 27299 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.284673 27301 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.260186 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.267349 27157 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:03.226358 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.260180 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.263877 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:03.272881 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59906.7us
I20260709 13:11:03.274682 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.189514 29303 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:03.289460 27304 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:03.236012 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 193356us
W20260709 13:11:03.259262 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.280504 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:03.208407 29278 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.287701 27269 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.291579 27227 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.291805 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.292986 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.293093 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.306200 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.151872 29349 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 13:11:03.155462 29295 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:03.311882 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.278393 29339 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.315855 27152 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.293764 29303 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.321028 27301 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:03.287231 29282 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.318569 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:03.330663 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:03.293589 29273 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.306042 29236 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.312844 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.371750 27306 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 2: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:03.308980 29317 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:03.402607 29350 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:03.403369 29350 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:03.403900 29350 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.407003 29354 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:03.407765 29354 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:03.408283 29354 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.299437 29235 consensus_queue.cc:1059] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:11:03.322371 29281 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.380475 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.327899 29278 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:11:03.380679 29262 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.380932 29272 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:03.439224 29254 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:11:03.468475 29350 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.397841 29339 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 13:11:03.470829 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 69525.3us
I20260709 13:11:03.472172 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.473687 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.476774 27806 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.313877 29300 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:11:03.434834 27167 tablet_copy_service.cc:140] P 1010256288ec4502b330749e2e3d7c85: Received BeginTabletCopySession request for tablet 9f9dfa4361254d838c2b61576ada60f4 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:47438)
I20260709 13:11:03.317548 29311 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 13:11:03.440655 29290 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.443186 29232 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:03.469452 29354 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.278582 29330 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:03.509845 29353 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.513947 29235 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:03.479303 27228 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:03.527760 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 247335us
I20260709 13:11:03.523384 29184 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:03.529201 29350 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:03.529594 29184 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:03.530261 29333 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:03.530869 29333 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.531991 29333 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.532294 29184 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:03.533118 29330 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.535641 27299 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:03.443289 27836 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
W20260709 13:11:03.535985 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 59272.3us
I20260709 13:11:03.495339 29262 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:03.512075 29302 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:03.537756 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 158583us
W20260709 13:11:03.538403 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 165687us
I20260709 13:11:03.539513 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:03.526122 29264 tablet_copy_client.cc:538] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:03.547425 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.525882 27167 tablet_copy_service.cc:161] P 1010256288ec4502b330749e2e3d7c85: Beginning new tablet copy session on tablet 9f9dfa4361254d838c2b61576ada60f4 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:47438: session id = f4afe81810944d70bc2cc31754392f3d-9f9dfa4361254d838c2b61576ada60f4
I20260709 13:11:03.558431 29262 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.536590 29235 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.510404 29324 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:11:03.587590 27155 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:03.588812 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.592931 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:03.594123 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 278014us
I20260709 13:11:03.595127 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:03.597543 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 58121.6us
I20260709 13:11:03.596678 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.598348 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:03.600445 27156 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:03.604704 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:03.605260 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52777.4us
I20260709 13:11:03.576488 29272 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:03.609433 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 62103.5us
I20260709 13:11:03.611864 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.614970 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.617794 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.641251 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:03.642683 27231 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.608407 29318 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.646368 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:03.648178 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.640561 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:03.654796 27155 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:03.657867 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:03.661417 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.662943 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.605520 29349 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:03.662358 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.666095 27232 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:03.664388 29272 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.608683 29332 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.701470 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.698014 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:03.699342 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 406295us
I20260709 13:11:03.668550 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:03.581377 29356 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:11:03.635083 29359 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.651830 29351 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.711787 29333 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.701359 29350 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:11:03.720772 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55263.9us
I20260709 13:11:03.722189 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.722613 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.634616 29357 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:11:03.725953 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.654184 29265 tablet_copy_client.cc:538] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:03.728497 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.729075 27833 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.730129 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.730378 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.730706 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.697575 29360 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:03.731321 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.729844 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:03.731961 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 122862us
I20260709 13:11:03.732933 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.656579 29230 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:11:03.734841 27303 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.667306 29184 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:11:03.652031 29358 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:11:03.738822 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.740559 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:03.741997 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:03.742938 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:03.751930 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:03.747267 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.753960 27838 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.758563 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.759042 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.759892 27302 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:03.760048 27167 tablet_copy_source_session.cc:215] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:03.764223 29350 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:03.764539 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:03.765300 27297 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:03.765821 29359 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.766261 29359 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:03.766382 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:03.768172 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.767231 29359 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.770439 29351 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.770849 29351 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:03.773339 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:03.771688 29333 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:03.777920 29184 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:03.778504 29184 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:03.779671 29184 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.782198 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:03.782847 27303 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:03.705639 29316 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:03.746592 29354 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:03.792071 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44602.6us
I20260709 13:11:03.793162 29184 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:03.794368 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.795657 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:03.797538 29333 consensus_queue.cc:1243] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:03.798275 29357 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.798978 29357 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:03.799666 29357 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.801381 29333 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:03.802603 29333 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.803072 29333 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:03.804174 29333 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.807730 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:03.808528 27223 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:03.805909 29333 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:03.753211 29365 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.821321 27231 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:03.826543 29337 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:03.824882 27838 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:03.739823 29360 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:03.980911 29235 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:04.003961 29282 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.005319 29296 raft_consensus.cc:3055] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:04.010387 29303 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.003s
I20260709 13:11:04.021339 29344 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.025490 29279 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.023236 29326 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:04.027740 29279 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:03.823983 29353 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.979382 29263 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:03.833421 29337 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.026428 29296 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:04.034024 27833 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:04.028782 29360 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.103082 27837 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.038859 29344 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:04.126116 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 477987us
I20260709 13:11:04.129151 29375 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:04.129606 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 361152us
I20260709 13:11:04.135347 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:04.135519 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 395021us
I20260709 13:11:04.135783 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:04.137168 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.137568 29360 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.138140 29369 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.138324 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.138773 27150 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.140015 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:04.140705 27836 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.142702 29360 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.147217 29325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9dfa4361254d838c2b61576ada60f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:04.148589 29369 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.150290 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.150821 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:04.151306 29371 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:04.130510 29375 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.152153 29360 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:04.152570 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.153330 29371 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:04.151831 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.154011 29375 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.158550 29353 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.158769 27833 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:04.159325 27836 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:04.159101 29353 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.160182 29329 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:04.160727 29329 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.163200 29353 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.163669 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.163220 29329 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.164463 29284 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.166326 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.167237 29371 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.166440 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.170334 29383 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.171066 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.171312 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:04.172650 27836 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.173617 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:04.173950 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:04.029734 29303 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.174636 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.174963 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:04.176640 29375 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.176256 29344 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:04.176992 29284 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.177366 29375 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:04.177529 29284 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:04.178467 29375 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.178623 29284 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.177785 29344 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.184479 29371 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:04.186277 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:04.188921 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 457091us
I20260709 13:11:04.192849 27834 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:04.192970 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.194257 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.197999 29329 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.199497 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:04.201808 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.203126 29363 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.203505 27152 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:04.204135 29263 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.207803 29265 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:11:04.202308 29316 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.210001 29262 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.200279 29296 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:04.232095 29263 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.232508 29363 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:04.231267 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.233024 29349 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.253021 29355 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.253473 29355 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.230830 29320 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.260807 29322 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.127s	user 0.009s	sys 0.003s
I20260709 13:11:04.212985 27301 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 2: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:04.235263 29369 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.242916 29059 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:04.243183 29368 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.243573 29302 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.244419 29350 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:04.245025 29331 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.245577 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:04.230892 29329 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.251652 29349 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.247496 29365 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.256862 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:04.189045 29383 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.261269 29322 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.305837 29059 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:04.258922 29363 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.261672 29303 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.257848 29320 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.230845 29270 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.310482 29329 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:04.312777 27805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.015s
I20260709 13:11:04.287626 29302 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.294663 29350 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.240628 29262 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.336824 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:04.254492 29355 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.320219 27807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.014s
W20260709 13:11:04.311666 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.349752 27807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.011s	sys 0.014s
W20260709 13:11:04.327838 27805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.003s	sys 0.015s
W20260709 13:11:04.350418 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 554795us
I20260709 13:11:04.327728 27230 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.303781 29369 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.316689 29365 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:04.330559 27195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.010s	sys 0.013s
I20260709 13:11:04.330099 29279 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.365685 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.330075 29329 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.367481 27231 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.348923 29264 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:11:04.344817 29059 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.196048 29337 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.314896 27122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.018s
W20260709 13:11:04.364416 27195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.010s	sys 0.020s
I20260709 13:11:04.363634 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:04.376533 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.377295 27122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.021s
W20260709 13:11:04.377930 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 595801us
I20260709 13:11:04.379657 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.385402 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.386330 27303 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:04.386693 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:04.387564 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:04.370972 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.389268 27306 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:04.329975 29270 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.401852 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:04.367460 29320 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:04.400076 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:04.400341 27299 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.400137 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.364686 29349 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.310920 29368 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.529939 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:04.401566 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.522338 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.535014 27306 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:04.524338 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 82534us
I20260709 13:11:04.392218 29279 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:04.528168 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:04.528842 27305 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.533308 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.539511 27228 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.575287 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:04.541973 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 140518us
I20260709 13:11:04.540602 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.529908 29302 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.600275 29360 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:04.527328 29330 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.994s	user 0.017s	sys 0.000s
W20260709 13:11:04.601665 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61144.2us
I20260709 13:11:04.603076 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.608667 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.520746 29355 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.614531 29368 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:04.615392 29368 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.616268 29368 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.617722 27231 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.617949 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:04.600898 29327 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:04.627225 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.536968 29337 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.586213 29353 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.592725 29370 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:04.632418 29370 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.632966 29370 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:04.642072 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.586443 29284 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.593734 29301 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:04.655750 27229 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:04.586292 29379 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:04.446328 29350 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.671093 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 135089us
W20260709 13:11:04.674026 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.676079 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.660529 29349 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.654481 29353 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:04.687130 29295 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.688172 27841 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:04.669463 29284 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.691083 27226 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:04.692270 29284 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:04.663937 29261 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.609941 29316 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:11:04.659297 29301 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:04.705107 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.716188 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:04.716300 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:04.705420 27195 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.718036 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.719604 29317 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:04.732620 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.681182 29322 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:04.695642 29353 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.741083 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.607256 29279 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.709702 29369 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:04.703601 29262 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:04.750983 29381 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.703994 29261 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:04.749842 29391 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:11:04.735152 27836 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:11:04.757236 29348 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.757941 29385 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:04.758637 29382 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:04.731524 29295 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:04.706947 29284 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:11:04.738348 29327 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.737339 29235 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.733151 29317 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:04.774242 29317 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.775573 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.717368 29281 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:04.755005 29236 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:04.782120 29236 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:04.754043 29279 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.769802 29327 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.780249 29284 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:04.785727 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:04.792465 29236 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.793601 29236 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:04.797323 29327 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.797186 29329 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.761440 27836 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:04.770185 29316 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.663091 29365 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.776723 29391 consensus_queue.cc:1243] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:04.777050 29295 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:04.809075 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:04.803542 27298 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:04.806181 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.798331 29284 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:04.810623 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:04.812459 27150 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:04.812665 29284 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.814095 29284 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.814352 29347 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:04.814956 29347 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.815315 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:04.818506 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.819322 29381 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.819486 29344 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.820132 29344 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.827039 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 218415us
I20260709 13:11:04.828668 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:04.833938 27231 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:04.835801 27841 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:04.837435 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.837980 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:04.839922 29394 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:04.841807 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:04.866463 29344 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:04.867442 29344 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:04.868095 29344 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:04.809490 29383 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:04.878073 27195 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:04.872408 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:04.890475 29295 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.863322 29339 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:11:04.783156 29370 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.871130 29320 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.788578 29382 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.778894 29385 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:04.869346 29344 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:04.972514 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 94633.6us
I20260709 13:11:04.906679 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:04.937620 29331 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.005s
I20260709 13:11:04.846117 29301 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:04.899713 29281 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.040350 29301 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.894510 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:05.039202 29388 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.040169 27152 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:04.913627 29232 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:04.969254 29311 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.031931 29364 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.093642 27152 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:05.062305 29326 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.036505 29347 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.165557 29264 tablet_bootstrap.cc:700] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent opening tablet: real 0.156s	user 0.005s	sys 0.000s
I20260709 13:11:05.128201 29232 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.168637 29232 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.172509 29279 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.176218 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 744) took 1435 ms. Trace:
I20260709 13:11:05.176801 27839 rpcz_store.cc:276] 0709 13:11:03.740859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.175062 (+1434203us) service_pool.cc:224] Handling call
0709 13:11:05.175523 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.175764 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.175801 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.175863 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:05.175930 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.176000 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.176137 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:05.139585 27152 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.151473 29300 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:05.185331 27839 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:05.128175 29311 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.187427 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:05.151166 29329 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.197696 27839 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.109252 29320 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.200351 27152 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:04.908313 29383 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:05.207036 29311 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.140156 29364 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:05.228819 29387 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:11:05.234237 29355 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.001s
I20260709 13:11:05.246348 27152 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:11:05.244480 29333 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.314s	user 0.013s	sys 0.000s
I20260709 13:11:05.250252 29261 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.252442 29383 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.130038 29388 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:05.255338 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 440065us
I20260709 13:11:05.272603 29347 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:05.202876 29300 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.283707 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:05.294210 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.295042 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.296443 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.274716 29320 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.287750 27297 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.323220 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:05.327339 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:05.333396 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:05.297829 29382 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.337064 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:05.338876 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:05.346688 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:05.342437 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:05.349597 27152 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.351225 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:05.352823 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:05.351920 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:05.354511 29059 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.353451 27300 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:05.356608 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1630) took 1695 ms. Trace:
I20260709 13:11:05.356493 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:05.326413 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:05.357053 27230 rpcz_store.cc:276] 0709 13:11:03.660876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.668181 (+  7305us) service_pool.cc:224] Handling call
0709 13:11:03.668492 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.352235 (+683743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.356356 (+1004121us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540037a354. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:05.356539 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515590016}
I20260709 13:11:05.361060 27304 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:05.363036 27226 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:05.365715 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 510519us
I20260709 13:11:05.371446 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:05.355718 29324 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.359180 29232 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.378214 27054 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 382) took 4135 ms. Trace:
W20260709 13:11:05.371002 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.368569 29316 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.002s
W20260709 13:11:05.381673 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.359216 29385 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.375779 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:05.404800 27835 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 2: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:05.388898 29304 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:05.389789 29316 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:05.418000 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:05.390391 29232 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:05.376756 29388 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.397818 29363 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:05.436422 27122 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.556s (SENT)
I20260709 13:11:05.458257 27152 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
W20260709 13:11:05.429438 29353 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.002s
I20260709 13:11:05.421083 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:05.400115 29311 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:05.378029 29324 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.460846 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:05.450281 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:05.423302 29396 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:11:05.420862 29398 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:05.369302 29351 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:05.584954 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 187658us
I20260709 13:11:05.460006 29363 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.585592 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 746) took 1844 ms. Trace:
I20260709 13:11:05.588729 27837 rpcz_store.cc:276] 0709 13:11:03.741398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.989023 (+247625us) service_pool.cc:224] Handling call
0709 13:11:04.102815 (+113792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.106329 (+  3514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.585360 (+1479031us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540074a250. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:05.585534 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239497472}
W20260709 13:11:05.419145 29325 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.094s	user 0.012s	sys 0.002s
I20260709 13:11:05.430713 29304 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.589785 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:05.508462 27835 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:05.493592 29265 tablet_bootstrap.cc:700] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Time spent opening tablet: real 0.170s	user 0.002s	sys 0.000s
W20260709 13:11:05.496647 29349 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.001s
I20260709 13:11:05.506937 29360 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.505991 29232 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:05.596484 29263 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.596693 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:05.598759 29304 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.599116 29351 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.615556 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:05.601475 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 165114us
I20260709 13:11:05.378731 27054 rpcz_store.cc:276] 0709 13:11:01.242551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.243109 (+   558us) service_pool.cc:224] Handling call
0709 13:11:01.276654 (+ 33545us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b540022ff10. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec130b2 00007f9a57b8ca89 00007f9a57b24da6 00007f9a57af6088 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc
0709 13:11:05.378141 (+4101487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:01.509466 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:01.723423 (+213957us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:01.762384 (+ 38961us) write_op.cc:435] Acquired schema lock
0709 13:11:01.763897 (+  1513us) tablet.cc:662] Decoding operations
0709 13:11:01.866211 (+102314us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:01.869052 (+  2841us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:01.872040 (+  2988us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:01.910624 (+ 38584us) tablet.cc:701] Row locks acquired
0709 13:11:01.915496 (+  4872us) write_op.cc:260] PREPARE: finished
0709 13:11:01.949270 (+ 33774us) write_op.cc:270] Start()
0709 13:11:01.956870 (+  7600us) write_op.cc:276] Timestamp: P: 1783602661949168 usec, L: 0
0709 13:11:01.958892 (+  2022us) op_driver.cc:348] REPLICATION: starting
0709 13:11:02.199487 (+240595us) log.cc:844] Serialized 603 byte log entry
0709 13:11:02.621668 (+422181us) op_driver.cc:464] REPLICATION: finished
0709 13:11:02.784770 (+163102us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18003889c0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a51cb4190 00007f9a51cadae7 00007f9a51cacdd9
0709 13:11:02.840998 (+ 56228us) write_op.cc:301] APPLY: starting
0709 13:11:02.841184 (+   186us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:02.841348 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:02.841385 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:02.841839 (+   454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:02.855575 (+ 13736us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:02.863339 (+  7764us) write_op.cc:312] APPLY: finished
0709 13:11:02.867577 (+  4238us) log.cc:844] Serialized 23 byte log entry
0709 13:11:02.867830 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:02.867958 (+   128us) write_op.cc:454] Released schema lock
0709 13:11:02.868015 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:02.889107 (+ 21092us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:02.891218 (+  2111us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":5510016,"child_traces":[["op",{"apply.queue_time_us":181964,"apply.run_cpu_time_us":2885,"apply.run_wall_time_us":56781,"num_ops":1,"prepare.queue_time_us":133391,"prepare.run_cpu_time_us":17359,"prepare.run_wall_time_us":986190,"raft.queue_time_us":131189,"raft.run_cpu_time_us":17332,"raft.run_wall_time_us":217442,"replication_time_us":613711,"spinlock_wait_cycles":9195904,"thread_start_us":452354,"threads_started":4,"wal-append.queue_time_us":183707,"wal-append.run_cpu_time_us":68111,"wal-append.run_wall_time_us":1588193}]]}
I20260709 13:11:05.591706 29363 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:05.608238 29337 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.947s	user 0.013s	sys 0.001s
I20260709 13:11:05.583935 29398 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.504714 29300 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:05.625403 27833 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:05.592474 27836 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:11:05.608721 29278 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.484540 29353 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.609675 29396 consensus_queue.cc:1243] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:05.607020 29344 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:05.627648 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 752) took 1094 ms. Trace:
I20260709 13:11:05.614012 29282 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.651645 27839 rpcz_store.cc:276] 0709 13:11:04.532742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.202907 (+670165us) service_pool.cc:224] Handling call
0709 13:11:05.203263 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.266043 (+ 62780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.266116 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.266185 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:05.266244 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.627299 (+361055us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b5400660154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:05.627374 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.627566 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22877,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11186,"spinlock_wait_cycles":143282560}
I20260709 13:11:05.648559 29402 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.682160 29402 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.683211 29350 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.676141 29399 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:05.676160 29352 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.717717 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.718425 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.817236 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.686333 29399 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.679921 29282 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:05.686435 29352 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.834378 27839 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:05.674423 29360 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:05.847826 27834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 737) took 2606 ms (client timeout 1556 ms). Trace:
I20260709 13:11:05.834546 29184 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.856516 29184 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:05.834661 29349 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.855000 27834 rpcz_store.cc:269] 0709 13:11:03.226241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.226420 (+   179us) service_pool.cc:224] Handling call
0709 13:11:05.832631 (+2606211us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:05.832845 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108953984}
I20260709 13:11:05.838359 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35852 (request call id 712) took 4042 ms. Trace:
I20260709 13:11:05.834867 29292 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:05.845705 29305 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.861446 29274 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:05.868153 29399 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:05.868880 29400 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:05.874043 29274 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.875041 29353 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:05.887755 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.888785 29274 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:05.902154 29398 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:05.909111 29327 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.111s	user 0.015s	sys 0.001s
W20260709 13:11:05.910894 29301 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.870s	user 0.008s	sys 0.010s
I20260709 13:11:05.911674 29398 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.912321 29398 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.923456 29370 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.900157 29399 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.859350 29360 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.867362 29349 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.939616 29282 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.875659 29305 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:05.861616 29325 rpcz_store.cc:276] 0709 13:11:01.792907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.793137 (+   230us) service_pool.cc:224] Handling call
0709 13:11:02.476324 (+683187us) ts_tablet_manager.cc:934] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
0709 13:11:04.143763 (+1667439us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:04.304247 (+160484us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:04.311192 (+  6945us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:05.606193 (+1295001us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:05.624671 (+ 18478us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:05.690212 (+ 65541us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:05.835251 (+145039us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33141,"tablet-copy.queue_time_us":428183,"thread_start_us":304033,"threads_started":2}
I20260709 13:11:05.869834 29292 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:05.949043 29324 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:05.950609 27804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.133s	sys 0.159s
I20260709 13:11:05.955205 29352 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.909763 29327 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:05.959820 27804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.133s	sys 0.159s
W20260709 13:11:05.963640 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 514969us
W20260709 13:11:05.960043 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.960646 27195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.064s	sys 0.132s
W20260709 13:11:05.966151 27195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.064s	sys 0.132s
I20260709 13:11:05.972847 27150 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.973405 27150 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:05.974570 27150 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:05.975931 27150 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.981407 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:05.984869 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:05.944451 29399 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:05.993789 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.966225 29325 tablet_copy_client.cc:806] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:05.995157 27841 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:05.957571 29370 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:05.993831 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.001560 27155 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:05.999136 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.003106 27154 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:06.004467 29235 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.007720 29235 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.019966 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:06.022169 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.013326 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1632) took 1832 ms. Trace:
I20260709 13:11:06.026705 27229 rpcz_store.cc:276] 0709 13:11:04.181100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.181438 (+   338us) service_pool.cc:224] Handling call
0709 13:11:04.181761 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.660288 (+478527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.012991 (+1352703us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54001257d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:06.013244 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030186752}
I20260709 13:11:06.010174 29184 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:05.987361 29324 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:05.937718 29400 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.035310 29284 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.036032 29184 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.036413 29274 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.032300 29325 tablet_copy_client.cc:670] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:06.018765 29301 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.030680 29326 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.882s	user 0.014s	sys 0.005s
I20260709 13:11:06.036602 29254 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:06.065258 29274 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.041699 29375 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:06.021565 29370 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.086033 29305 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.089465 29393 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.090104 29393 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.059345 29402 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.048043 29324 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:06.131052 27807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.023s	sys 0.048s
W20260709 13:11:06.144878 27807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.024s	sys 0.049s
I20260709 13:11:06.059530 29284 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:06.147982 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.148207 29351 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.148854 29263 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.081581 29375 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:06.149605 29263 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:06.148782 29351 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.080336 29289 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.150314 29282 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.121929 27150 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:06.151999 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:06.153514 29263 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:06.143654 27297 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.799s	user 0.003s	sys 0.014s
I20260709 13:11:06.155316 27154 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:06.155920 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.157936 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.079229 29235 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.067821 29184 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:06.163236 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:06.092023 29292 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.144228 29254 tablet_bootstrap.cc:492] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:11:06.091275 29295 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.079833 29301 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.179441 29375 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.213160 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.180001 29399 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.171669 29353 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.213845 27149 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:06.170251 29289 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:06.210199 27835 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:06.169622 27297 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:06.164429 29315 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:06.187878 29184 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.188767 29279 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.189613 29351 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.212432 29348 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.191318 29324 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.192126 29377 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.230659 29400 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.230471 29377 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.231765 29360 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.232889 29377 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.234858 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 577) took 1400 ms. Trace:
I20260709 13:11:06.235267 27841 rpcz_store.cc:276] 0709 13:11:04.834514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.873309 (+ 38795us) service_pool.cc:224] Handling call
0709 13:11:06.234587 (+1361278us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400721854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:06.234760 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2347524480}
I20260709 13:11:06.169749 29282 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:06.238972 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 992) took 2067 ms (client timeout 1948 ms). Trace:
W20260709 13:11:06.239432 27833 rpcz_store.cc:269] 0709 13:11:04.171638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.173329 (+  1691us) service_pool.cc:224] Handling call
0709 13:11:06.238783 (+2065454us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400720bd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:06.238897 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336581504}
I20260709 13:11:06.242285 29348 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.243508 27837 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:06.164670 29276 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.245153 29276 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.247345 29276 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:06.194265 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 1936) took 2464 ms (client timeout 1902 ms). Trace:
I20260709 13:11:06.195639 29284 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.199942 27836 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:06.201236 29274 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.202564 29412 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.202788 29370 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.206355 29295 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.260362 29399 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:06.274955 29399 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:06.275902 29399 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.276373 29295 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:06.208529 29388 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:11:06.162492 29311 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.277311 29399 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:06.201983 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.212052 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.216229 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.217689 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.181113 29292 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.182235 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:06.173763 29408 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:06.215071 29350 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 13:11:06.219874 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.329011 27157 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:11:06.329375 27227 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.223567 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.190840 29372 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:06.218513 29363 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.593s	user 0.016s	sys 0.000s
I20260709 13:11:06.346383 29363 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.348481 29372 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:06.224922 29254 ts_tablet_manager.cc:1403] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 2.786s	user 0.049s	sys 0.040s
I20260709 13:11:06.227841 29349 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.229887 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 991) took 2058 ms. Trace:
I20260709 13:11:06.372181 27269 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:06.242663 27055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 334) took 4687 ms. Trace:
I20260709 13:11:06.193041 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 489) took 1522 ms. Trace:
W20260709 13:11:06.248113 27298 rpcz_store.cc:269] 0709 13:11:03.729616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.729738 (+   122us) service_pool.cc:224] Handling call
0709 13:11:06.194022 (+2464284us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540031c9d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:06.194159 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260087680}
I20260709 13:11:06.262516 27154 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:06.223924 29327 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:06.265554 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 94479.6us
I20260709 13:11:06.259176 29393 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.283938 29264 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:06.244593 29348 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.249032 29375 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.297351 27149 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:06.291503 27155 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:06.298538 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:06.300892 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.302330 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.311847 29365 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.313616 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.315687 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.267102 29416 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.323833 29301 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.324681 29407 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:06.222529 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:06.218796 29353 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.330953 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.341522 29364 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.342152 29408 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.266103 29284 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.345799 29282 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.361740 27153 raft_consensus.cc:2368] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:06.437184 29369 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.438616 29369 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.439724 29353 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.440687 27232 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:06.436403 29350 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.441486 29350 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.442090 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.442795 27232 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:06.375213 27055 rpcz_store.cc:276] 0709 13:11:01.555183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.559473 (+  4290us) service_pool.cc:224] Handling call
0709 13:11:06.242444 (+4682971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2285797,"reported_tablets":1}
I20260709 13:11:06.431294 29270 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.443743 29350 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.372249 27832 rpcz_store.cc:276] 0709 13:11:04.171360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.662567 (+491207us) service_pool.cc:224] Handling call
0709 13:11:04.680607 (+ 18040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.018565 (+1337958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.018597 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.018645 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:06.018706 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.229585 (+210879us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400477cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:06.229639 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.229822 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3076329344}
I20260709 13:11:06.444231 27225 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:06.444322 29350 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.444715 29284 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.444871 29350 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.446810 27224 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:06.446943 29284 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.437261 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 583) took 1072 ms. Trace:
I20260709 13:11:06.447824 27835 rpcz_store.cc:276] 0709 13:11:05.364604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.596346 (+231742us) service_pool.cc:224] Handling call
0709 13:11:06.437057 (+840711us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400660dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:06.437194 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373651712}
I20260709 13:11:06.441836 29289 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:06.449847 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.321708 29302 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.451181 29416 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.364884 29409 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.293891 29359 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.370888 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.436081 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:06.453866 27225 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.455560 27229 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:06.454035 27230 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:11:06.467573 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.478919 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.402562 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69994.5us
I20260709 13:11:06.443682 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.480775 27833 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:06.481137 27232 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:06.480790 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.482249 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.482024 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.480772 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:06.483600 27839 raft_consensus.cc:2376] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3. Re-sending same reply.
I20260709 13:11:06.483927 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1002) took 1142 ms. Trace:
I20260709 13:11:06.484603 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.484316 27834 rpcz_store.cc:276] 0709 13:11:05.341546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.860507 (+518961us) service_pool.cc:224] Handling call
0709 13:11:06.192113 (+331606us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:06.437442 (+245329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.437727 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.437753 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.437811 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.437863 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.437926 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.483715 (+ 45789us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400660dd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:06.483863 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568196864}
I20260709 13:11:06.486778 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.485891 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.442973 29264 tablet_bootstrap.cc:492] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:11:06.506039 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.409343 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:06.508606 27834 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:06.436585 29209 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.363945 29355 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.558463 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:06.564487 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 155220us
W20260709 13:11:06.557288 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.458725 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:06.464346 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 282160us
I20260709 13:11:06.509599 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.577082 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:06.571877 27839 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:06.580154 29355 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.581099 29399 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.582558 29230 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.583436 29416 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.584998 27297 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:06.585427 29209 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.375337 27231 rpcz_store.cc:276] 0709 13:11:04.670734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.671262 (+   528us) service_pool.cc:224] Handling call
0709 13:11:04.698144 (+ 26882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.834593 (+136449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.192791 (+1358198us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400218254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:06.192975 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311651072}
I20260709 13:11:06.486619 29347 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.200s
I20260709 13:11:06.296233 29412 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.801334 27050 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 378) took 5165 ms. Trace:
I20260709 13:11:06.394608 27228 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.466931 29284 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.788278 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:06.823570 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 314785us
I20260709 13:11:06.784353 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:06.421025 29324 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:06.716840 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:06.440732 29369 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.488206 29303 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:06.666702 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 77824.6us
I20260709 13:11:06.661787 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.854382 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.865584 27225 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
W20260709 13:11:06.854692 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 277722us
I20260709 13:11:06.832844 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.592473 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.868144 27303 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:06.832844 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.657454 27306 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:06.619837 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 161180us
I20260709 13:11:06.870620 27298 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:06.767613 29326 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.775499 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:06.877239 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.371649 29366 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.486961 29356 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.393172 29398 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.465997 29406 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.487179 29330 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.889365 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:06.852427 29350 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.784439 29264 ts_tablet_manager.cc:1403] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 2.450s	user 0.063s	sys 0.075s
I20260709 13:11:06.613065 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.716481 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:06.602012 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 119229us
I20260709 13:11:06.656674 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:06.834123 27050 rpcz_store.cc:276] 0709 13:11:01.535000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.544341 (+  9341us) service_pool.cc:224] Handling call
0709 13:11:06.699897 (+5155556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242221,"reported_tablets":5}
I20260709 13:11:06.399125 29295 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.452s
I20260709 13:11:06.935901 29295 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:06.936735 29292 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.002s
I20260709 13:11:06.588404 29363 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:06.694696 29282 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.694330 29364 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.784005 29400 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.509568 29389 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.354s
I20260709 13:11:06.840929 29408 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.884792 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.715793 29301 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.698712 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:06.421362 29349 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.956548 29301 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.957289 29349 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.850180 29230 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.958755 29230 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.959033 29301 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:06.952811 29400 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.960774 29235 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:06.961164 29235 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:06.919378 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.920596 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:06.962380 27306 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:06.962492 27298 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.882525 29316 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:06.882349 29415 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.916407 29398 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.882349 29326 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.924590 29406 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.925581 29330 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.921342 29385 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:11:06.858407 29327 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:06.873458 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:06.864825 29324 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.927212 27195 leader_election.cc:400] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:06.931846 27304 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:06.980358 27195 leader_election.cc:403] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.932595 27305 raft_consensus.cc:2376] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5. Re-sending same reply.
I20260709 13:11:06.937316 29292 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:06.874609 29393 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.964182 29347 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.946593 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.949580 27302 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:06.945580 29364 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.942106 29373 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:11:06.955690 29375 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.859308 29284 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:06.967276 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.938253 29381 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.004333 27301 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:06.985806 29324 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.880728 29369 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:06.965585 29235 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.015689 29364 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:06.944339 29350 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:06.950459 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.984161 27298 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
W20260709 13:11:06.984844 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57838.4us
I20260709 13:11:06.985821 27299 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:06.942531 29416 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:06.889678 29356 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.941670 29282 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.988454 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:06.999054 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.030958 27302 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.002696 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.007651 29381 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.985500 29407 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:06.993947 29408 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.011773 27303 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:07.004073 29375 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.988595 27835 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:06.975805 29316 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.977653 29415 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.021174 29284 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.026269 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.041394 29381 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.026269 27154 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:06.986421 29398 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.040922 29304 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.036616 27297 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:07.037241 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.037585 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.086702 27150 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:07.030303 27305 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:06.506899 29409 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:06.993450 29393 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.055646 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.029206 29350 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.066395 29316 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.013268 29264 raft_consensus.cc:359] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.070091 27149 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.027022 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.038519 29282 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.076333 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.107326 27154 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:06.872822 29399 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.079957 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.120116 27301 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:07.077339 29412 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.121734 27224 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:07.080509 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 147997us
I20260709 13:11:07.080410 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.081398 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.049981 29407 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.084024 29304 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:07.078017 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:07.085991 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.089808 27152 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.126653 27841 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:07.000412 29347 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.093655 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.018483 29369 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:07.095165 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 287522us
I20260709 13:11:07.097586 27157 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.098876 27306 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
W20260709 13:11:07.105401 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.143499 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.100093 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.123685 27299 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:07.081585 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.144459 27156 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:07.126034 27301 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:07.145362 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:07.146009 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.130250 29230 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.131919 27834 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:07.085585 29303 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:07.150406 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 276494us
I20260709 13:11:07.098156 29349 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.106287 29264 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:11:07.157799 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.161314 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.095099 29284 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:11:07.163422 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.152997 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.178067 27152 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:07.152158 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.119207 29316 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:07.163975 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.167549 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.183403 27157 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
W20260709 13:11:07.162313 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 52077us
I20260709 13:11:07.175843 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.184481 27156 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:07.185163 27303 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 2: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:07.181054 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.185685 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.186509 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:07.182462 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.146529 29209 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.187947 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.179843 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.154842 29416 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:07.186378 27151 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
I20260709 13:11:07.165247 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.200471 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:07.201768 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.209062 27299 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.214299 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.215224 27833 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:07.194041 29428 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.218838 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.219199 27839 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:07.220741 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.223366 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.193725 29406 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.193866 29305 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.191821 29430 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.201874 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:07.226225 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.193295 29330 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.197161 29184 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:07.234653 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.234769 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.191535 29316 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.200835 29423 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.240320 27223 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:07.270386 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:07.228094 29305 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.198477 29355 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.218863 29428 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.210233 29209 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:07.270584 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:07.248288 27832 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:07.238330 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.248207 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.249737 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.211084 29431 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.278580 29431 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.279057 29431 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.279356 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.280038 27226 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:07.280964 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.193243 29349 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:11:07.226321 29422 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.286226 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.199584 29416 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.200902 29304 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.288252 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:07.292117 27148 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:07.229424 29430 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.340628 29430 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.233515 29406 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:07.293522 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.343868 29406 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.344198 29400 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.235577 29393 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.232297 29284 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.287410 29423 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:07.345434 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.345175 29284 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.346131 29423 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.347500 29412 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.347954 29412 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:07.348376 29412 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.350281 29292 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:07.353996 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.297991 29296 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.298858 29261 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.235879 29184 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.246045 29375 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.198611 29372 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.221868 29254 raft_consensus.cc:359] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.302523 29301 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:07.302963 29424 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:07.303375 27148 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.355756 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:07.375844 29408 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:07.274447 29305 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.376904 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.379431 29184 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.381851 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.383126 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.369594 27833 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:07.385612 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.401717 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.402420 27303 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.402614 27230 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:07.403395 29359 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.002s
I20260709 13:11:07.403491 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.403656 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.404122 27303 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.404064 27838 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:07.405052 29352 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.302925 29416 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.407585 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.314931 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.317898 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.319489 29326 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.326691 29399 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.328163 29398 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.329017 29407 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.329880 29235 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.330294 29303 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.332345 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.334358 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1637) took 2014 ms. Trace:
W20260709 13:11:07.334793 29365 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.002s
I20260709 13:11:07.335480 29431 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:07.294121 29438 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.211649 29264 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.339887 29316 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.235075 29350 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.248816 29427 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:07.234442 29419 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:07.343019 29409 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.344282 29406 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.354444 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.484252 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.249416 29230 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.303817 29304 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.386691 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.373050 29422 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.501475 27306 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:07.502884 29422 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.491070 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:07.506664 27836 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.507237 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.507901 27223 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:07.508764 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.509303 27223 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:07.456003 29441 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.510488 29441 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.512820 29441 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.446762 27228 rpcz_store.cc:276] 0709 13:11:05.320380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.325339 (+  4959us) service_pool.cc:224] Handling call
0709 13:11:06.394123 (+1068784us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12e9c 00007f9a4ec12a5b 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:06.394371 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.857991 (+463620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.333999 (+476008us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b54002916a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d3aa02 00007f9a51d36dd6 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:07.334284 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213911168}
I20260709 13:11:07.337587 29324 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:07.523835 29324 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.524873 27301 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:07.394260 29301 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:07.526881 29301 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.485427 29282 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.528412 29301 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.529475 29282 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.233006 29433 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:07.373451 29415 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.398602 29254 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:11:07.531904 27840 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:07.531262 29254 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.532415 29391 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.532998 29391 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.372689 29347 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.305276 27150 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:07.535379 29442 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:07.399489 29371 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:07.535988 29442 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.377532 27226 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:07.406857 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.408370 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:07.413094 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 59193.2us
I20260709 13:11:07.539498 27154 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:07.245203 29327 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.542320 29327 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.544301 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 569) took 3815 ms. Trace:
I20260709 13:11:07.544752 27840 rpcz_store.cc:276] 0709 13:11:03.732184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.178745 (+1446561us) service_pool.cc:224] Handling call
0709 13:11:05.179085 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.532269 (+2353184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.544058 (+ 11789us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b5400560254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:07.544234 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5410049792}
W20260709 13:11:07.356570 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 66093.4us
I20260709 13:11:07.415899 27225 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:07.416965 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:07.547866 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 315722us
W20260709 13:11:07.419376 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 239588us
I20260709 13:11:07.549604 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.550741 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:07.552380 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.245579 29369 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.423277 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:07.428670 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 240977us
W20260709 13:11:07.564937 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 141778us
I20260709 13:11:07.565662 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.348393 29284 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:07.434556 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 284958us
I20260709 13:11:07.546617 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.438508 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.568473 27834 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.439344 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:07.440871 27838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 998) took 3233 ms (client timeout 1774 ms). Trace:
I20260709 13:11:07.445230 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:07.569767 27838 rpcz_store.cc:269] 0709 13:11:04.206995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.384684 (+177689us) service_pool.cc:224] Handling call
0709 13:11:07.440644 (+3055960us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b54004a7254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:07.440773 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6620539264}
I20260709 13:11:07.445588 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.445231 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.446130 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.571887 27304 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:07.444164 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.450603 27303 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.451579 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.573776 27833 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.355988 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:07.405514 29352 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:07.430855 29302 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.004s
I20260709 13:11:07.371320 29428 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.350322 29436 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:07.421108 29355 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.459574 29418 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.458595 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.462946 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.463207 29431 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.465770 29430 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.472239 29264 ts_tablet_manager.cc:1434] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.533s	user 0.008s	sys 0.001s
I20260709 13:11:07.474167 27832 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.436733 29364 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.431149 29385 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.435830 29359 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:07.610060 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.599426 29324 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.610293 29359 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.592916 27297 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.611928 29254 ts_tablet_manager.cc:1434] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 1.250s	user 0.018s	sys 0.006s
I20260709 13:11:07.479796 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.445533 29393 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:07.608204 29355 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.618613 29393 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:07.479002 29366 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:11:07.620411 29355 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.620688 29366 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.620839 27835 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:07.621519 27302 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:07.577870 29433 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:07.485502 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:07.623195 27300 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:07.624174 27157 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:07.487851 29400 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:07.489059 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:07.489328 29356 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.476924 29438 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:07.390873 29372 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.494081 29419 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.496927 29348 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.478541 29427 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:07.500182 29381 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.541714 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:07.634970 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 93341us
I20260709 13:11:07.635113 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:07.564532 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:07.606737 29436 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:07.431821 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.565838 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:07.638487 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72711.8us
W20260709 13:11:07.638736 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 207049us
I20260709 13:11:07.638746 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.569789 27839 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 1.
I20260709 13:11:07.640933 29399 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.641443 29399 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.641788 29399 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.642913 29353 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.576086 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:07.579089 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.521651 29406 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:07.646950 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67925.7us
I20260709 13:11:07.626401 29400 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:07.576771 29270 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.596510 29304 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:07.597296 29391 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.597471 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.598253 29305 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.598484 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:07.638087 29430 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.602099 27841 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:07.579047 29415 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.577737 29292 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:07.608712 27151 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:07.607837 29364 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.611007 29324 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.441579 29437 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.612511 29385 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.286767 29209 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.593168 29284 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.617787 29265 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:07.694011 29412 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.695032 29265 tablet_bootstrap.cc:492] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:11:07.695880 29265 ts_tablet_manager.cc:1403] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 3.488s	user 0.053s	sys 0.043s
I20260709 13:11:07.696105 29393 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.600845 29337 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.578117 29422 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:11:07.606108 29264 ts_tablet_manager.cc:1467] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Tablet startup took 674ms
W20260709 13:11:07.625171 29254 ts_tablet_manager.cc:1467] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Tablet startup took 1262ms
I20260709 13:11:07.640084 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:07.643733 27227 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:07.644737 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:07.593497 27834 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:11:07.647823 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 71840.8us
I20260709 13:11:07.645697 29355 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.647686 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:07.651669 27232 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:07.655103 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56694.9us
I20260709 13:11:07.564306 29296 raft_consensus.cc:2764] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:07.643481 29235 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:07.645846 29369 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:07.608415 29418 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.646638 29353 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:07.659435 29415 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.643002 29419 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.667358 27838 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:07.651181 29270 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.648769 29230 raft_consensus.cc:2764] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:11:07.675493 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.638427 29356 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:11:07.651176 29365 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.638594 29442 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.655959 29398 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.637769 29348 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.703302 29359 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.679687 29364 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:07.720543 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75866.3us
I20260709 13:11:07.681486 29324 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:07.889093 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 241441us
I20260709 13:11:07.682871 29430 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:07.889302 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 249248us
I20260709 13:11:07.683396 29385 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:07.891248 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 293844us
W20260709 13:11:07.891486 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.696383 29412 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.878973 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:11:07.802932 29452 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:11:07.716759 29352 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:07.942966 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.946700 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:07.782450 27050 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 3 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:07.947957 27151 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.946892 27299 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:07.949658 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 70804.3us
I20260709 13:11:07.897487 29372 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.950762 29372 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.951192 29372 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.951318 29265 raft_consensus.cc:359] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.952294 29265 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:11:07.955101 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.957844 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:07.734723 29355 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.948523 27050 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:07.937891 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.734395 29408 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.888548 29415 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.888167 29270 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.960812 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:07.962688 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:07.985400 27154 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.696941 29284 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:07.968199 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:07.716405 29209 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:07.886850 29420 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.734277 29433 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.816052 29316 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:07.912854 27806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.954s (SENT) [suppressed 18 similar messages]
I20260709 13:11:07.893893 29430 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.894295 29353 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.893240 29365 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:07.989143 27151 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:07.937558 29381 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.719309 29437 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:07.995589 29305 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.996686 29372 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.997478 27836 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:07.979076 29408 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.056962 29408 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.967108 29406 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:07.966835 29265 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:07.966262 29398 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.001130 29230 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:08.039245 29430 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.976053 29355 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.008793 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:08.066409 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57751.7us
I20260709 13:11:08.068977 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.004696 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:08.070566 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65985.6us
I20260709 13:11:08.071550 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:07.937243 29375 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:11:07.697116 29427 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.052114 29292 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.055753 29372 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.034816 29420 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:07.765654 29436 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.010738 29433 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:07.719036 29337 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.036912 29365 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.790957 29438 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.003822 29327 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.057963 29270 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:08.081416 29325 tablet_copy_client.cc:538] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:08.063990 29301 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 13:11:07.994302 29284 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.063357 29398 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:08.077803 29296 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.076347 29359 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.078245 29393 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.047971 29316 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.089910 29433 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.101475 29398 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.114889 29400 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.114689 29420 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.117157 29399 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.120471 29399 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.123739 29418 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.128398 29398 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.129515 29427 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.104501 29393 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:08.134438 29393 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.135030 29400 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.138526 29430 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.140725 29430 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:07.894435 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:08.198436 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 247839us
W20260709 13:11:08.200169 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 305675us
I20260709 13:11:08.200860 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:07.718873 29254 ts_tablet_manager.cc:1469] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Trace:
0709 13:10:57.634974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.635104 (+   130us) service_pool.cc:224] Handling call
0709 13:10:57.660675 (+ 25571us) ts_tablet_manager.cc:934] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:57.945797 (+285122us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:58.137509 (+191712us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:58.137649 (+   140us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:58.272977 (+135328us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:58.273397 (+   420us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:00.321775 (+2048378us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec132b8 00007f9a4ec131db 00007f9a57b54bb9 00007f9a56c85d88 00007f9a56d4c973 00007f9a56d4870f 00007f9a56d4a2d3 00007f9a56d7bf4e 00007f9a56d60fdd 00007f9a56d60f89
0709 13:11:00.329283 (+  7508us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:00.329557 (+   274us) inbound_call.cc:177] Queueing success response
0709 13:11:03.438747 (+3109190us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:06.362360 (+2923613us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:06.839346 (+476986us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:06.988487 (+149141us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":460,"raft.queue_time_us":3627,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":12423552,"tablet-copy.queue_time_us":19372,"tablet-download-pool.queue_time_us":286882,"tablet-download-pool.run_cpu_time_us":1739,"tablet-download-pool.run_wall_time_us":2488561,"thread_start_us":36457,"threads_started":2}
I20260709 13:11:08.205008 29337 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.209232 29316 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:08.004076 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 366667us
I20260709 13:11:08.216643 29364 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:08.018146 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.228663 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.230346 27151 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.230237 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.227451 29364 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.231199 27157 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
I20260709 13:11:08.232813 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.233054 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:08.237233 29348 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:08.239019 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 326088us
I20260709 13:11:08.233475 29393 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.077824 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.064137 29230 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:08.282857 29230 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.283102 29270 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:08.283973 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 209745us
W20260709 13:11:08.184842 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.285971 29391 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.187553 27153 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:08.059515 27297 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:08.288805 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1551) took 1049 ms. Trace:
I20260709 13:11:08.289238 27297 rpcz_store.cc:276] 0709 13:11:07.239124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.250029 (+ 10905us) service_pool.cc:224] Handling call
0709 13:11:08.288487 (+1038458us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:07.706774 29264 ts_tablet_manager.cc:1469] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Trace:
0709 13:10:57.853331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.853885 (+   554us) service_pool.cc:224] Handling call
0709 13:10:57.985563 (+131678us) ts_tablet_manager.cc:934] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:10:58.154542 (+168979us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:58.237523 (+ 82981us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:58.237698 (+   175us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:58.289472 (+ 51774us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:58.289733 (+   261us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:00.650150 (+2360417us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:00.654756 (+  4606us) inbound_call.cc:177] Queueing success response
0709 13:11:04.323013 (+3668257us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:06.938926 (+2615913us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:06.989883 (+ 50957us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:06.990707 (+   824us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":350,"mutex_wait_us":9403,"raft.queue_time_us":11075,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5801,"tablet-copy.queue_time_us":130114,"tablet-download-pool.queue_time_us":157,"tablet-download-pool.run_cpu_time_us":1359,"tablet-download-pool.run_wall_time_us":2727670,"thread_start_us":168232,"threads_started":2}
I20260709 13:11:08.195093 27840 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:08.195689 29265 ts_tablet_manager.cc:1434] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.499s	user 0.004s	sys 0.007s
W20260709 13:11:08.291438 29265 ts_tablet_manager.cc:1467] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Tablet startup took 595ms
I20260709 13:11:08.145435 29437 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.218950 29422 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:08.220920 29462 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:08.134792 29385 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:08.189478 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 117839us
I20260709 13:11:08.233855 27154 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
I20260709 13:11:08.256275 29419 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:08.303095 29419 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:08.304826 29419 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.307854 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.308902 29398 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:08.309007 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108378us
I20260709 13:11:08.310159 29462 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.310751 29462 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.257097 29393 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.259809 29427 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.271418 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.272853 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.272996 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.275264 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.276947 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.277748 29327 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.277938 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.278092 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.278841 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.279155 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.280539 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.281195 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.285283 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.194998 29296 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.329079 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.329792 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.330503 27229 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:08.329982 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.336598 27223 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.338346 29316 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:08.338582 27227 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.339021 29325 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:11:08.315192 29385 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.343493 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:08.316017 29427 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:08.317611 29398 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.339138 29316 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.350757 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.350701 29437 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.352648 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.352777 29437 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.354300 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.354535 29296 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.355028 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.357273 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.357314 29296 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.358132 29437 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.358371 29296 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.367218 27154 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:08.348090 29427 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.370254 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:08.373178 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 121866us
I20260709 13:11:08.374790 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:08.375681 27226 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.381107 29441 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.381718 29441 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.382139 29441 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:08.291882 29265 ts_tablet_manager.cc:1469] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Trace:
0709 13:10:57.878141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.878466 (+   325us) service_pool.cc:224] Handling call
0709 13:10:58.023206 (+144740us) ts_tablet_manager.cc:934] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:11:00.779540 (+2756334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:00.913441 (+133901us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:00.913591 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:01.118952 (+205361us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:01.156767 (+ 37815us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:01.256498 (+ 99731us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:01.266166 (+  9668us) inbound_call.cc:177] Queueing success response
0709 13:11:01.512042 (+245876us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800327700. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:04.207400 (+2695358us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:07.696230 (+3488830us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:07.702798 (+  6568us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:07.703418 (+   620us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":10017,"mutex_wait_us":35416,"raft.queue_time_us":9610,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4585,"spinlock_wait_cycles":4270336,"tablet-copy.queue_time_us":143412,"tablet-download-pool.queue_time_us":11319,"tablet-download-pool.run_cpu_time_us":1852,"tablet-download-pool.run_wall_time_us":2127655,"thread_start_us":230516,"threads_started":2}
W20260709 13:11:08.386595 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 101574us
I20260709 13:11:08.387010 29296 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.390563 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:08.385700 29430 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.389762 29296 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.397019 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.412546 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:08.393996 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.419523 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:08.462231 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.397409 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:08.395135 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46130.8us
I20260709 13:11:08.396976 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.413595 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.453542 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.455194 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.419334 27156 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:08.521293 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.453428 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.426451 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.416702 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.404314 29430 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.454857 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.455994 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.417775 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.407812 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.416451 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.455785 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.527590 27302 raft_consensus.cc:2368] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6.
I20260709 13:11:08.419988 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.525612 27157 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.409022 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.533924 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.535038 27150 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.535670 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.523774 29462 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.536468 27299 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:08.536360 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:08.538683 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.538553 29418 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:08.539582 27304 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.540086 29418 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.540467 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.540632 29327 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.541363 29436 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.541285 29327 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.541780 29436 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:08.543181 29436 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.543877 29327 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.544734 29436 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.545100 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.546253 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.537774 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.541682 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.447875 29316 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.550885 27305 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.554028 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:08.408841 29433 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.551815 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.407195 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.527700 29430 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.428510 29230 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.565261 27301 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:08.435307 29355 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.566188 27154 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.566082 27152 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.540480 29418 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.567736 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.569417 27155 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.571796 29355 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.574549 29462 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.574873 29365 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:08.566654 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:08.420473 29324 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:08.419884 29415 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.565876 29270 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.580452 27304 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:08.428776 29353 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.580614 27302 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:08.581104 27300 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:08.585840 29304 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.587653 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.589430 27153 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.576514 29418 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.582134 27315 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-9e466225c5a147b9b31f11fea1bcf893 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:11:08.593571 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.596940 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:08.598317 27298 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.598238 27231 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.598205 27315 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-9e466225c5a147b9b31f11fea1bcf893 on tablet 9e466225c5a147b9b31f11fea1bcf893 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:08.598434 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.590128 29304 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.606554 29304 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.607254 29416 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.595934 27297 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:08.617098 29433 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.622040 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.624185 29359 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.624752 29359 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.624948 27299 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.625168 29359 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.626291 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:08.627374 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.627521 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.627691 29400 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:08.628190 29400 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:08.628321 27152 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.628646 29400 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:08.632563 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 100034us
I20260709 13:11:08.626322 29365 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.634455 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:08.636858 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 223412us
I20260709 13:11:08.637817 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.638592 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:08.640229 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.640403 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:08.645754 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 219499us
I20260709 13:11:08.649199 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:08.641321 29408 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.004s
I20260709 13:11:08.652571 27155 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:08.631878 29441 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.638266 29427 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.659137 29408 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.661635 29230 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.662417 27229 raft_consensus.cc:2368] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3.
I20260709 13:11:08.662767 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1549) took 1475 ms. Trace:
I20260709 13:11:08.631793 29437 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.663127 27298 rpcz_store.cc:276] 0709 13:11:07.187071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.297715 (+110644us) service_pool.cc:224] Handling call
0709 13:11:07.479598 (+181883us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:08.662504 (+1182906us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540031bfd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:08.662670 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388393984}
I20260709 13:11:08.665102 29327 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.665330 29437 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.665653 29327 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.666158 29327 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.666570 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.660257 29355 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.670849 29355 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:08.670756 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.671377 29355 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.671926 29437 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.672305 29437 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:08.672665 29437 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.674269 29381 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.674779 29381 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.675189 29381 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.692478 29393 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:08.694123 29420 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.694660 29420 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.695026 29420 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.695914 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.696094 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.697096 27150 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.694214 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:08.708436 29230 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:08.708691 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:08.709615 29433 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.710237 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.711167 27151 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:08.711426 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:08.717222 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:08.726292 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 58177.8us
W20260709 13:11:08.726548 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 67007.7us
I20260709 13:11:08.724421 29270 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:08.730660 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.730779 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.732177 29337 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.732625 29337 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.732954 29337 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.733237 29458 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.712412 29408 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.735306 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:08.735884 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.737064 29365 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:08.737501 29365 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:08.737833 29365 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.730731 29270 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:08.740329 29270 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.740532 29430 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:08.741421 29470 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.219s	user 0.001s	sys 0.002s
I20260709 13:11:08.708452 29441 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.744400 29416 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.745234 29416 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:08.746542 29438 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:08.747145 29438 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:08.747370 29427 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.748196 29438 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.751364 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.751776 29393 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.752295 29393 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:08.752403 27298 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.753038 29393 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.754128 27300 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:08.730043 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:08.762598 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.763361 29408 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.763527 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.764331 27297 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:08.764053 29408 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.766400 27298 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:08.766523 29408 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:08.769721 29284 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.010s
I20260709 13:11:08.722903 29324 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.770289 29284 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:08.771886 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.725268 29415 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.791316 27298 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.799129 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.800679 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.804913 27150 raft_consensus.cc:2368] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5.
W20260709 13:11:08.806883 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 76938.3us
I20260709 13:11:08.807636 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:08.773955 29359 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.805019 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.795974 29284 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.819691 27269 leader_election.cc:400] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5.
I20260709 13:11:08.820577 27269 leader_election.cc:403] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.838351 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.830794 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:08.798017 29381 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.841856 27151 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.842036 27840 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:08.815464 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.795774 29270 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.800087 29355 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.841905 27299 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.847477 29324 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.848944 29359 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.835486 29438 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.815595 29400 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.862957 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:08.849844 29359 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.868208 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54536.5us
I20260709 13:11:08.871198 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:08.873286 29305 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.873751 29305 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:08.874205 29305 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.874102 29359 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.874735 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:08.875499 27835 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.875169 29337 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.876788 29359 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.878530 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:08.881310 29347 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.844134 29304 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:08.882584 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:08.883208 27838 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.883303 29369 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:08.883785 29369 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.884092 29369 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.884111 29304 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.886503 27302 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.887625 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.888001 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.888427 27305 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.888952 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:08.830822 29408 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:08.883217 27153 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:08.882701 29347 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.894208 29347 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:08.894866 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47689.9us
I20260709 13:11:08.895385 29347 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.864449 29438 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.896672 29438 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.897101 29400 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.897621 29337 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.889535 27301 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.885728 29365 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.898406 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:08.888327 29327 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.881438 29420 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:08.901880 29327 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.903524 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.904165 27150 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.904524 29365 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.896840 29347 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.906607 27838 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:08.908303 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.908977 27155 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.909369 29270 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.909546 29355 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:08.858536 29353 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.910570 29420 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:08.882074 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:08.925927 27151 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:08.927825 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:08.929436 27155 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
W20260709 13:11:08.934360 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.938257 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.941062 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.931514 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:08.927691 29366 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:08.945043 29366 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:08.949059 29366 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:08.945587 29433 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.940251 29385 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:08.951826 29385 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:08.952301 29385 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.955039 27150 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:08.957970 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:08.962664 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:08.965337 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.965587 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.967526 27301 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:08.969220 27150 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.970845 27152 raft_consensus.cc:2368] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:08.931377 29430 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:08.975401 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.976147 27149 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.978471 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.980090 27151 raft_consensus.cc:2368] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:08.972553 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.987182 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:08.988065 27153 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:08.966671 29230 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:08.990020 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108071us
I20260709 13:11:08.991009 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:08.991622 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:08.993614 27838 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.991353 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:08.999191 27269 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:08.966828 29420 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:09.001741 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43919.7us
I20260709 13:11:08.984953 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.004163 27840 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:09.004299 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.005455 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.006150 27837 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:09.006150 29481 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.008958 27835 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:09.005800 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.000214 27301 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.016858 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.017524 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.014389 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:09.024502 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 189778us
I20260709 13:11:09.025144 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.026189 27303 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:08.986819 29353 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.015601 29437 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.015563 29381 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:09.014004 29438 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:09.041736 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 50896us
W20260709 13:11:09.034397 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45919us
I20260709 13:11:09.052513 29437 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:09.001305 29230 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:09.050417 27150 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:09.052845 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.056700 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.084317 27149 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:09.062043 27299 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:09.081975 27195 leader_election.cc:400] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:09.086251 27195 leader_election.cc:403] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.028687 27153 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:09.102964 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.046262 29398 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:09.109333 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 79044.5us
I20260709 13:11:09.110020 27834 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:09.112466 27195 leader_election.cc:400] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:09.112828 27195 leader_election.cc:403] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.115049 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.116096 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.054286 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.053010 29365 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.030527 29420 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:09.127046 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.118240 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.049206 29324 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5.
W20260709 13:11:09.121263 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64652.4us
I20260709 13:11:09.123090 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.056932 29481 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.124225 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.050627 29353 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:09.127923 27840 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:09.128614 27299 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:09.134972 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 141351us
I20260709 13:11:09.136267 27838 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:09.132927 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.138072 27306 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.117854 29398 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.110747 29430 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.089354 29230 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:09.121040 29284 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.153108 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:09.154855 27837 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.060194 29418 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:09.159689 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.129173 27302 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:09.165520 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.194586 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:09.168962 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 111422us
I20260709 13:11:09.203256 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:09.127737 29400 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.207866 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.209203 27229 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.167637 27838 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:09.213410 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.210270 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.137831 29416 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.127131 29484 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:11:09.156132 29398 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:09.225728 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 97753us
I20260709 13:11:09.162266 29365 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:09.229377 29492 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:09.222890 27301 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.194976 29415 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.231035 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.202761 29419 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:09.242666 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.236732 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:09.245060 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:09.247018 27224 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.247622 27838 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:09.240037 27299 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.161846 29437 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:11:09.246232 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.194734 29430 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.230396 27835 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.266377 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.267203 27225 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.271592 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.272622 27228 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.237920 29355 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.278697 27229 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:09.280722 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:09.283339 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:09.288664 29418 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:09.289551 27223 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:09.291917 29430 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:09.292886 27050 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 242) took 1643 ms. Trace:
I20260709 13:11:09.294317 29407 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.294518 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.295323 27837 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:11:09.297420 29407 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:09.301735 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:09.304992 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70406.4us
I20260709 13:11:09.310858 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.311746 27223 raft_consensus.cc:2368] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5.
I20260709 13:11:09.315873 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.316524 27227 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.318105 27055 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.319957 27055 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 3, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:09.325506 27225 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:09.321432 27055 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.329417 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:09.278544 29359 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.335633 27227 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:09.335851 27223 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:09.341958 27229 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.276480 29419 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.261303 29415 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:09.297977 29407 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.299036 29337 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.365797 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:09.419533 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 158131us
I20260709 13:11:09.358610 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:09.422930 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:09.424008 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.424430 27224 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:09.276746 29420 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.423720 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:09.357007 27055 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:09.432221 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:09.434664 27225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:09.435060 29284 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:09.435421 27225 raft_consensus.cc:606] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:09.437636 29416 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:09.439291 27055 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:09.424883 29393 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.002s
I20260709 13:11:09.441859 29393 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.442965 27225 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.442992 27836 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:09.441524 27055 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:09.444135 29393 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:09.444252 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.445128 27225 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.446122 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.447228 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.445526 27055 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 2, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:09.447944 27225 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.448794 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:09.449450 27225 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.450448 27226 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:09.450371 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:09.451936 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.452766 27157 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:09.455175 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.428737 29494 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.456892 27229 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:09.458701 29494 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:09.460579 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:09.461445 29427 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:09.461025 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.462634 27232 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:09.463354 27225 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.464907 29481 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.457943 29398 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:09.381058 29355 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.463241 27197 leader_election.cc:400] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6.
I20260709 13:11:09.470196 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:09.471189 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:09.472815 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 168908us
I20260709 13:11:09.472543 29494 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.473901 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:09.293288 27050 rpcz_store.cc:276] 0709 13:11:07.649201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.649377 (+   176us) service_pool.cc:224] Handling call
0709 13:11:09.292656 (+1643279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:08.360822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:08.363124 (+  2302us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:08.363186 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:11:08.363237 (+    51us) tablet.cc:662] Decoding operations
0709 13:11:08.363845 (+   608us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:08.363983 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:08.364012 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:08.409346 (+ 45334us) tablet.cc:701] Row locks acquired
0709 13:11:08.409405 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:11:08.409649 (+   244us) write_op.cc:270] Start()
0709 13:11:08.409869 (+   220us) write_op.cc:276] Timestamp: P: 1783602668409561 usec, L: 0
0709 13:11:08.409933 (+    64us) op_driver.cc:348] REPLICATION: starting
0709 13:11:08.442421 (+ 32488us) log.cc:844] Serialized 925 byte log entry
0709 13:11:08.838496 (+396075us) op_driver.cc:464] REPLICATION: finished
0709 13:11:09.060619 (+222123us) write_op.cc:301] APPLY: starting
0709 13:11:09.060732 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:09.060887 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:09.061554 (+   667us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:09.065241 (+  3687us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:09.088905 (+ 23664us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:09.088976 (+    71us) write_op.cc:312] APPLY: finished
0709 13:11:09.089337 (+   361us) log.cc:844] Serialized 29 byte log entry
0709 13:11:09.089576 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.089706 (+   130us) write_op.cc:454] Released schema lock
0709 13:11:09.089772 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:09.090462 (+   690us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:09.090504 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":221760,"apply.run_cpu_time_us":3227,"apply.run_wall_time_us":29775,"num_ops":2,"prepare.queue_time_us":357141,"prepare.run_cpu_time_us":11468,"prepare.run_wall_time_us":194683,"raft.queue_time_us":119027,"raft.run_cpu_time_us":9178,"raft.run_wall_time_us":129475,"replication_time_us":428328,"spinlock_wait_cycles":1920,"thread_start_us":669519,"threads_started":4,"wal-append.queue_time_us":169918}]]}
I20260709 13:11:09.476190 27197 leader_election.cc:403] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:09.477192 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 119087us
I20260709 13:11:09.343001 29438 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:09.432806 29305 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.001s
I20260709 13:11:09.514151 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.514500 29305 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.488852 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:09.515793 27834 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:09.489573 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.516856 27157 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:09.517705 27154 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:09.491835 29327 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.518553 29327 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:09.490854 27228 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:09.496827 29369 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.004s
I20260709 13:11:09.498041 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.536048 27153 raft_consensus.cc:2368] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3.
I20260709 13:11:09.486426 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:09.505409 29479 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.374s	user 0.000s	sys 0.002s
I20260709 13:11:09.502041 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.508788 27224 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:09.510881 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:09.512797 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.540521 27299 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.513294 27315 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-1a6d314618684d688b91fe535777e47b received from {username='slave'} at 127.0.0.1:40558
I20260709 13:11:09.515082 27301 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.546022 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.546739 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.486286 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:09.517565 29305 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:09.495383 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:09.526093 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.534512 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:09.542209 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.542474 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 119644us
I20260709 13:11:09.300858 29304 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:11:09.532630 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.545264 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.545205 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.546979 27227 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.336229 29353 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.523900 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:09.582180 27315 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-1a6d314618684d688b91fe535777e47b on tablet 1a6d314618684d688b91fe535777e47b with peer f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:09.596673 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 133639us
I20260709 13:11:09.597195 27316 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-d87c41315a07486aa13067ad7c47c34a received from {username='slave'} at 127.0.0.1:40558
W20260709 13:11:09.590759 29385 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.004s
I20260709 13:11:09.597795 27316 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-d87c41315a07486aa13067ad7c47c34a on tablet d87c41315a07486aa13067ad7c47c34a with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:09.585696 27224 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:09.599766 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.597934 29385 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.601006 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.602290 29495 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:09.602388 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 91657.8us
I20260709 13:11:09.603084 29495 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.603284 29492 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.603894 29492 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:09.604837 29492 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.603111 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:09.606365 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:09.607093 27297 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:09.607738 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.542972 29400 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:11:09.608505 27297 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:09.601809 27149 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:09.611864 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88044.8us
I20260709 13:11:09.479627 29230 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.612529 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:09.547555 27301 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:09.576601 27300 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.545107 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.610431 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:09.619496 27305 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.616753 27302 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:09.616665 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:09.574103 29408 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6.
I20260709 13:11:09.609925 29441 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:09.610366 29493 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:11:09.616528 27230 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.625541 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.627722 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:09.629053 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 186701us
I20260709 13:11:09.574160 29438 raft_consensus.cc:2764] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:09.631839 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.636744 27804 leader_election.cc:400] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3.
I20260709 13:11:09.637120 27804 leader_election.cc:403] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.623522 29400 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.639585 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:09.519541 29327 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.643537 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.644577 27157 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.631378 29337 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:09.547294 29369 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.646097 27840 raft_consensus.cc:2368] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:09.648761 29364 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.640763 29437 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.653374 29398 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:09.655222 27838 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:09.655414 29419 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:09.636030 29385 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:09.664577 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:09.641280 29408 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.669152 27834 raft_consensus.cc:2393] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:09.650563 29305 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:11:09.662868 29484 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.648651 29393 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.678526 29327 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.682232 29498 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:09.682791 29498 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:09.683049 27836 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:09.683202 29498 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.685827 27838 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:09.646430 29441 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:09.671363 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:09.649084 29400 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:09.709795 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 96383.3us
I20260709 13:11:09.711664 27231 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 1. Current term is 3. Ops: []
W20260709 13:11:09.712533 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 66795.7us
I20260709 13:11:09.711412 29270 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.737053 29441 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.741387 27157 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:09.732340 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.716346 29337 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:09.753329 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:09.762651 27223 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:09.761374 29369 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:09.776818 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:09.735101 29355 raft_consensus.cc:2764] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:09.802798 29337 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.846216 27305 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:09.803642 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:09.938198 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45404.2us
I20260709 13:11:09.804085 27157 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:09.943929 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 272623us
W20260709 13:11:09.824152 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45474us
I20260709 13:11:09.804179 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:09.949432 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 217143us
W20260709 13:11:09.846541 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 189622us
I20260709 13:11:09.994035 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:09.996378 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:09.804663 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:09.954110 27834 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:09.777205 29408 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:10.100525 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 104235us
W20260709 13:11:10.098973 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 142361us
W20260709 13:11:10.102453 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108538us
I20260709 13:11:10.094937 29324 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:11:10.103178 29420 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:09.906951 29497 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.104528 29497 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:09.805123 29400 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.106928 29497 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:09.782655 29407 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.103319 27272 leader_election.cc:400] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5.
I20260709 13:11:09.934293 29327 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.930377 29437 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3.
I20260709 13:11:10.110335 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:10.110769 27157 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:10.112560 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.122323 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:10.126844 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:10.129302 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:10.133309 29507 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:11:10.156670 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.138535 29327 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:09.779160 29270 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.127708 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:10.150185 29347 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.174741 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.132653 29510 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.116129 29324 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:10.287869 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 185055us
I20260709 13:11:10.288830 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:10.125133 29364 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.804796 29490 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.322s
I20260709 13:11:10.109248 29407 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:10.111477 29509 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.171080 27298 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:10.288956 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 172448us
I20260709 13:11:10.156049 29230 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.172528 29420 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:10.317059 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 160546us
I20260709 13:11:10.327003 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.272939 29385 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:10.327998 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 176354us
W20260709 13:11:10.340497 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 216582us
I20260709 13:11:10.357445 27272 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:10.293480 29418 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.167323 27841 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:10.371495 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:10.319621 27836 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.274318 29347 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:10.381243 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.376605 29353 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:10.412111 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:10.294938 29324 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:10.348373 29385 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:10.379662 29420 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.323832 29509 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.404561 29493 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:10.415556 29418 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.414604 29491 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.414103 29481 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:10.508208 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 136844us
W20260709 13:11:10.542573 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 130563us
I20260709 13:11:10.547119 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:10.443464 29353 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:11:10.511189 29493 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:10.506994 29230 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:10.552824 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:10.535352 29491 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:10.555883 27223 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:10.454447 29526 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:11:10.561414 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:10.447005 29420 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.560880 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:10.563530 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:10.563666 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:10.563902 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.564159 27223 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.564729 27226 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:10.566145 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 209543us
I20260709 13:11:10.566510 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.568959 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:10.567243 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 209929us
I20260709 13:11:10.569867 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:10.559062 29400 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:10.563125 29418 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:10.581128 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 292391us
I20260709 13:11:10.567688 29327 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:10.596839 29364 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:10.596915 29481 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:10.603202 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:10.604761 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:10.547149 29385 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.593699 29353 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.597028 29270 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:10.620853 27807 leader_election.cc:400] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3.
I20260709 13:11:10.599812 29529 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:10.614403 29400 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:10.627568 29524 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:11:10.629300 29523 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:11:10.630411 29512 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:10.632302 29491 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:10.633764 29491 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.634621 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:10.651189 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:10.636045 29365 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:10.636250 29536 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:10.636739 29493 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.655818 29537 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:10.656394 29537 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:10.656661 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:10.641482 27157 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.572528 29516 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:10.641956 29393 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:10.643829 29385 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.643920 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:10.644405 29270 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:10.644779 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:10.676911 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:10.623222 29230 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:10.645375 29517 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:11:10.626592 29533 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:10.634680 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:10.605147 29481 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.651952 27230 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.654714 27834 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:10.654927 29530 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.612386 29304 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.651973 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:10.683979 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 68858.6us
I20260709 13:11:10.684301 27152 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:10.695626 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.619431 29353 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:10.623036 29418 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:10.712553 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 145678us
I20260709 13:11:10.731738 29364 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:10.657332 29537 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:10.659631 29347 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:10.731180 29418 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:10.739104 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 140372us
I20260709 13:11:10.684587 29438 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:10.678018 29393 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.673696 29327 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.733232 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:10.741223 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.688097 29324 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:10.698143 29481 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.753368 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:10.658221 29337 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:11:10.755366 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 510) took 1211 ms. Trace:
I20260709 13:11:10.759676 27299 rpcz_store.cc:276] 0709 13:11:09.538877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.608593 (+ 69716us) service_pool.cc:224] Handling call
0709 13:11:09.608957 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.609680 (+   723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.609710 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.610213 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.777458 (+167245us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:09.777522 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.777607 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.644645 (+867038us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:10.750262 (+105617us) raft_consensus.cc:1685] finished
0709 13:11:10.750287 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.750509 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":152620800,"thread_start_us":166132,"threads_started":1,"wal-append.queue_time_us":662020}
I20260709 13:11:10.735493 29531 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.683049 29270 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:10.877380 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 181901us
I20260709 13:11:10.878666 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:10.752034 29327 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.891093 29353 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:10.900293 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 147838us
I20260709 13:11:10.900558 29353 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.744428 29304 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.901413 27836 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:10.918884 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1028) took 1134 ms. Trace:
I20260709 13:11:10.919333 27836 rpcz_store.cc:276] 0709 13:11:09.784218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.797625 (+ 13407us) service_pool.cc:224] Handling call
0709 13:11:10.918767 (+1121142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:10.921015 27839 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:10.923911 29365 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.924448 29365 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.928057 29514 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.929690 29514 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.733909 29530 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.931042 29437 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:10.932313 29530 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:10.932924 29530 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:10.933379 29530 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:10.903307 29420 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:10.927969 27223 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:10.895164 29327 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.949879 27230 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:11.025686 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.026840 27305 raft_consensus.cc:2368] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5.
I20260709 13:11:10.738411 29533 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:11.029582 27306 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:11.031550 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:10.944893 29536 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:11.048069 27269 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:10.919261 29549 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.092362 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.099637 27303 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.092583 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.095338 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:11.100620 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:11.098335 27299 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.102041 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:11.109061 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61138.8us
I20260709 13:11:11.113230 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.117283 27306 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:11.124657 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:11.123111 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 185054us
I20260709 13:11:11.125304 27305 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:11.128767 27122 leader_election.cc:400] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5.
I20260709 13:11:11.129096 27122 leader_election.cc:403] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:11.128786 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:11.135424 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 382152us
I20260709 13:11:11.137184 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.142956 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:11.143625 27304 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:11.104892 29438 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:11.169484 29550 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.170514 29546 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:11.170773 29528 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5.
I20260709 13:11:11.170493 29438 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.171159 29546 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:11.171631 29546 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:11.174964 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 436442us
W20260709 13:11:11.175550 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45563.8us
I20260709 13:11:11.178560 29561 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:11.179141 29561 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:11.179618 29561 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:11.178318 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49611.3us
I20260709 13:11:11.178565 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:11.182022 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:11.183281 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:11.185148 29556 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.186929 29551 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.188462 29545 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:11.188524 29561 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.171111 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:11.198438 29535 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.198628 29560 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.198673 29558 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.199199 29535 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.200469 29558 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:11.202211 27300 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.205047 27832 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 2: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:11.165669 29337 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.176646 27836 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:11.174217 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.201799 29552 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:11.195273 27807 connection.cc:256] RPC call timeout handler was delayed by -1.0697270989999197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:11:11.231921 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:11.233110 27223 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:11.192863 29549 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:11.194952 29304 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:11.243450 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64985.9us
I20260709 13:11:11.244390 29561 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.245303 29561 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:11.245782 29561 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:11.247480 29561 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:11.250452 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 66120.4us
I20260709 13:11:11.202019 29565 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:11.249801 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.151860 29364 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:11:11.252482 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.257196 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:11.225178 29365 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.263947 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:11.201099 29558 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.271468 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:11.283757 27832 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:11.253332 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:11.258205 29337 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:11.268539 27225 raft_consensus.cc:2376] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4. Re-sending same reply.
I20260709 13:11:11.272893 29567 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:11.251507 29549 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.272205 29568 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.287436 27225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1685) took 1837 ms (client timeout 2215 ms). Trace:
I20260709 13:11:11.268959 29365 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:11.276341 29543 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:11:11.277377 29552 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.275693 29535 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.268002 29548 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:11.282805 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:11.291474 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:11.292714 29533 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:11.293264 29481 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
I20260709 13:11:11.294847 29415 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:11.295527 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:11.296339 29385 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.613s	user 0.002s	sys 0.007s
W20260709 13:11:11.288004 27225 rpcz_store.cc:269] 0709 13:11:09.447658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.464552 (+ 16894us) service_pool.cc:224] Handling call
0709 13:11:11.257002 (+1792450us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:11.285257 (+ 28255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30122752}
I20260709 13:11:11.299173 27300 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:11.327432 27302 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:11.262663 29304 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:11.302044 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52397.5us
W20260709 13:11:11.316629 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 438047us
I20260709 13:11:11.323861 27832 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:11.285907 29364 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:11.262372 29540 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:11.300572 29498 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.617s	user 0.012s	sys 0.004s
W20260709 13:11:11.347921 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 65214.4us
I20260709 13:11:11.352041 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:11.322624 29347 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:11.360352 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.321887 29567 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:11.228446 29536 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:11.327123 29530 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.345600 29304 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.352095 29533 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:11.375069 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.297494 29337 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:11.372952 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 247024us
I20260709 13:11:11.347558 29545 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:11.384681 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:11.376406 29393 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.003s
I20260709 13:11:11.386351 27302 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:11.390779 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:11.391970 27150 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:11.279276 29565 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:11.359580 29415 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.392755 29393 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.412359 29562 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:11:11.414798 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54549.3us
I20260709 13:11:11.367983 29365 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:11.457495 29327 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.437014 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:11.300823 29568 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:11.378316 29304 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:11.478217 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:11.438637 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45542.2us
I20260709 13:11:11.338912 29481 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.378165 29533 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:11.357667 29364 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:11.372982 29514 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.446813 27150 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:11.440369 29430 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:11.522116 27156 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:11.455127 29559 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.188s
I20260709 13:11:11.455530 27836 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.377534 29554 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:11.362147 29498 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.377849 29385 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:11:11.461971 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:11.393347 29545 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.464003 29541 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.463794 29567 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:11.441001 29530 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.366421 29540 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:11.393534 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:11.572214 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 178753us
W20260709 13:11:11.572356 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 89937.7us
I20260709 13:11:11.470158 29365 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:11.476575 29531 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:11:11.477654 29568 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:11.472823 29325 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:11.484388 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:11.467818 29491 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.003s
W20260709 13:11:11.524133 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 196640us
I20260709 13:11:11.525897 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:11.555681 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:11.556579 27152 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:11.562479 27836 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:11.593075 27223 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:11.566866 29563 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.567708 27156 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:11.595507 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:11.602823 27230 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:11.573275 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.525058 29552 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.576918 27151 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:11.584915 29365 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:11.522280 29430 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:11.546904 29514 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.591109 27155 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:11.595263 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:11.605597 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:11.585532 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 353710us
I20260709 13:11:11.611675 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:11.588819 29572 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:11.593690 29543 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.672019 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:11.611615 27227 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:11.715157 27224 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:11.717217 29573 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:11:11.600512 29531 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.701705 27230 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:11:11.623823 27303 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 13:11:11.590162 29438 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:11.678843 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:11.722666 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 131668us
I20260709 13:11:11.734241 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:11.728094 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 96150.1us
I20260709 13:11:11.735915 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2557) took 2641 ms. Trace:
I20260709 13:11:11.558239 29554 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:11.702817 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.739653 27301 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:11.725047 29353 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.007s
W20260709 13:11:11.727788 29546 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.006s
I20260709 13:11:11.725741 27303 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:11.677527 29498 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.585248 29541 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:11.701619 29565 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:11.760586 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:11.705519 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 131988us
I20260709 13:11:11.761773 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:11.743528 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:11.737073 27123 leader_election.cc:336] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.612s (SENT)
I20260709 13:11:11.714847 29552 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:11.766844 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.718389 29572 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:11.636595 29558 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:11.736337 27149 rpcz_store.cc:276] 0709 13:11:09.088254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.088457 (+   203us) service_pool.cc:224] Handling call
0709 13:11:09.092990 (+  4533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.612243 (+519253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.729125 (+2116882us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54000681d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:11.729333 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169599360}
I20260709 13:11:11.748021 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:11.586571 29533 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.734241 29438 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.670727 29553 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:11:11.783131 29572 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:11.726506 29543 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.600373 29532 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 13:11:11.679656 29586 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:11:11.785480 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:11.974541 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2005) took 2542 ms. Trace:
I20260709 13:11:11.787554 29366 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:11.969827 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1567) took 3084 ms (client timeout 2448 ms). Trace:
W20260709 13:11:12.129374 27298 rpcz_store.cc:269] 0709 13:11:08.885049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.887715 (+  2666us) service_pool.cc:224] Handling call
0709 13:11:11.969464 (+3081749us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540031c4d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:11.969690 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372633344}
W20260709 13:11:11.965934 29536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.026s	sys 0.052s
W20260709 13:11:12.143286 29536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.030s	sys 0.064s
I20260709 13:11:12.143828 29562 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.797081 29565 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:12.143709 29365 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:12.113404 29518 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.690s	user 0.011s	sys 0.018s
I20260709 13:11:11.770313 29430 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.007289 29569 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:11.796880 29581 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.323s
I20260709 13:11:12.159165 29565 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:11.970594 27840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 611) took 2484 ms (client timeout 2304 ms). Trace:
W20260709 13:11:12.163180 27840 rpcz_store.cc:269] 0709 13:11:09.485820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.485969 (+   149us) service_pool.cc:224] Handling call
0709 13:11:11.970287 (+2484318us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b5400336b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:11.970462 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150971648}
I20260709 13:11:12.163645 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.164448 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 617) took 1488 ms. Trace:
I20260709 13:11:12.164552 29565 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.164827 27841 rpcz_store.cc:276] 0709 13:11:10.676175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.678459 (+  2284us) service_pool.cc:224] Handling call
0709 13:11:12.163512 (+1485053us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12eee 0000000000375939 00007f9a56c861e0 00007f9a56d4f0c4 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:12.164382 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10967424}
I20260709 13:11:12.144393 29438 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.145025 29353 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.152997 29494 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:11.796682 27149 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:12.167291 29494 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:12.168272 29494 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.160681 29569 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:11.970815 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 616) took 1323 ms. Trace:
I20260709 13:11:12.143168 29556 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:12.113816 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 376763us
I20260709 13:11:12.166610 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:12.144881 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 359509us
I20260709 13:11:12.171777 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:12.164561 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:12.173425 29537 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:12.173645 29563 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.899979 29541 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.171718 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:11.763597 29546 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.174345 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.113744 29325 tablet_bootstrap.cc:492] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
I20260709 13:11:12.185657 29481 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.116592 29554 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.186664 29549 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.187920 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.189576 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1666) took 2762 ms. Trace:
I20260709 13:11:12.165956 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:11.772285 29566 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.426s
I20260709 13:11:11.996757 27232 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:11.958536 29558 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:11.870625 29531 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.790879 29582 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:11.973551 27836 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:12.189725 29546 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.194443 29393 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.192401 29528 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.225294 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:12.202898 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.192373 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.226871 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.227609 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.155429 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.170207 27839 rpcz_store.cc:276] 0709 13:11:10.647536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.732796 (+ 85260us) service_pool.cc:224] Handling call
0709 13:11:10.920598 (+187802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.921512 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.970514 (+1049002us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54004a4a50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:11.970720 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418793728}
I20260709 13:11:12.229841 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.229914 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:12.213599 29270 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.230638 27839 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.224869 29528 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.156620 29568 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.787714 29540 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.166549 29572 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.233345 29577 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.234007 29577 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.927711 29552 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.153160 29364 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.170288 29556 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:12.115541 27154 rpcz_store.cc:276] 0709 13:11:09.433213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.460108 (+ 26895us) service_pool.cc:224] Handling call
0709 13:11:09.460412 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.518245 (+ 57833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.974246 (+2456001us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b54003561d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:11.974474 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131319168}
I20260709 13:11:12.174247 29569 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.185444 27227 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:12.186828 29325 ts_tablet_manager.cc:1403] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 3.848s	user 0.066s	sys 0.083s
I20260709 13:11:12.212214 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 512) took 1164 ms. Trace:
I20260709 13:11:12.144603 27152 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:11.977104 29576 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:12.092650 29304 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.004s
I20260709 13:11:12.228083 29230 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.227712 29531 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.276861 29577 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.277194 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1583) took 1185 ms. Trace:
I20260709 13:11:12.277395 29531 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.230743 27228 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:12.278856 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.280254 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.224339 29558 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.277803 29528 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:12.283192 29525 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.852s	user 0.007s	sys 0.000s
I20260709 13:11:12.284716 29558 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:12.236652 29547 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.300s	user 0.003s	sys 0.000s
I20260709 13:11:12.285104 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1027) took 2501 ms. Trace:
I20260709 13:11:12.237591 27155 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:12.286579 29393 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.287662 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.289201 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.241833 27841 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:12.290982 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.291123 29514 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.239288 27300 rpcz_store.cc:276] 0709 13:11:11.047681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.097644 (+ 49963us) service_pool.cc:224] Handling call
0709 13:11:12.211985 (+1114341us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54001ca7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:12.212121 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202765696}
I20260709 13:11:12.104241 29588 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.947975 29490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.564s	user 0.006s	sys 0.022s
W20260709 13:11:12.292297 29490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.908s	user 0.010s	sys 0.025s
I20260709 13:11:12.292091 29588 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:11.994019 29542 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.259224 29552 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.261338 29556 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.262439 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.297320 27151 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:12.170398 29337 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.244943 29364 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.262451 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.308724 27227 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:12.308547 29364 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.309854 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.310531 27227 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:12.263684 29569 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.265565 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:12.265640 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.189742 29353 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:12.321273 29353 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.179688 29545 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.233369 29568 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.270246 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.330900 27225 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:12.279686 29325 raft_consensus.cc:359] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:12.161782 29430 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.286144 27228 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:12.287288 29393 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.277653 27305 rpcz_store.cc:276] 0709 13:11:11.091993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.126599 (+ 34606us) service_pool.cc:224] Handling call
0709 13:11:12.276383 (+1149784us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:12.276612 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.276851 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.276881 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.276924 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:12.276957 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.277017 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.277119 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19259136}
I20260709 13:11:12.294988 27841 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:12.189993 27231 rpcz_store.cc:276] 0709 13:11:09.426741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.426884 (+   143us) service_pool.cc:224] Handling call
0709 13:11:09.427275 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.714776 (+287501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.189301 (+2474525us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540037a354. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:12.189489 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653371264}
W20260709 13:11:12.298388 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.305938 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.306591 29588 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.307840 29556 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.376051 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:12.311545 29364 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.311370 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:12.313442 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 86029us
I20260709 13:11:12.281294 29304 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.314227 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:12.251484 29576 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.342429 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.378363 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:12.378953 27804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.033s	sys 0.038s
I20260709 13:11:12.380613 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.382119 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:12.312040 29542 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.392436 27225 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:12.396914 29590 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:12.399518 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:12.403755 29490 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.404215 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:12.405151 27229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1681) took 2958 ms (client timeout 1964 ms). Trace:
I20260709 13:11:12.408084 27157 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:12.384218 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 70132.6us
I20260709 13:11:12.333596 29325 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
W20260709 13:11:12.387558 27804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.034s	sys 0.039s
I20260709 13:11:12.382421 29535 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:12.388513 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:12.411803 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.414608 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:12.418471 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.409768 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:12.405596 27229 rpcz_store.cc:269] 0709 13:11:09.446476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.461899 (+ 15423us) service_pool.cc:224] Handling call
0709 13:11:12.404010 (+2942111us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:12.405032 (+  1022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31352192}
I20260709 13:11:12.420639 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:12.415124 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 639556us
I20260709 13:11:12.423243 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:12.429832 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:12.416764 27227 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:12.457693 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.457933 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 782) took 1475 ms. Trace:
I20260709 13:11:12.462868 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:12.431150 29521 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.106s	user 0.010s	sys 0.019s
I20260709 13:11:12.333942 29574 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.138s
I20260709 13:11:12.431775 29590 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.429289 29364 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:12.430336 29535 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:12.475039 27300 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:12.459563 29398 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:12.454202 29545 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:12.433966 29588 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.460078 29558 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.465490 29408 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.484618 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:12.544019 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.544386 27840 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:12.461148 29546 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.518263 27229 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:12.464583 29560 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.493976 29398 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:12.518435 27305 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:12.536243 27302 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:12.468806 29521 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.149s	user 0.010s	sys 0.019s
W20260709 13:11:12.465034 29492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.074s	user 0.013s	sys 0.021s
I20260709 13:11:12.434413 29337 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:12.467727 29493 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:11:12.457541 29528 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.467765 29497 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:12.493921 29305 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.394375 29541 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.497561 29545 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.517215 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:12.581846 27303 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:12.513613 29535 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:12.414215 29490 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.542395 29407 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.549688 29408 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.542191 29385 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:12.465747 29365 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.543675 29551 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:12.575760 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 1993) took 1529 ms. Trace:
I20260709 13:11:12.546609 29575 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:12.498190 29588 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.556128 29492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.177s	user 0.015s	sys 0.023s
I20260709 13:11:12.584245 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.285722 27835 rpcz_store.cc:276] 0709 13:11:09.783772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.849957 (+ 66185us) service_pool.cc:224] Handling call
0709 13:11:09.885066 (+ 35109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.908680 (+ 23614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.911328 (+  2648us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.106311 (+194983us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.125356 (+ 19045us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:10.156759 (+ 31403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.173192 (+ 16433us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.280278 (+2107086us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:12.284643 (+  4365us) raft_consensus.cc:1685] finished
0709 13:11:12.284673 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.284976 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1698,"raft.queue_time_us":2937,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8579,"spinlock_wait_cycles":30693248,"thread_start_us":18621,"threads_started":1,"wal-append.queue_time_us":214014}
I20260709 13:11:12.538645 29427 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:11:12.589926 27301 rpcz_store.cc:276] 0709 13:11:11.046415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.099505 (+ 53090us) service_pool.cc:224] Handling call
0709 13:11:11.099838 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.745089 (+645251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.575467 (+830378us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002675d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:12.575687 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470946048}
I20260709 13:11:12.555868 29398 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:12.570555 29585 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:11:12.578122 29528 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.551674 29494 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.494532 29325 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:12.612355 27149 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.604013 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.589941 29568 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.573518 29543 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:12.606935 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61033us
I20260709 13:11:12.584316 29545 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.589649 29490 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.494808 29542 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.601749 29588 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.582615 29532 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:11:12.629446 29532 consensus_queue.cc:1243] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:12.630089 29532 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:12.630401 29532 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:12.600449 29497 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.631847 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 608) took 3330 ms. Trace:
I20260709 13:11:12.633632 29497 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.620038 27228 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:12.587561 29407 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.622403 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:12.625397 27839 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:12.636195 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:12.555481 29546 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:12.555637 29560 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.628623 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.628760 29542 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.632241 27837 rpcz_store.cc:276] 0709 13:11:09.301630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.329189 (+ 27559us) service_pool.cc:224] Handling call
0709 13:11:09.368589 (+ 39400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.604156 (+235567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.604189 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.604735 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.650143 (+ 45408us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:12.025831 (+2375688us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b180003f700. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf
0709 13:11:12.026104 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.332018 (+305914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.631528 (+299510us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400560254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:12.631581 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.631629 (+    48us) raft_consensus.cc:1685] finished
0709 13:11:12.631641 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.631786 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9793,"prepare.queue_time_us":233505,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":15451,"raft.queue_time_us":2501,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":8675,"spinlock_wait_cycles":597799424,"thread_start_us":596004,"threads_started":3,"wal-append.queue_time_us":614254,"wal-append.run_cpu_time_us":4615,"wal-append.run_wall_time_us":1658343}
W20260709 13:11:12.619460 29595 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:11:12.642273 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.642396 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.606578 29393 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:12.613086 29528 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.647675 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.652760 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.654066 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.657758 29558 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:12.658244 29567 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:12.581983 29576 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.643070 27840 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:11:12.694764 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52413us
I20260709 13:11:12.657070 27156 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:12.631309 29532 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.710083 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.609652 29575 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.640038 27228 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:12.640501 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.627491 29494 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.672621 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1693) took 1072 ms. Trace:
I20260709 13:11:12.675102 29586 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.641866 29568 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.710690 29576 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.645565 29552 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:12.761767 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:12.762755 27156 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:12.752641 27232 rpcz_store.cc:276] 0709 13:11:11.599943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.611161 (+ 11218us) service_pool.cc:224] Handling call
0709 13:11:11.672485 (+ 61324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.226065 (+553580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.672292 (+446227us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54001bb054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:12.672520 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744413440}
I20260709 13:11:12.768025 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2520) took 1016 ms. Trace:
I20260709 13:11:12.751472 29497 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.769683 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 558) took 3129 ms. Trace:
I20260709 13:11:12.770459 29364 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:12.771119 29364 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.771277 29407 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.769711 27228 rpcz_store.cc:276] 0709 13:11:11.752097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.639254 (+887157us) service_pool.cc:224] Handling call
0709 13:11:12.639637 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.727587 (+ 87950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.764873 (+ 37286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:12.775942 27228 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:12.770093 29497 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.779817 29497 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.458540 27834 rpcz_store.cc:276] 0709 13:11:10.982287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.110528 (+128241us) service_pool.cc:224] Handling call
0709 13:11:12.008889 (+898361us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:12.009248 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.009578 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:12.382661 (+373083us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.457546 (+ 74885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.457603 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:12.457659 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.457730 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.457867 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":401,"spinlock_wait_cycles":29311744,"thread_start_us":445241,"threads_started":2}
I20260709 13:11:12.781215 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.781553 27228 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:12.782393 27153 rpcz_store.cc:276] 0709 13:11:09.640493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.640681 (+   188us) service_pool.cc:224] Handling call
0709 13:11:09.648492 (+  7811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.668514 (+ 20022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.668551 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.674598 (+  6047us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.236989 (+2562391us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b18003d2b80. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:12.536207 (+299218us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:12.536249 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.536331 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.765474 (+229143us) raft_consensus.cc:1685] finished
0709 13:11:12.765502 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.769609 (+  4107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28769,"raft.queue_time_us":205,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8541,"spinlock_wait_cycles":2008832,"thread_start_us":298986,"threads_started":1,"wal-append.queue_time_us":2948927}
I20260709 13:11:12.775853 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2017) took 1249 ms. Trace:
I20260709 13:11:12.688901 29558 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.789316 27232 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.784940 27152 rpcz_store.cc:276] 0709 13:11:11.526499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.738400 (+211901us) service_pool.cc:224] Handling call
0709 13:11:11.769276 (+ 30876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.244949 (+475673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.775480 (+530531us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000677d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:12.775764 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862593920}
W20260709 13:11:12.796634 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 92635.9us
I20260709 13:11:12.797516 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.799048 27156 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:12.760584 29568 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.754861 29586 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:12.761000 29561 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.801146 27834 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:12.723451 29416 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:11:12.811674 27155 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:12.768326 29532 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.766736 29552 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:12.810413 29408 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:12.816753 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 791) took 1554 ms. Trace:
I20260709 13:11:12.819793 27834 rpcz_store.cc:276] 0709 13:11:11.253162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.800546 (+1547384us) service_pool.cc:224] Handling call
0709 13:11:12.800882 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.807520 (+  6638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.807822 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:12.805784 27835 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:12.823704 27835 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Advancing to term 4
W20260709 13:11:12.824146 29572 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.020s
I20260709 13:11:12.796726 29538 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:12.790557 29558 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.806074 29568 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.816306 29497 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.829705 29325 ts_tablet_manager.cc:1434] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.568s	user 0.011s	sys 0.000s
W20260709 13:11:12.827108 29569 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.515s	user 0.024s	sys 0.004s
W20260709 13:11:12.837980 29510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.459s	user 0.020s	sys 0.015s
I20260709 13:11:12.881345 27840 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:12.884590 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 620) took 1129 ms. Trace:
I20260709 13:11:12.826326 29552 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:12.885505 29602 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:11:12.872979 29541 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:12.818794 29567 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:11:12.887058 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2510) took 2236 ms. Trace:
I20260709 13:11:12.818640 29566 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:11:12.887398 27226 rpcz_store.cc:276] 0709 13:11:10.651110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.652187 (+  1077us) service_pool.cc:224] Handling call
0709 13:11:10.685177 (+ 32990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.734830 (+ 49653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.734878 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.270468 (+1535590us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b2c00010828. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:12.270901 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.539592 (+268691us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:12.539632 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.539713 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.886733 (+347020us) raft_consensus.cc:1685] finished
0709 13:11:12.886756 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.886975 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142377,"raft.queue_time_us":201504,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":41744,"spinlock_wait_cycles":10887424,"thread_start_us":268271,"threads_started":1,"wal-append.queue_time_us":339745}
I20260709 13:11:12.877115 29546 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:12.891043 29510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.514s	user 0.026s	sys 0.022s
I20260709 13:11:12.891453 29510 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:12.892457 29510 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:12.885085 27840 rpcz_store.cc:276] 0709 13:11:11.755050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.840386 (+1085336us) service_pool.cc:224] Handling call
0709 13:11:12.879244 (+ 38858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.884256 (+  5012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.884515 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:12.842530 29538 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:12.876184 29325 ts_tablet_manager.cc:1467] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Tablet startup took 637ms
I20260709 13:11:12.839946 29353 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.861617 29560 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:12.910290 29558 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:12.925680 27840 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:13.017795 29535 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:12.989334 29527 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:12.964143 29539 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.043182 29558 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.902760 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 789) took 1667 ms. Trace:
W20260709 13:11:12.953284 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.972241 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.741s (SENT) [suppressed 22 similar messages]
I20260709 13:11:12.960160 27838 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.966065 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 794) took 1209 ms. Trace:
I20260709 13:11:13.043067 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 622) took 1287 ms. Trace:
W20260709 13:11:13.101472 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 129272us
I20260709 13:11:13.101907 27840 rpcz_store.cc:276] 0709 13:11:11.755549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.894874 (+1139325us) service_pool.cc:224] Handling call
0709 13:11:12.925349 (+ 30475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.042767 (+117418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.043005 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:12.963785 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.037271 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:11:13.039372 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 339923us
I20260709 13:11:13.016089 27833 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:13.016671 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2015) took 1541 ms. Trace:
W20260709 13:11:13.094810 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.101619 27834 rpcz_store.cc:276] 0709 13:11:11.756398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.964871 (+1208473us) service_pool.cc:224] Handling call
0709 13:11:12.965243 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.965622 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.965653 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.965738 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:12.965779 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.965845 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.965983 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":529,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":133}
I20260709 13:11:13.111418 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 615) took 2464 ms. Trace:
W20260709 13:11:13.113608 27807 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.906s (SENT)
I20260709 13:11:13.114331 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:13.111776 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1037) took 1347 ms. Trace:
I20260709 13:11:13.107712 27148 rpcz_store.cc:276] 0709 13:11:11.475402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.475574 (+   172us) service_pool.cc:224] Handling call
0709 13:11:11.503628 (+ 28054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.568637 (+ 65009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.568671 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:11.568711 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:11.568740 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.016373 (+1447633us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b54001ae0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:13.016432 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.016577 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149017856}
W20260709 13:11:12.953320 29556 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.009s
W20260709 13:11:12.937069 29600 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:11:13.111841 27838 rpcz_store.cc:276] 0709 13:11:10.647198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.647352 (+   154us) service_pool.cc:224] Handling call
0709 13:11:10.654151 (+  6799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.959958 (+2305807us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5400336920. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:11:13.111096 (+151138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.111352 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44932480}
I20260709 13:11:13.043485 29527 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:13.016037 27835 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:12.925117 29353 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:13.100056 29337 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.156189 27157 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2018) took 1590 ms (client timeout 1830 ms). Trace:
I20260709 13:11:13.117865 27833 rpcz_store.cc:276] 0709 13:11:11.763941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.015446 (+1251505us) service_pool.cc:224] Handling call
0709 13:11:13.015857 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.111393 (+ 95536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.111707 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.095552 29539 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:13.053898 29393 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.139192 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:12.948105 29575 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.139230 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.020567 29568 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.053547 29562 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.963099 29327 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.151456 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:13.211388 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60022.9us
I20260709 13:11:13.053578 29437 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.895412 29497 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.157104 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.135501 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.157825 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:12.951614 29364 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.100144 27836 rpcz_store.cc:276] 0709 13:11:11.232340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.681372 (+449032us) service_pool.cc:224] Handling call
0709 13:11:11.973090 (+291718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.223463 (+250373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.877262 (+653799us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400336b50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:12.899517 (+ 22255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669895936}
I20260709 13:11:13.159288 29509 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.160995 29337 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:13.156709 27157 rpcz_store.cc:269] 0709 13:11:11.552114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.555390 (+  3276us) service_pool.cc:224] Handling call
0709 13:11:13.141839 (+1586449us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54000de654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:13.141999 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876595968}
I20260709 13:11:13.164052 29353 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.164846 27197 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:13.238610 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 73873.8us
I20260709 13:11:13.238890 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:13.157806 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.036403 29398 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:13.166208 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.210248 29575 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:13.122721 29305 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:13.170392 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:13.170229 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 57572.7us
I20260709 13:11:12.953001 29588 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.111080 29546 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.172250 29527 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.096558 29545 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.137034 29528 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.036019 29538 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.179136 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:13.180060 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1033) took 1808 ms. Trace:
W20260709 13:11:12.905663 29325 ts_tablet_manager.cc:1469] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Trace:
0709 13:11:01.792907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.793137 (+   230us) service_pool.cc:224] Handling call
0709 13:11:02.476324 (+683187us) ts_tablet_manager.cc:934] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249)
0709 13:11:04.143763 (+1667439us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:04.304247 (+160484us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:04.311192 (+  6945us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:05.606193 (+1295001us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:05.624671 (+ 18478us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:05.690212 (+ 65541us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:05.835251 (+145039us) inbound_call.cc:177] Queueing success response
0709 13:11:06.361835 (+526584us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b4c001d4200. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50003a20 00007f9a50014a29 00007f9a5001513f 00007f9a4ffd92ab 00007f9a50006f3c 00007f9a50007461 00007f9a50007768 00007f9a55d8d66b 00007f9a56cca15b 00007f9a56cc9f98 00007f9a56cbb322
0709 13:11:08.338274 (+1976439us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:12.259216 (+3920942us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:12.259907 (+   691us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:12.260568 (+   661us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":33141,"raft.queue_time_us":8610,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":8011,"spinlock_wait_cycles":22260480,"tablet-copy.queue_time_us":428183,"tablet-download-pool.queue_time_us":18272,"tablet-download-pool.run_cpu_time_us":4401,"tablet-download-pool.run_wall_time_us":1995742,"thread_start_us":304033,"threads_started":2}
I20260709 13:11:12.948758 29586 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.188926 27230 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:12.946897 29494 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.022616 29552 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.209110 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.213897 27148 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:13.188256 29535 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.263536 29535 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.264015 29535 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.264325 29620 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:13.264928 29620 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.265331 29620 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.266296 29535 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.267498 29535 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.267956 29535 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.235337 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:13.270255 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 164546us
I20260709 13:11:13.236893 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.271837 27153 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:13.242069 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:13.166425 29430 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.239676 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:13.248610 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:13.206741 29393 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.243692 29327 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.288067 27154 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:13.253226 29576 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.257849 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.292469 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.292879 27230 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:13.261840 27151 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:13.270622 27157 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:13.243244 29415 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:13.276621 27837 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:13.243687 27225 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:13.222342 29437 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.302582 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.303987 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.304597 27225 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:13.305413 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.285710 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.214349 29562 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:13.289384 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47467.3us
W20260709 13:11:13.291106 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 177574us
I20260709 13:11:13.285008 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:13.308516 27123 leader_election.cc:336] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.670s (SENT)
I20260709 13:11:13.270016 29535 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.295210 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.314997 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.315582 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:13.282867 29516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.353s	user 0.014s	sys 0.027s
I20260709 13:11:13.293116 27231 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:13.275898 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:13.296952 29532 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:13.318102 29516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.424s	user 0.015s	sys 0.027s
I20260709 13:11:13.339919 29532 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.340348 29532 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:13.252521 29546 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.296965 29586 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.342124 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:13.342739 29555 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:13.343263 29555 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:13.320333 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.344146 27153 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:13.344291 29555 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.344986 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.345598 29555 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.345829 27153 raft_consensus.cc:2410] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:11:13.351065 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75253.9us
I20260709 13:11:13.287081 29560 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:13.316799 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 104490us
I20260709 13:11:13.316828 29347 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:13.338846 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.299470 29494 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:13.290293 29430 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.297844 29327 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.255589 29305 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.257063 29509 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:11:13.342633 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.301383 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.314203 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.335546 29364 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.346869 29353 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.355846 29571 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.338838 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.327184 29569 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.358165 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2022) took 1754 ms. Trace:
I20260709 13:11:13.309954 29576 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:13.410029 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.352207 29550 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:13.338387 29458 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:13.356609 27224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1698) took 1749 ms (client timeout 1670 ms). Trace:
I20260709 13:11:13.328944 29437 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.337666 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2567) took 1072 ms. Trace:
I20260709 13:11:13.347134 29568 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.415599 27155 rpcz_store.cc:276] 0709 13:11:12.264910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.305465 (+ 40555us) service_pool.cc:224] Handling call
0709 13:11:13.337449 (+1031984us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400069fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:13.337571 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998944000}
I20260709 13:11:13.395974 29347 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:13.333846 27832 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:13.331945 27123 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.684s (SENT)
W20260709 13:11:13.413784 27224 rpcz_store.cc:269] 0709 13:11:11.607413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.738550 (+131137us) service_pool.cc:224] Handling call
0709 13:11:13.356366 (+1617816us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400125cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:13.356510 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895635328}
I20260709 13:11:13.418490 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:13.321096 29561 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:11:13.320892 29612 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:13.334647 29588 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.330657 29528 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.333606 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1038) took 1569 ms. Trace:
I20260709 13:11:13.432904 27833 rpcz_store.cc:276] 0709 13:11:11.764213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.218673 (+1454460us) service_pool.cc:224] Handling call
0709 13:11:13.219024 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.253692 (+ 34668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.253734 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.253777 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:13.253823 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.333264 (+ 79441us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5400753d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:13.333335 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.333525 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79185152}
I20260709 13:11:13.331421 29393 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.322554 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.333551 29562 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.351074 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1042) took 1585 ms. Trace:
I20260709 13:11:13.416357 29624 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.316092 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.348559 29337 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.254492 29366 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:13.249532 29539 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.346611 27195 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:13.380831 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:13.451792 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 71075.7us
I20260709 13:11:13.326992 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.400130 27225 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.361176 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1043) took 1589 ms. Trace:
I20260709 13:11:13.254269 27835 rpcz_store.cc:276] 0709 13:11:11.371324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.823173 (+1451849us) service_pool.cc:224] Handling call
0709 13:11:12.823532 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.142814 (+319282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.179976 (+ 37162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.408442 27149 rpcz_store.cc:276] 0709 13:11:11.603485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.169165 (+565680us) service_pool.cc:224] Handling call
0709 13:11:12.169445 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.612802 (+443357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.357854 (+745052us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54002e7cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:13.358086 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018121088}
I20260709 13:11:13.424585 29621 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:13.351260 29556 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.339526 29567 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.412400 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.476624 27157 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:13.385854 29560 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.449806 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.565399 29560 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.565111 29558 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:13.565874 29619 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:11:13.566123 27297 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:13.442636 27836 rpcz_store.cc:276] 0709 13:11:11.765323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.243438 (+1478115us) service_pool.cc:224] Handling call
0709 13:11:13.288856 (+ 45418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.310212 (+ 21356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.314481 (+  4269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.350655 (+ 36174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:13.350726 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.350839 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.350994 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.441920 29416 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:13.338930 29497 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.325235 29552 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.339735 29398 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:13.414561 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.452085 29588 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.328362 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.421654 27155 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:13.409454 29571 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:13.626389 27155 pending_rounds.cc:85] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 1
I20260709 13:11:13.399317 29415 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:11:13.429705 27152 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:13.430747 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.413213 29458 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:13.441501 27301 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:13.445247 27148 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:13.419837 29347 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.448983 27833 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:13.423060 29493 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.452966 27838 rpcz_store.cc:276] 0709 13:11:11.772079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.360197 (+1588118us) service_pool.cc:224] Handling call
0709 13:11:13.360530 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.360735 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.360775 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.360834 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:13.360884 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.360962 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.361097 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.478812 29539 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:13.459342 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 112809us
I20260709 13:11:13.414044 29569 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:13.437882 29548 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.648075 29548 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:13.413256 29550 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.476123 29567 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:13.652019 29567 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.653498 29567 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.336998 29385 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:13.654264 29385 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:13.619812 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.626677 27155 pending_rounds.cc:107] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:13.448271 29420 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.622713 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 145822us
I20260709 13:11:13.463806 29568 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.629974 27299 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.324031 29545 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.675848 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.676612 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.677927 27306 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:13.635711 29497 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:13.692799 27152 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:13.636265 29588 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.642686 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 797) took 1164 ms. Trace:
I20260709 13:11:13.455744 29624 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.658322 27157 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:11:13.662833 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.696556 27833 rpcz_store.cc:276] 0709 13:11:12.477869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.445652 (+967783us) service_pool.cc:224] Handling call
0709 13:11:13.446122 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.632068 (+185946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.642623 (+ 10555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:13.633440 27156 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:13.666239 27148 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:13.662827 27155 raft_consensus.cc:2889] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:13.631973 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 300044us
W20260709 13:11:13.680059 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.713s (SENT)
I20260709 13:11:13.706290 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:13.681591 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.631238 29558 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:11:13.682855 27305 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:13.480043 29621 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.632234 29393 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.694474 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.711706 27304 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:13.641265 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:13.708297 27123 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.797s (SENT)
W20260709 13:11:13.717274 27123 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.966s (SENT)
I20260709 13:11:13.690259 27300 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:13.627003 29416 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.697059 29497 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.723194 27305 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:13.713920 27225 raft_consensus.cc:2410] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:11:13.720990 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 330942us
I20260709 13:11:13.694321 29627 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:13.726989 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46972.2us
I20260709 13:11:13.695719 29634 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.728569 27841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 618) took 1974 ms (client timeout 2115 ms). Trace:
W20260709 13:11:13.730681 27841 rpcz_store.cc:269] 0709 13:11:11.754500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.290680 (+536180us) service_pool.cc:224] Handling call
0709 13:11:13.728370 (+1437690us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b54005a1c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:13.728497 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7504768}
I20260709 13:11:13.702193 29548 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.674680 29420 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:13.752585 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.750149 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.750959 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.756855 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.761299 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:13.720489 29545 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.759545 29622 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:13.749213 29639 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:13.773268 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.774600 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:13.775769 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:13.758980 27299 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:13.776337 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.777236 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.757697 29634 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:13.768867 29620 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.002s
I20260709 13:11:13.728680 27297 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:13.709358 29458 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.770254 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.787382 27305 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:13.788388 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.789469 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.728322 29497 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.793233 29420 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.793813 29640 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.726774 29393 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.794885 27305 raft_consensus.cc:2410] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:13.752863 29627 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.786263 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.757700 29327 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.797648 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.760238 29576 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.800601 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.795782 27840 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:13.799085 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:13.803793 27305 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:13.799431 27304 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:13.780112 29556 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.759685 29509 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:11:13.824668 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.806893 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:13.805088 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:13.825934 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64764.9us
I20260709 13:11:13.827042 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:13.762605 29305 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.782859 29492 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:13.820586 29563 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:13.842770 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 69219.8us
I20260709 13:11:13.797726 29620 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.833487 29548 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:13.832679 29407 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:13.797459 29385 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.804631 29543 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:13.852217 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:13.794863 29545 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:13.800437 29528 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:11:13.837073 29337 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:13.833129 29492 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:13.808127 29574 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:13.841279 29576 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:13.834297 29420 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:11:13.861163 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.829708 29556 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.862609 27839 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:13.873682 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.874632 27304 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:13.875463 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.876191 27304 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:13.855129 29569 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.865180 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2516) took 2124 ms. Trace:
I20260709 13:11:13.866245 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:13.857689 29548 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:13.834141 29640 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:11:13.855626 29407 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.867625 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.849825 29563 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:13.861799 29550 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:13.891112 29556 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:13.891486 29545 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.891912 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:13.892765 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.893297 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.892937 29563 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.895915 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 619) took 2141 ms. Trace:
I20260709 13:11:13.879166 27229 rpcz_store.cc:276] 0709 13:11:11.740659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.547937 (+807278us) service_pool.cc:224] Handling call
0709 13:11:12.566817 (+ 18880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.636082 (+ 69265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.636103 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.636132 (+    29us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:12.636159 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.864950 (+1228791us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54001db0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:13.864998 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.865119 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158794624}
I20260709 13:11:13.884436 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.896364 27837 rpcz_store.cc:276] 0709 13:11:11.754799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.653789 (+898990us) service_pool.cc:224] Handling call
0709 13:11:13.895711 (+1241922us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400721854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:13.895850 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384754048}
I20260709 13:11:13.855806 29633 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:13.864537 29492 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:13.885921 29407 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:13.899900 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 72215.9us
I20260709 13:11:13.880069 29509 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:13.909430 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:13.892262 29497 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:13.915439 27224 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:13.879621 29416 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:13.927373 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:13.917549 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61101.6us
I20260709 13:11:13.912665 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:13.922719 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:13.979668 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.980705 27304 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:13.926641 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.872606 29576 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.929520 29588 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:13.945652 29642 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:13.953768 29550 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:13.954173 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.908186 29551 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.957181 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.886363 29625 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.928042 27303 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.883953 29560 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:13.915939 29337 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:13.967844 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:13.916503 29509 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:13.972894 29347 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:13.992761 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:13.897482 29353 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:14.067950 27841 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:13.956369 29532 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.003s
I20260709 13:11:13.943493 29633 consensus_queue.cc:1243] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:14.069182 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.076659 27232 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
W20260709 13:11:14.082985 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.078469 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.083745 27304 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.001859 27225 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:14.085467 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.085251 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.089200 27226 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:14.090632 27841 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:14.091954 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.093757 29509 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:14.096577 29347 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.086962 29625 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.090615 29532 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:14.098160 27832 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:14.045372 29533 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.099895 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.100694 27305 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:14.103327 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.103951 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.104414 27150 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.105706 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.107097 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:14.093146 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 107813us
I20260709 13:11:14.109493 27303 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
W20260709 13:11:14.115785 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.117530 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.117993 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.086740 29550 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.086899 29627 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.142284 29337 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.142531 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.143102 27229 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:14.116895 29497 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.124941 29509 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.054530 29430 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.130259 27304 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:14.044525 29385 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.005365 29546 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.013702 29621 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.076404 29353 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:14.181414 29353 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.182817 29353 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.182868 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.183590 27299 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5. Re-sending same reply.
I20260709 13:11:14.184698 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.185946 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.187390 27299 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:14.187927 29546 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.188439 29546 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:14.190924 29546 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.194851 29560 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.121754 29527 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.002894 29543 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 13:11:14.105372 29493 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:14.088280 29624 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:14.135382 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:14.138398 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.205132 27226 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
W20260709 13:11:14.136109 27123 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.964s (SENT)
I20260709 13:11:14.139313 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.139858 29494 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:14.141851 27839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 798) took 1662 ms (client timeout 2082 ms). Trace:
W20260709 13:11:14.207743 27839 rpcz_store.cc:269] 0709 13:11:12.479152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.635681 (+156529us) service_pool.cc:224] Handling call
0709 13:11:13.341919 (+706238us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:14.141586 (+799667us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54005e6854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:14.141781 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207817344}
I20260709 13:11:14.208892 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.209017 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.143272 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:14.210196 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 74126.1us
I20260709 13:11:14.210378 27306 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:14.211660 27306 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:14.126945 29555 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.781s	user 0.015s	sys 0.000s
I20260709 13:11:14.214738 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.215390 27152 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
I20260709 13:11:14.215572 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1045) took 1140 ms. Trace:
I20260709 13:11:14.216233 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.147521 29550 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.216816 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.217424 27149 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.125999 29407 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.148473 27832 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:14.148676 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 802) took 1106 ms. Trace:
W20260709 13:11:14.150431 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.153435 29347 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.036760 29548 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.147584 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2527) took 1906 ms. Trace:
I20260709 13:11:14.136029 27224 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:14.154940 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.155591 29538 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.156349 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.157248 29571 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.159449 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.161803 29393 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.163756 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.161913 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.240114 27303 raft_consensus.cc:2410] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:14.238641 27838 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
W20260709 13:11:14.137550 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.237778 27833 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:14.241786 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.242475 27833 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.172950 29625 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.161844 27229 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:14.243854 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.244436 27229 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 1.
W20260709 13:11:14.174176 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 222337us
I20260709 13:11:14.175650 29532 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.179037 29576 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.177838 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.224949 29304 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.216114 27840 rpcz_store.cc:276] 0709 13:11:13.075441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.156162 (+ 80721us) service_pool.cc:224] Handling call
0709 13:11:14.215342 (+1059180us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:14.215487 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260813056}
I20260709 13:11:14.218956 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.219988 27148 raft_consensus.cc:2410] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:14.226334 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:14.277990 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51733.7us
W20260709 13:11:14.227312 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.228118 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.279325 27839 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 2: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:14.280432 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.281559 27839 raft_consensus.cc:2368] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:14.231015 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.233475 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.282665 27152 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:14.236330 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.283768 27841 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:14.214864 29494 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.239775 27231 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:14.290413 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:14.248342 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.291487 27224 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:14.249228 27167 tablet_copy_service.cc:342] P 1010256288ec4502b330749e2e3d7c85: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-9f9dfa4361254d838c2b61576ada60f4 received from {username='slave'} at 127.0.0.1:47438
I20260709 13:11:14.249863 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.235224 27228 rpcz_store.cc:276] 0709 13:11:12.241211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.777122 (+535911us) service_pool.cc:224] Handling call
0709 13:11:12.777538 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.787465 (+  9927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.147208 (+1359743us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b54001270d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:14.147501 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6644096}
W20260709 13:11:14.260238 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.260999 27232 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:14.263249 27304 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:14.083626 29551 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.264922 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.230618 29528 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.299569 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.300449 27231 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:14.301582 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.288982 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2023) took 1869 ms. Trace:
I20260709 13:11:14.289242 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2024) took 1869 ms. Trace:
I20260709 13:11:14.306836 27154 rpcz_store.cc:276] 0709 13:11:12.419641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.419801 (+   160us) service_pool.cc:224] Handling call
0709 13:11:14.288773 (+1868972us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54001adbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:14.288924 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898494720}
W20260709 13:11:14.309284 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44464us
I20260709 13:11:14.309607 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.293112 27841 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:14.312116 27841 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:14.314252 27230 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:11:14.314635 27230 pending_rounds.cc:85] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
I20260709 13:11:14.314885 27230 pending_rounds.cc:107] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:11:14.315130 27230 raft_consensus.cc:2889] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.316623 27230 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:14.293283 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.318856 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:14.319545 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.319469 27152 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:14.293973 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.303222 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.320595 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.321247 27229 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:14.304098 27838 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:14.304864 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.275676 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:14.297603 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.289547 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:14.325629 29641 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:11:14.326475 27148 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:14.310403 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.328368 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2578) took 1148 ms. Trace:
I20260709 13:11:14.328735 27157 rpcz_store.cc:276] 0709 13:11:13.179668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.637928 (+458260us) service_pool.cc:224] Handling call
0709 13:11:13.638288 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.698317 (+ 60029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.328138 (+629821us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540012c0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:14.328309 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45240704}
I20260709 13:11:14.330349 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.331364 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.331681 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.332134 27302 raft_consensus.cc:2368] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:14.333317 29393 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:14.334154 29393 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:14.335080 29327 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:14.335501 29624 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:14.335932 29624 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:14.335176 29393 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.338752 27298 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.334981 29550 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.341251 29550 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.341645 29550 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.336930 29624 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.347121 29624 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.351356 29550 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.352175 29640 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.354851 29550 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.357271 29560 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:14.317754 27230 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.358520 29560 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.358922 29560 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:14.359578 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.360489 29546 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.357553 29634 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.359741 29560 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.361837 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2029) took 1215 ms. Trace:
I20260709 13:11:14.362691 29560 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.363145 27223 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:14.363622 27223 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:14.362285 27149 rpcz_store.cc:276] 0709 13:11:13.145948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.454560 (+308612us) service_pool.cc:224] Handling call
0709 13:11:13.454914 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.217845 (+762931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.361583 (+143738us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54000df054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:14.361772 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753070336}
I20260709 13:11:14.365670 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.366041 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:14.366300 27149 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 1.
I20260709 13:11:14.366863 29634 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:14.367127 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.367403 29634 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:14.367797 27149 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:14.368518 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.307554 27151 rpcz_store.cc:276] 0709 13:11:12.420020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.420141 (+   121us) service_pool.cc:224] Handling call
0709 13:11:12.459301 (+ 39160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.293311 (+834010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.289004 (+995693us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400357d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:14.289184 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844985728}
I20260709 13:11:14.235033 29493 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:11:14.235421 29347 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:14.234862 29385 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:11:14.382221 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.416033 27226 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:14.369544 27050 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.292255 29430 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:14.391074 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.383852 27155 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:14.381232 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.420536 27156 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.386140 27223 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.393667 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.421777 27230 raft_consensus.cc:2410] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:11:14.395253 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.399415 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.422607 27154 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:14.413102 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.414350 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:14.417761 27837 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:14.417155 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:14.426671 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 111706us
I20260709 13:11:14.427037 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:14.418181 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.423568 27839 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:14.428184 27833 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:14.428203 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.430856 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:14.431002 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.371707 29644 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:14.432808 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:14.436030 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.436848 27050 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.449887 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.450783 27838 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:14.451958 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.452728 27223 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.454244 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.455056 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.455808 27055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 383) took 6250 ms. Trace:
I20260709 13:11:14.446938 27228 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:14.456418 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.457513 27839 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:14.419970 29568 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.001s
I20260709 13:11:14.465312 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:14.440784 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.398803 27167 tablet_copy_service.cc:434] P 1010256288ec4502b330749e2e3d7c85: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-9f9dfa4361254d838c2b61576ada60f4 on tablet 9f9dfa4361254d838c2b61576ada60f4 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.382742 29532 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.308593 29646 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:14.444906 27149 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
W20260709 13:11:14.459401 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 194046us
I20260709 13:11:14.439168 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:14.482388 27833 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:14.441999 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.462338 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:14.426103 29567 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 13:11:14.470590 27837 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:14.472734 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.454787 27050 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.485425 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.488250 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:14.489980 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48081.8us
I20260709 13:11:14.490809 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.459438 29645 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:14.453903 29638 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:14.495618 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.544031 27305 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.497754 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:14.495273 27050 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.499768 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:14.545137 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47486.7us
I20260709 13:11:14.454277 29393 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:14.505067 27832 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:14.498652 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.472110 29324 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.535972 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.498405 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.521654 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.559837 27151 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.431890 29550 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.503260 27839 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 3 LEARNER]: Advancing to term 5
I20260709 13:11:14.225750 27836 rpcz_store.cc:276] 0709 13:11:13.042557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.567986 (+525429us) service_pool.cc:224] Handling call
0709 13:11:13.568359 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.676106 (+107747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.679119 (+  3013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.695847 (+ 16728us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:13.699883 (+  4036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.148314 (+448431us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400882054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:14.148381 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.148548 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201684736}
I20260709 13:11:14.446287 29588 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.446465 29437 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:14.544076 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63218.2us
W20260709 13:11:14.555285 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55633.8us
I20260709 13:11:14.425002 29420 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
W20260709 13:11:14.508517 29492 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
W20260709 13:11:14.557709 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59140.1us
W20260709 13:11:14.559249 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60935.3us
I20260709 13:11:14.536372 29327 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.382289 29634 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.492266 29398 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.492048 29539 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:11:14.485137 29558 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.568624 27223 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:14.489423 29568 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.494844 29415 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.573369 29627 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.577800 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.614292 27300 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:14.504882 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.509351 29644 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:14.587352 27122 leader_election.cc:400] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:14.587795 27050 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.586499 29355 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:14.631524 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.625962 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48228.5us
I20260709 13:11:14.633981 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.634739 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.595614 27149 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:14.552035 29638 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:14.638585 29638 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:14.566962 27298 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:14.594242 29492 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.640367 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.641546 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.560649 29393 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.552302 29527 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.594506 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:14.456164 27055 rpcz_store.cc:276] 0709 13:11:08.185238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.186360 (+  1122us) service_pool.cc:224] Handling call
0709 13:11:14.434896 (+6248536us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:09.742230 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:09.760011 (+ 17781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:09.760050 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:09.760068 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:09.760979 (+   911us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:09.761041 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:09.761066 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:09.761669 (+   603us) tablet.cc:701] Row locks acquired
0709 13:11:09.761683 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:09.761835 (+   152us) write_op.cc:270] Start()
0709 13:11:09.761971 (+   136us) write_op.cc:276] Timestamp: P: 1783602669761785 usec, L: 0
0709 13:11:09.761998 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:11:09.885150 (+123152us) log.cc:844] Serialized 2862 byte log entry
0709 13:11:10.176121 (+290971us) op_driver.cc:464] REPLICATION: finished
0709 13:11:12.184158 (+2008037us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a5576def0
0709 13:11:12.658332 (+474174us) write_op.cc:301] APPLY: starting
0709 13:11:12.658462 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:12.658682 (+   220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:12.658707 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:12.726610 (+ 67903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:12.777859 (+ 51249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:11:12.777917 (+    58us) write_op.cc:312] APPLY: finished
0709 13:11:12.778248 (+   331us) log.cc:844] Serialized 59 byte log entry
0709 13:11:13.131282 (+353034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.138640 (+  7358us) write_op.cc:454] Released schema lock
0709 13:11:13.138700 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:13.139233 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.139282 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35554,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2341629,"apply.run_cpu_time_us":30076,"apply.run_wall_time_us":492718,"num_ops":7,"prepare.queue_time_us":255884,"prepare.run_cpu_time_us":4615,"prepare.run_wall_time_us":164077,"replication_time_us":370356,"spinlock_wait_cycles":277128576,"thread_start_us":2727933,"threads_started":3,"wal-append.queue_time_us":273694,"wal-append.run_cpu_time_us":1321,"wal-append.run_wall_time_us":1002055}]]}
W20260709 13:11:14.600900 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 109691us
I20260709 13:11:14.587388 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.559980 29646 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:14.558907 29621 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:14.603720 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 545) took 1442 ms. Trace:
I20260709 13:11:14.565887 29562 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.528899 29557 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:11:14.653975 29355 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.682688 29557 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.683128 29557 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:14.684017 29557 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.684684 29355 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:14.685257 29557 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.570422 29645 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.659633 29398 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.688405 29366 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.688840 29366 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:14.641551 29492 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.668439 29562 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.691131 29562 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.632673 29644 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:14.613175 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.702376 29644 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.702724 27302 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:14.569962 29324 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:14.615909 29658 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:11:14.616433 29458 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.552716 29576 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:11:14.621634 29437 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:14.477876 29416 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:14.611673 29415 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.595952 29407 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.591380 29327 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.626154 27305 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:14.494001 29532 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.630631 27122 leader_election.cc:403] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:14.729092 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.642234 27150 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:14.643445 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.644920 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.578315 29545 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:11:14.736935 29545 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:14.725199 29437 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.737370 29545 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:14.575546 29588 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:14.738307 29588 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:14.624812 29408 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 13:11:14.654629 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60218.7us
I20260709 13:11:14.741739 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:14.743243 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.650231 27151 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:14.745409 29664 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:11:14.745517 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:14.659363 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.747275 27299 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:14.662792 27839 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:14.662684 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:14.748869 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 86256.9us
I20260709 13:11:14.664479 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:14.662480 27223 rpcz_store.cc:276] 0709 13:11:13.161711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.357307 (+195596us) service_pool.cc:224] Handling call
0709 13:11:13.357558 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.363042 (+1005484us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b540020fe20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:11:14.603415 (+240373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.603669 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225288064}
I20260709 13:11:14.634153 29567 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:14.675254 29305 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.650810 29393 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:14.622670 29558 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.762534 29510 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:14.771911 29558 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.636435 29627 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.774024 29627 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:14.505267 29541 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.693727 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:14.694591 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 107308us
W20260709 13:11:14.701251 29655 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 13:11:14.709514 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.776595 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.710747 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.718686 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.658339 29574 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.662277 29621 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.811184 29621 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.668910 29353 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:14.711428 29533 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 13:11:14.727803 29415 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.831166 29353 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.837620 29353 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.732959 29324 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.726238 29416 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.735649 29532 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:14.744334 27195 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.839233 29416 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:14.839990 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 95722.7us
I20260709 13:11:14.711645 29640 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:14.754422 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.662979 29527 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:14.689685 29366 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:14.766156 29645 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:11:14.766665 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 179452us
I20260709 13:11:14.766885 29624 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:14.767225 29385 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:14.767490 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:14.767946 29567 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.764309 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:14.710388 29347 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:14.948796 29532 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.789525 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:14.790740 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:14.746871 29327 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.792603 27123 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:14.746722 29566 raft_consensus.cc:2764] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:14.817044 27156 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:15.113341 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:15.114173 27156 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:14.828980 29561 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:14.829685 29430 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.833120 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2037) took 1033 ms. Trace:
I20260709 13:11:14.833429 27157 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:14.766789 29546 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.753093 29568 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.947347 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:14.946264 27299 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.767418 29625 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:11:14.949858 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 285454us
W20260709 13:11:15.024613 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.777794 27302 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:15.086445 27306 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:14.939961 29555 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.022590 29662 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.419s	user 0.000s	sys 0.003s
I20260709 13:11:15.135025 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:15.117602 27155 rpcz_store.cc:276] 0709 13:11:13.800176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.800351 (+   175us) service_pool.cc:224] Handling call
0709 13:11:14.832889 (+1032538us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:14.833055 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327843712}
I20260709 13:11:15.136904 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:15.125797 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51689.9us
W20260709 13:11:15.137820 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 190574us
I20260709 13:11:15.068324 29355 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.081746 29567 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:15.168196 29567 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.168658 29497 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:15.169106 29497 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:15.171767 27227 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:15.172143 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:15.173276 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:14.834576 29574 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.176259 29574 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.180783 27227 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:15.182219 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:15.171767 27228 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:15.129035 29668 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.105975 29548 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:15.156088 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:15.155129 29355 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.126576 29430 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.240293 29620 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:14.840951 29646 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.118988 29509 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:15.161481 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 382531us
I20260709 13:11:15.162824 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:15.163807 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.164676 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:15.266917 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 102349us
I20260709 13:11:15.139389 27195 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:15.270526 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 131213us
I20260709 13:11:15.127770 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:15.074366 29634 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:15.282678 29571 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.282995 29634 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:15.283432 29634 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:15.284359 29634 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.285593 29634 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.211763 27227 raft_consensus.cc:2410] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:15.085116 29624 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:15.289060 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 126293us
W20260709 13:11:15.277837 29538 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.038s	user 0.028s	sys 0.023s
I20260709 13:11:15.116176 29407 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.241734 27155 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:15.137001 29493 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:11:15.151623 29673 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:15.150000 29677 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:15.368330 29677 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.368968 29677 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:15.264130 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:15.273411 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.276229 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:15.263473 29548 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.278306 29568 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:15.278762 29645 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.278908 29625 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:15.280385 29533 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:15.234578 27306 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:15.271705 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:15.408694 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 137064us
I20260709 13:11:15.409482 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:15.152220 29532 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:11:15.160315 29562 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.236857 29668 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.304442 29545 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:15.306154 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 586) took 1083 ms. Trace:
W20260709 13:11:15.306598 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.169945 29497 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.434913 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:15.392709 29568 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.338899 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:15.149554 29555 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.182233 29567 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.363243 29673 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.392752 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.287438 29627 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.416990 29645 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:15.287923 29509 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:15.340078 29672 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.440143 29678 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.399595 29538 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.424047 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:15.446589 27151 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:15.449846 27269 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:15.420174 27148 rpcz_store.cc:276] 0709 13:11:14.222944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.327539 (+104595us) service_pool.cc:224] Handling call
0709 13:11:14.327819 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.371928 (+ 44109us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:14.388902 (+ 16974us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.725437 (+336535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.725496 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:14.725556 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.744815 (+ 19259us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:15.305835 (+561020us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b5400069ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:15.305891 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.306085 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65810,"prepare.queue_time_us":18628,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":13603,"raft.queue_time_us":107108,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3189,"spinlock_wait_cycles":173528832,"thread_start_us":245928,"threads_started":2,"wal-append.queue_time_us":227265}
W20260709 13:11:15.450747 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.469244 29545 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:15.505029 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:15.451169 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.452683 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:15.453174 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:15.454521 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:15.455319 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:15.458127 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:15.458416 29355 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:15.459595 29576 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:15.461457 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:15.462203 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 196163us
I20260709 13:11:15.515136 27123 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:15.517184 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:15.504740 29538 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.502951 29672 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:15.523547 29672 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.526809 29625 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:15.527371 29625 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.527933 29625 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:15.528614 29550 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.959s	user 0.006s	sys 0.009s
I20260709 13:11:15.529116 29550 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:15.530611 29494 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.227s	user 0.026s	sys 0.039s
I20260709 13:11:15.531096 29494 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.533215 29494 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.508912 29678 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.535667 29624 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:15.536783 29548 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.538786 27154 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:15.540027 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2045) took 1177 ms. Trace:
I20260709 13:11:15.540403 27149 rpcz_store.cc:276] 0709 13:11:14.362216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.478940 (+116724us) service_pool.cc:224] Handling call
0709 13:11:14.595440 (+116500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.636126 (+ 40686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.539803 (+903677us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000677d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:15.539959 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267127680}
I20260709 13:11:15.541215 29567 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.542006 27149 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:15.542464 29645 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:15.468336 29541 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.694s	user 0.025s	sys 0.023s
W20260709 13:11:15.330116 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.445749 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:15.469998 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.318552 29638 consensus_meta.cc:287] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.679s	user 0.003s	sys 0.033s
I20260709 13:11:15.432209 29633 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:15.474022 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:15.559298 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 543) took 1062 ms. Trace:
I20260709 13:11:15.559719 27299 rpcz_store.cc:276] 0709 13:11:14.496707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.754031 (+257324us) service_pool.cc:224] Handling call
0709 13:11:15.559202 (+805171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:15.433655 29527 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.431491 29561 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.436483 29539 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.480885 27301 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:15.487273 27302 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:15.444669 29568 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:15.498524 27305 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:15.507346 27298 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:15.505896 27148 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:15.474866 29673 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:15.500160 29669 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.687s	user 0.000s	sys 0.002s
I20260709 13:11:15.494187 29509 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:15.512812 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:15.548758 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:15.554244 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 789984us
W20260709 13:11:15.558120 27300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2004) took 1845 ms (client timeout 2231 ms). Trace:
I20260709 13:11:15.555572 27837 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:15.565897 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:15.595988 27300 rpcz_store.cc:269] 0709 13:11:13.713126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.718767 (+  5641us) service_pool.cc:224] Handling call
0709 13:11:15.557892 (+1839125us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001cb1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:15.558036 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719816448}
I20260709 13:11:15.597321 27151 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:15.598956 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:15.567253 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:15.537856 29668 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.571676 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.544318 29493 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:15.607959 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59317.9us
I20260709 13:11:15.610872 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:15.576320 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:15.605108 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:15.621285 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 171524us
I20260709 13:11:15.568702 29543 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.563548 29541 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.568857 29552 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:15.626958 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:15.629163 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52922.6us
I20260709 13:11:15.577539 29539 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.643401 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:15.586920 29624 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.579164 29633 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:15.588358 29562 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:15.652514 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.647884 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:15.618285 29550 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.570250 29638 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.626878 29627 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.577710 29561 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:15.627292 29337 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:15.618011 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:15.640519 29668 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:15.646844 29539 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.676239 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.678308 27302 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:15.678431 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 217063us
I20260709 13:11:15.645726 29567 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:15.649890 29648 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.631459 29574 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:15.640625 29569 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:11:15.711606 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1620) took 1745 ms. Trace:
I20260709 13:11:15.662009 29620 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:15.720657 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:15.681115 29398 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.991s	user 0.018s	sys 0.010s
I20260709 13:11:15.721387 27302 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.720713 27231 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.717540 27303 rpcz_store.cc:276] 0709 13:11:13.966019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.240716 (+274697us) service_pool.cc:224] Handling call
0709 13:11:14.290562 (+ 49846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.306917 (+ 16355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.306950 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.403078 (+ 96128us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.648527 (+245449us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:14.648567 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.648637 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.711382 (+1062745us) raft_consensus.cc:1685] finished
0709 13:11:15.711401 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.711544 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13087,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":32769,"thread_start_us":120134,"threads_started":1,"wal-append.queue_time_us":247276}
I20260709 13:11:15.669885 29408 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.669265 29541 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.652581 29576 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:11:15.667241 29548 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.668274 29627 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:15.724936 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:15.770524 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 139794us
I20260709 13:11:15.676033 29689 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:15.680655 29678 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.658815 29624 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.793869 27303 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:15.742877 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.785465 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60682.1us
I20260709 13:11:15.796339 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:15.786748 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 68579.4us
W20260709 13:11:15.726564 29393 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.958s	user 0.006s	sys 0.007s
W20260709 13:11:15.727538 29644 consensus_meta.cc:287] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.025s	user 0.012s	sys 0.015s
I20260709 13:11:15.790777 29543 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:15.794696 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 127585us
I20260709 13:11:15.797554 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:15.727583 29621 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.916s	user 0.002s	sys 0.026s
W20260709 13:11:15.727742 29588 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.989s	user 0.012s	sys 0.013s
I20260709 13:11:15.775719 29398 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:15.783794 29560 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.420s	user 0.011s	sys 0.002s
I20260709 13:11:15.704422 29337 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.714910 27836 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:15.725155 29567 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:11:15.788343 29408 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.789781 29627 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.783531 29683 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:15.822880 27838 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:15.782021 29493 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:15.843663 29353 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.006s	user 0.008s	sys 0.004s
W20260709 13:11:15.844558 29416 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.005s	user 0.036s	sys 0.003s
I20260709 13:11:15.812739 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.728164 29533 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:11:15.805786 29562 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.847355 27301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 1998) took 2171 ms (client timeout 1798 ms). Trace:
I20260709 13:11:15.789244 29541 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.792068 29548 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:15.853827 27306 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:15.856150 27302 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:15.813814 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:15.880123 27298 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:15.783161 29620 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:15.804253 29680 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:11:15.882364 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 240630us
W20260709 13:11:15.845693 29415 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.006s	user 0.013s	sys 0.042s
W20260709 13:11:15.844305 29437 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.106s	user 0.011s	sys 0.001s
W20260709 13:11:15.866559 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.825742 29668 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:15.868554 27303 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:15.842681 29420 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:15.869650 27301 rpcz_store.cc:269] 0709 13:11:13.675946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.676370 (+   424us) service_pool.cc:224] Handling call
0709 13:11:15.847098 (+2170728us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540002cbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:15.847253 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3764879616}
I20260709 13:11:15.806434 29678 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.875036 27152 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:15.840102 29337 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:15.809947 29393 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:15.837317 29430 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.597s	user 0.001s	sys 0.006s
I20260709 13:11:15.880275 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:15.842422 29690 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:15.819424 29644 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.890002 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:15.822933 29621 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.828043 29588 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.898633 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:15.896466 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71291.6us
I20260709 13:11:15.894084 29420 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.896119 29561 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:15.910761 29686 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:15.897015 29668 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:15.867898 29683 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:15.914691 29680 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.916263 29688 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:15.898960 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:15.961660 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 62777.2us
I20260709 13:11:15.962646 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:15.816627 29633 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:15.881430 29672 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:15.951341 29420 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:15.949349 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59431.3us
I20260709 13:11:15.941449 29693 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.880818 29416 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.952903 29493 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.940929 29543 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:15.945248 29691 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:15.955323 29355 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:15.948392 29695 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.081s	user 0.000s	sys 0.012s
W20260709 13:11:15.955438 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56888us
I20260709 13:11:15.956256 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:15.959156 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.488s	user 0.027s	sys 0.027s
I20260709 13:11:15.892328 29415 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.059861 29704 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:16.054212 29672 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.892091 29437 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:15.969529 29683 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:15.970664 29551 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.600s	user 0.022s	sys 0.018s
I20260709 13:11:15.870471 29353 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:15.951085 29337 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:15.975510 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:16.055548 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.995694 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.052234 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:16.104223 27837 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:16.052987 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 596) took 1597 ms. Trace:
I20260709 13:11:16.105227 27154 rpcz_store.cc:276] 0709 13:11:14.455476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.515172 (+ 59696us) service_pool.cc:224] Handling call
0709 13:11:14.554521 (+ 39349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.539186 (+984665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.052734 (+513548us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54000dff54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:16.052924 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263010048}
I20260709 13:11:15.883126 29562 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.045300 29416 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:15.972425 29527 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.047791 29548 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:15.947512 29430 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.076431 27229 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:16.126639 27155 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:16.071964 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.601s	user 0.027s	sys 0.027s
W20260709 13:11:16.127995 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 1.67374e+06us
I20260709 13:11:16.129134 27197 leader_election.cc:400] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
W20260709 13:11:16.048662 29327 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.921s	user 0.000s	sys 0.026s
I20260709 13:11:16.130409 29327 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.133322 29327 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:16.050752 29385 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.968s	user 0.016s	sys 0.000s
I20260709 13:11:16.134316 29385 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:16.134451 27832 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:16.137593 29366 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.048223 29555 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.057991 29678 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.069450 29494 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.090821 29677 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.002s
I20260709 13:11:16.190531 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2585) took 1542 ms. Trace:
I20260709 13:11:16.191196 27157 rpcz_store.cc:276] 0709 13:11:14.647833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.285441 (+637608us) service_pool.cc:224] Handling call
0709 13:11:15.285826 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.447916 (+162090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.447954 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.473153 (+ 25199us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.691940 (+218787us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:15.823599 (+131659us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.851895 (+ 28296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.851986 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.190180 (+338194us) raft_consensus.cc:1685] finished
0709 13:11:16.190211 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.190436 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33969,"prepare.queue_time_us":196533,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":34720,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":15734,"thread_start_us":347014,"threads_started":2,"wal-append.queue_time_us":302575}
I20260709 13:11:16.108361 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:16.196534 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 88299.3us
I20260709 13:11:16.198736 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.115270 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:15.975275 29708 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:16.084210 29561 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.116336 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.095139 29696 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:16.140096 29546 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:15.966827 29680 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.057598 29620 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:16.146716 29692 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:11:16.147778 29705 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:11:16.148241 29347 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:16.043452 29408 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.082695 29415 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.089363 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 542) took 1588 ms. Trace:
I20260709 13:11:16.042110 29509 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.154134 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.163770 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 593) took 1889 ms. Trace:
I20260709 13:11:16.075030 29704 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.090271 29624 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.165138 27224 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:16.114964 29337 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.229254 29546 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:16.177532 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 202115us
I20260709 13:11:16.175927 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:16.200992 27231 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:16.139267 29305 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:16.121855 29527 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.042771 29693 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.213742 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:16.294667 27837 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
W20260709 13:11:16.216147 29706 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:11:16.218706 29562 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.220137 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 583) took 2006 ms. Trace:
I20260709 13:11:16.300118 27152 rpcz_store.cc:276] 0709 13:11:14.213639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.320325 (+106686us) service_pool.cc:224] Handling call
0709 13:11:14.320628 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.897011 (+1576383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.219780 (+322769us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400098154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:16.220045 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3574090112}
I20260709 13:11:16.221426 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:16.221590 29393 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:16.222764 29644 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:16.058184 29673 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.223068 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:16.224135 29588 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:16.209822 29494 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:16.224879 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:16.226179 29541 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.226459 27301 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:16.227414 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 801) took 3185 ms. Trace:
I20260709 13:11:16.228150 29668 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:16.143121 29699 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:11:16.251339 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.252754 27156 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:16.254400 27840 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:16.254652 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 306802us
W20260709 13:11:16.255133 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 301974us
W20260709 13:11:16.342530 27123 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.676s (SENT)
I20260709 13:11:16.342408 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:16.268731 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.343653 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:16.281049 27150 rpcz_store.cc:276] 0709 13:11:14.274779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.342870 (+ 68091us) service_pool.cc:224] Handling call
0709 13:11:14.343176 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.731537 (+388361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.163462 (+1431925us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540012cad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:16.163700 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687217408}
I20260709 13:11:16.106351 29551 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.211511 29555 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:16.205686 29708 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.271459 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:16.288364 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 112615us
I20260709 13:11:16.290584 29305 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:16.286190 29704 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.296203 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:16.269125 29711 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.363273 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.364122 27150 raft_consensus.cc:2410] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:16.211107 29677 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:16.365352 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69257.5us
I20260709 13:11:16.299358 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:16.288488 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:16.230046 29561 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.301549 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.210180 29678 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:16.294881 29545 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.006s
I20260709 13:11:16.381984 29707 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:11:16.294735 29571 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.011s	user 0.013s	sys 0.019s
I20260709 13:11:16.310451 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:16.403420 29707 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:16.403858 29707 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:16.403899 27232 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:16.404482 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:16.299858 29568 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.004s
I20260709 13:11:16.311908 27302 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:16.405052 29707 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.314522 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.294342 29527 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:16.303930 29634 consensus_meta.cc:287] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.018s	user 0.021s	sys 0.009s
I20260709 13:11:16.419373 27148 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:16.332813 27226 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:16.247272 29696 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.343840 27301 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.195358 29385 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:16.308634 29621 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.350718 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:16.355360 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:16.421298 29385 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.355362 27151 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:16.423066 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:16.423578 29385 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.423717 27225 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:16.424328 27154 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:16.424662 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:16.361718 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:16.345865 29555 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.354720 29708 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:16.365664 29546 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:16.384042 29539 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.002s
I20260709 13:11:16.365011 29416 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:11:16.366165 29715 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:11:16.384497 29458 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.663s	user 0.014s	sys 0.031s
I20260709 13:11:16.373085 29533 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:11:16.385048 29550 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
W20260709 13:11:16.386132 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 97754.7us
I20260709 13:11:16.382325 27304 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:16.385946 27223 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 2. Current term is 4. Ops: []
I20260709 13:11:16.391675 29711 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:16.397200 29561 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.399035 29673 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.374850 29680 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.379071 29677 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.400385 29551 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.400588 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:16.372972 29567 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:16.401680 29678 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.307996 27298 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:16.349845 29638 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.293008 29415 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:16.415725 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.364478 29672 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.426204 27157 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.406283 29353 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.382553 29437 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:16.432741 27301 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:16.276690 27297 rpcz_store.cc:276] 0709 13:11:14.496437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.108397 (+611960us) service_pool.cc:224] Handling call
0709 13:11:15.230757 (+122360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.447916 (+217159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.471381 (+ 23465us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.526200 (+ 54819us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.657994 (+131794us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:15.665747 (+  7753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.674769 (+  9022us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.057763 (+382994us) raft_consensus.cc:1685] finished
0709 13:11:16.057795 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.084670 (+ 26875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8261,"raft.queue_time_us":38513,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":177,"thread_start_us":119786,"threads_started":1,"wal-append.queue_time_us":243608}
I20260709 13:11:16.314471 27835 rpcz_store.cc:276] 0709 13:11:13.042236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.564302 (+522066us) service_pool.cc:224] Handling call
0709 13:11:13.750844 (+186542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:13.770487 (+ 19643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.770546 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.771220 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.271608 (+500388us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b1800433960. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:14.400053 (+128445us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:14.418827 (+ 18774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.437963 (+ 19136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.774691 (+336728us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:15.405649 (+630958us) raft_consensus.cc:1685] finished
0709 13:11:15.408269 (+  2620us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.227209 (+818940us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54005a1c50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:16.227342 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40161,"raft.queue_time_us":1242,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5664,"spinlock_wait_cycles":512121856,"thread_start_us":100344,"threads_started":1,"wal-append.queue_time_us":765514}
I20260709 13:11:16.520627 27153 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:16.446447 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:16.728770 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:16.781798 27229 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:16.658387 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 818) took 1213 ms. Trace:
I20260709 13:11:16.487252 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:16.620862 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.758479 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.778267 27152 raft_consensus.cc:2410] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:16.783874 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:16.685549 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2545) took 1232 ms. Trace:
I20260709 13:11:16.784859 27225 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
W20260709 13:11:16.545197 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.785641 27231 rpcz_store.cc:276] 0709 13:11:15.452826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.452948 (+   122us) service_pool.cc:224] Handling call
0709 13:11:16.685340 (+1232392us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54002279d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:16.685489 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488977792}
I20260709 13:11:16.786751 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:16.787401 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:16.440706 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:16.676561 29716 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:11:16.835573 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.788033 27225 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 2: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:16.439917 29555 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:16.439740 29545 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.686721 29494 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:16.726608 29699 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:11:16.445691 29627 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
W20260709 13:11:16.548904 29714 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:11:16.820109 27150 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:16.715634 29680 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.778851 29415 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:16.855355 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:16.489130 29707 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.855738 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:16.444449 29693 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.648703 29634 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.830111 29557 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 2.144s	user 0.021s	sys 0.039s
I20260709 13:11:16.728331 29532 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.493075 29546 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.783352 27839 rpcz_store.cc:276] 0709 13:11:15.445001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.445112 (+   111us) service_pool.cc:224] Handling call
0709 13:11:15.841554 (+396442us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:15.841829 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.077230 (+235401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.077316 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.077946 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.276936 (+198990us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:16.548962 (+272026us) log.cc:844] Serialized 14 byte log entry
0709 13:11:16.549376 (+   414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.549502 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.549560 (+    58us) raft_consensus.cc:1685] finished
0709 13:11:16.658102 (+108542us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.658304 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227,"prepare.queue_time_us":472604,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":133272,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":48336,"spinlock_wait_cycles":26309504,"thread_start_us":681769,"threads_started":3,"wal-append.queue_time_us":224533}
W20260709 13:11:16.859216 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71896.1us
I20260709 13:11:16.765368 29677 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:16.683506 29711 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.780012 29567 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.761191 29696 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:16.619524 29566 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.681820 29420 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.002s
I20260709 13:11:16.752817 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1058) took 1134 ms. Trace:
W20260709 13:11:16.492132 29625 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.000s
I20260709 13:11:16.862424 27157 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:16.782934 29550 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.836277 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.126518 27151 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:17.127102 27231 raft_consensus.cc:2410] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:16.829252 29681 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:16.419134 29568 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.860582 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.143630 27229 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:16.788669 29327 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:11:17.146570 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:16.854780 29551 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.154716 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1627) took 1831 ms. Trace:
I20260709 13:11:16.438999 29305 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:16.867627 29627 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:16.872354 29415 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.107883 29567 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:16.877246 29724 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:11:16.877405 29337 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:16.869289 29533 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:16.881301 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:16.857031 29416 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:16.860024 29494 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.177510 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:17.177830 29416 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:16.885807 27150 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:17.178596 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.179595 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:17.179798 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.180343 29416 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.180585 27229 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:16.869735 29541 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:16.871088 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:16.894506 29725 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:16.874476 29588 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:16.895478 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.859357 29545 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:16.903173 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.919756 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:16.965517 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.014611 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:17.012488 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.098300 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:17.100828 27156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2582) took 2455 ms (client timeout 2364 ms). Trace:
W20260709 13:11:17.109931 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 236747us
W20260709 13:11:17.126395 27305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 535) took 2641 ms (client timeout 2547 ms). Trace:
I20260709 13:11:16.854504 29366 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.127509 27154 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2049) took 1419 ms (client timeout 1636 ms). Trace:
I20260709 13:11:17.128247 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:17.009618 29620 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:17.130445 29385 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.136206 29527 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 13:11:17.102231 29711 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.139014 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:17.139256 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1626) took 1825 ms. Trace:
I20260709 13:11:17.014912 29552 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.872913 29680 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.097380 29677 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.145097 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 815) took 1722 ms. Trace:
I20260709 13:11:17.014103 29532 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:17.147310 27153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2580) took 2483 ms (client timeout 1640 ms). Trace:
W20260709 13:11:17.249248 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.101424 29645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.262s	user 0.013s	sys 0.021s
I20260709 13:11:17.147590 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2587) took 2370 ms. Trace:
W20260709 13:11:17.148636 27232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2549) took 1693 ms (client timeout 1622 ms). Trace:
I20260709 13:11:17.149087 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.151091 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:17.152695 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.153807 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.155551 27837 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:17.099263 29557 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.263831 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.263644 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 124712us
I20260709 13:11:17.155174 27306 rpcz_store.cc:276] 0709 13:11:15.323235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.408708 (+ 85473us) service_pool.cc:224] Handling call
0709 13:11:15.409062 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.879110 (+470048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.154456 (+1275346us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540002d0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:17.154649 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022332160}
I20260709 13:11:17.264590 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:17.159554 29568 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.125934 29420 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.163554 27833 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:16.876567 29437 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:17.267446 27197 connection.cc:256] RPC call timeout handler was delayed by -1.4761737189999167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 13:11:17.249924 27232 rpcz_store.cc:269] 0709 13:11:15.454739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.454901 (+   162us) service_pool.cc:224] Handling call
0709 13:11:17.148454 (+1693553us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54001da6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.148563 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059205120}
W20260709 13:11:17.268025 27197 connection.cc:256] RPC call timeout handler was delayed by -1.1933837560000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:11:17.268766 27303 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:17.154901 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:17.265380 27151 raft_consensus.cc:2376] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3. Re-sending same reply.
I20260709 13:11:17.165076 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.012270 29634 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.163443 29551 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:17.174479 27226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2544) took 1899 ms (client timeout 1825 ms). Trace:
I20260709 13:11:17.249842 27155 rpcz_store.cc:276] 0709 13:11:14.776720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.315351 (+538631us) service_pool.cc:224] Handling call
0709 13:11:15.315783 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.127183 (+811400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.147317 (+1020134us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540037f5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:17.147522 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864159104}
I20260709 13:11:16.783340 29539 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.177910 29494 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.189441 27297 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 5. Ops: []
W20260709 13:11:17.228578 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.287140 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:17.288720 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:17.181294 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:17.194649 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 313472us
I20260709 13:11:17.291447 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:17.291957 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:17.240597 27228 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.292977 29640 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:17.293063 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:17.294011 27155 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:17.294344 29416 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:17.240453 27154 rpcz_store.cc:269] 0709 13:11:15.707697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.106432 (+398735us) service_pool.cc:224] Handling call
0709 13:11:17.127337 (+1020905us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003566d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.127449 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329669376}
I20260709 13:11:17.245110 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:17.245409 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.298878 27225 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:17.242522 27305 rpcz_store.cc:269] 0709 13:11:14.491418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.728744 (+237326us) service_pool.cc:224] Handling call
0709 13:11:17.126164 (+2397420us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400267ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.126314 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767447808}
I20260709 13:11:17.299916 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.300629 27305 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:17.301429 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:17.181372 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.242442 27272 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:17.302610 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60267.3us
W20260709 13:11:17.240869 27156 rpcz_store.cc:269] 0709 13:11:14.645897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.127417 (+481520us) service_pool.cc:224] Handling call
0709 13:11:17.100624 (+1973207us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540012c5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.100759 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984456576}
W20260709 13:11:17.248277 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 150069us
I20260709 13:11:17.303258 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:17.248775 27153 rpcz_store.cc:269] 0709 13:11:14.644042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.644682 (+   640us) service_pool.cc:224] Handling call
0709 13:11:17.126832 (+2482150us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.126946 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4062387072}
I20260709 13:11:17.110420 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:17.305044 27148 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:17.250833 27231 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:17.265128 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:17.306301 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.269785 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:17.308384 29551 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.308660 29494 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.310324 29539 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.311321 29539 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:17.263396 29552 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.267151 29366 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.313409 29337 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:17.313966 29337 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:17.314297 29366 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.277541 27835 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:17.272502 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:17.264317 29493 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:17.316188 27232 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:17.316962 27227 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:17.275942 27302 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:17.240558 27304 rpcz_store.cc:276] 0709 13:11:15.313976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.367563 (+ 53587us) service_pool.cc:224] Handling call
0709 13:11:15.367904 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.776966 (+1409062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.138989 (+362023us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000bb654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:17.139194 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2332296960}
I20260709 13:11:17.178339 27149 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:17.318554 27229 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:17.126165 29625 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.279733 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2534) took 2110 ms. Trace:
I20260709 13:11:17.322930 27223 rpcz_store.cc:276] 0709 13:11:15.169532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.169669 (+   137us) service_pool.cc:224] Handling call
0709 13:11:15.170006 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.780283 (+1610277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.279486 (+499203us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001db5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:17.279667 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795833600}
I20260709 13:11:17.145596 27298 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:17.170469 29681 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:17.264485 29645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.014s	sys 0.022s
I20260709 13:11:17.291770 27150 raft_consensus.cc:2376] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6. Re-sending same reply.
I20260709 13:11:17.280800 29557 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:17.273257 27300 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:17.278565 27226 rpcz_store.cc:269] 0709 13:11:15.452204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.452374 (+   170us) service_pool.cc:224] Handling call
0709 13:11:17.174171 (+1721797us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54001266d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.174348 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786070272}
I20260709 13:11:17.266778 29731 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.319077 27303 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.266863 29672 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.321888 27841 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:17.276768 29693 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.275550 29550 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.340718 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1057) took 1724 ms. Trace:
I20260709 13:11:17.247412 29527 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:17.363528 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 59212.7us
I20260709 13:11:17.286501 29627 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.279732 29696 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:17.263959 29385 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:17.315282 29677 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:17.286316 29568 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.146695 29566 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.390676 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1059) took 1773 ms. Trace:
I20260709 13:11:17.283618 29715 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:17.193099 29533 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.315023 29337 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.287952 29538 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.391219 27840 rpcz_store.cc:276] 0709 13:11:15.617021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.345937 (+728916us) service_pool.cc:224] Handling call
0709 13:11:16.346442 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.359098 (+ 12656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.359148 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.359874 (+   726us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.541131 (+181257us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:16.541197 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.541312 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.390438 (+849126us) raft_consensus.cc:1685] finished
0709 13:11:17.390461 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.390610 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":11220,"thread_start_us":158607,"threads_started":1,"wal-append.queue_time_us":377734}
I20260709 13:11:17.267455 29620 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.315295 29420 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.283028 29327 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:11:17.357306 27841 rpcz_store.cc:276] 0709 13:11:15.616496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.616722 (+   226us) service_pool.cc:224] Handling call
0709 13:11:17.321354 (+1704632us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:17.321626 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.340342 (+ 18716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.340637 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708352}
I20260709 13:11:17.396733 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.328316 29681 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:17.418499 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 263725us
I20260709 13:11:17.370018 29732 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.368618 27228 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:17.241715 27832 rpcz_store.cc:276] 0709 13:11:15.422861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.423016 (+   155us) service_pool.cc:224] Handling call
0709 13:11:15.439273 (+ 16257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.135127 (+695854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.144827 (+1009700us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400336b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:17.145040 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597780480}
I20260709 13:11:17.408255 27303 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:17.321123 29353 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:11:17.357182 29550 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.363040 29494 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:17.353919 29731 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.364609 27299 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:17.424860 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.417505 29681 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.432092 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.358140 29672 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.363933 29693 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:17.434754 29704 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.046s	user 0.002s	sys 0.011s
I20260709 13:11:17.407248 29677 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:17.425711 29732 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.424170 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 137099us
I20260709 13:11:17.404456 29696 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:17.439839 27228 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:17.440225 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 137032us
I20260709 13:11:17.442523 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.437629 29731 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.428364 29588 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:17.402657 29568 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.437124 29735 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:17.422843 29734 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:17.403635 29715 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.434906 27225 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:17.435770 29550 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.457463 27223 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:17.438596 29494 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:17.458804 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:17.404546 27232 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:17.454896 29732 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.425597 29407 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:11:17.521000 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2557) took 1135 ms. Trace:
I20260709 13:11:17.521610 27232 rpcz_store.cc:276] 0709 13:11:16.385223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.519847 (+1134624us) service_pool.cc:224] Handling call
0709 13:11:17.520278 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.520525 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.520567 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.520623 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:17.520670 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.520744 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.520916 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.522763 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 562) took 1165 ms. Trace:
W20260709 13:11:17.460517 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 168247us
I20260709 13:11:17.523226 27225 rpcz_store.cc:276] 0709 13:11:16.357157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.521703 (+1164546us) service_pool.cc:224] Handling call
0709 13:11:17.522118 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.522332 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.522367 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.522436 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:17.522491 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.522561 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.522691 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.464337 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 69331us
I20260709 13:11:17.469592 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:17.450233 29681 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.446834 29541 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:17.506176 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.460507 29588 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.525120 27225 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:17.458948 29739 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.567549 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.568717 27225 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:17.467229 29675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.933s	user 0.020s	sys 0.016s
I20260709 13:11:17.525413 27228 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:17.570195 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45580.1us
I20260709 13:11:17.462667 29736 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.466540 29735 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.462945 29538 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:17.633122 27223 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:17.634714 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 110696us
I20260709 13:11:17.635161 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 568) took 1250 ms. Trace:
I20260709 13:11:17.635548 27223 rpcz_store.cc:276] 0709 13:11:16.384528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.519846 (+1135318us) service_pool.cc:224] Handling call
0709 13:11:17.632934 (+113088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.634866 (+  1932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.635101 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.633634 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 174942us
I20260709 13:11:17.566128 29640 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:17.637434 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:17.452016 29704 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.456478 29677 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.520160 29494 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.464982 29638 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
W20260709 13:11:17.663781 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.665426 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:17.575309 29680 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.571676 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:17.652702 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.573750 29497 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.639954 27841 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:11:17.519940 29416 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:17.521555 29437 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.675226 29437 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.676450 29672 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.677691 29677 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:17.679340 29555 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.001s
I20260709 13:11:17.679812 29555 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.681062 27305 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:17.683796 29567 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.660887 29568 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.661739 29430 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.663429 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.639238 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:17.576516 29545 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.632899 29735 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.668617 27840 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
W20260709 13:11:17.742471 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.658066 27223 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:17.669440 27839 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:17.670826 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99274.2us
I20260709 13:11:17.673745 29407 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:17.667508 29741 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.674378 29557 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:17.677703 29437 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.685966 29416 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.607312 29736 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.647255 29353 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:17.670462 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:17.605257 29675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.036s	user 0.020s	sys 0.016s
I20260709 13:11:17.470901 29734 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.709776 27832 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:17.740051 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 74737.2us
W20260709 13:11:17.676414 29415 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:11:17.110356 27836 rpcz_store.cc:276] 0709 13:11:15.616774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.878460 (+261686us) service_pool.cc:224] Handling call
0709 13:11:15.945480 (+ 67020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.072607 (+127127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.077649 (+  5042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.189389 (+111740us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.317798 (+128409us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:16.684144 (+366346us) log.cc:844] Serialized 14 byte log entry
0709 13:11:16.728501 (+ 44357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.744106 (+ 15605us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.745095 (+   989us) raft_consensus.cc:1685] finished
0709 13:11:16.746942 (+  1847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.751545 (+  4603us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10724,"prepare.queue_time_us":434728,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":41792,"raft.queue_time_us":120450,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":19521,"thread_start_us":378075,"threads_started":2,"wal-append.queue_time_us":122398}
I20260709 13:11:17.648793 29538 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.771319 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.744323 29744 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:17.776522 29327 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.778098 29620 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:17.635850 29634 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:17.776970 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 137857us
W20260709 13:11:17.779093 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 359447us
I20260709 13:11:17.670037 29625 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.670264 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.794809 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.795554 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.806269 27841 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:17.739213 29527 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.807134 27840 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
W20260709 13:11:17.807433 27838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 822) took 2240 ms (client timeout 1824 ms). Trace:
W20260709 13:11:17.751489 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.796442 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.809013 27228 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:17.830348 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:17.870136 27838 rpcz_store.cc:269] 0709 13:11:15.566616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.566900 (+   284us) service_pool.cc:224] Handling call
0709 13:11:17.807237 (+2240337us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.807360 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506185088}
I20260709 13:11:17.871024 27306 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:17.871673 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:17.744421 29747 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.746122 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1056) took 2130 ms (client timeout 2015 ms). Trace:
I20260709 13:11:17.797134 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.800717 29557 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.796139 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:17.821645 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.651619 29739 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:17.872141 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:17.872287 27300 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:17.771349 29737 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:11:17.822964 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:17.790789 29738 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.790745 29742 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:17.790478 29736 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.874478 27838 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:17.872517 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:17.805564 29407 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:17.776783 29541 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:17.876005 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:17.809530 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 481509us
I20260709 13:11:17.877015 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.831281 29538 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:17.897946 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:17.807036 29415 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:17.863857 29708 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.347s	user 0.007s	sys 0.007s
I20260709 13:11:17.799675 29533 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:17.825368 29567 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:17.824681 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.822803 29755 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:11:17.877969 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:18.154433 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 281995us
W20260709 13:11:17.961544 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 138616us
W20260709 13:11:17.902879 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 79556.9us
W20260709 13:11:18.169201 27833 rpcz_store.cc:269] 0709 13:11:15.615672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.615838 (+   166us) service_pool.cc:224] Handling call
0709 13:11:16.350542 (+734704us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:17.745853 (+1395311us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54007076d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:17.746009 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711093376}
W20260709 13:11:17.897050 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63952.3us
I20260709 13:11:17.900205 27304 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:11:18.078786 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.172122 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:17.822443 29749 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.178988 27841 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:18.180362 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.180910 27841 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:17.829869 29571 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.968477 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:17.828235 29546 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.000s
I20260709 13:11:18.176239 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:18.182945 27833 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:17.868481 29555 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.189815 27833 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:18.190689 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.192271 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:17.831071 29704 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.194804 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:18.196807 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.197100 27841 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:18.197448 27156 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:18.028012 27297 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:18.195231 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:18.200567 27153 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.201450 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.201718 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.202400 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:17.809952 29640 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:18.098004 29620 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:18.217557 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:18.220515 27841 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:18.106400 29711 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.839s	user 0.011s	sys 0.000s
W20260709 13:11:18.211762 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.170562 29742 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:18.215262 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.215910 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:18.102097 29737 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:17.824024 29327 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:18.208593 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.902891 29693 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.213145 27153 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:17.980223 29683 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:18.277365 29683 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:18.277829 29683 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:18.222940 29748 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
W20260709 13:11:18.283739 27837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1065) took 2055 ms (client timeout 1904 ms). Trace:
W20260709 13:11:18.284411 27837 rpcz_store.cc:269] 0709 13:11:16.227933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.299036 (+ 71103us) service_pool.cc:224] Handling call
0709 13:11:18.283451 (+1984415us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540053e654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:18.283628 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787681536}
I20260709 13:11:18.285249 29678 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:18.285763 29678 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:18.286217 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.223302 29752 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:18.286823 29752 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.287205 29752 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.287315 27834 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:18.179035 29696 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.229013 29737 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:18.183881 29560 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:17.826453 29430 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.382s
W20260709 13:11:18.200513 29550 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.001s
I20260709 13:11:18.226418 27838 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:18.314548 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.315505 27838 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:18.226869 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 58136us
I20260709 13:11:17.894037 29744 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:18.182650 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.194303 29545 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.232950 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.240150 27841 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:18.339030 27154 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:18.219192 29546 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:18.242950 29407 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.243654 29527 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:17.932430 29557 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.222011 29533 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:17.895614 29747 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.225033 29743 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.334185 29696 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:17.936358 29738 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.255316 29739 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.257432 27149 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:18.259477 29552 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.237722 29754 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.229859 29711 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.229993 29620 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.262379 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2028) took 1109 ms. Trace:
I20260709 13:11:18.263921 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2559) took 1831 ms. Trace:
W20260709 13:11:18.265661 27299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1632) took 2813 ms (client timeout 1828 ms). Trace:
W20260709 13:11:18.390671 27299 rpcz_store.cc:269] 0709 13:11:15.452020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.571419 (+119399us) service_pool.cc:224] Handling call
0709 13:11:18.265459 (+2694040us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54000587d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:18.265580 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4041101184}
I20260709 13:11:18.271539 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:18.398319 27832 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.398490 27224 raft_consensus.cc:2376] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5. Re-sending same reply.
I20260709 13:11:18.399909 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:18.400733 27224 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:18.273113 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2553) took 2480 ms. Trace:
I20260709 13:11:18.275535 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.200191 29571 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.403657 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.409040 27832 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:18.196448 27836 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 1.
I20260709 13:11:18.293602 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:18.414124 27837 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:18.414315 27227 rpcz_store.cc:276] 0709 13:11:15.792294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.792583 (+   289us) service_pool.cc:224] Handling call
0709 13:11:15.793019 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.317509 (+1524490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.272807 (+955298us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001b9c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:18.273044 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3503858432}
W20260709 13:11:18.297358 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.665s (SENT) [suppressed 27 similar messages]
I20260709 13:11:18.305174 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:11:18.307542 27223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.014s	sys 0.015s
I20260709 13:11:18.324582 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:18.195492 29749 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.333330 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:18.181569 29708 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.221127 29567 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
W20260709 13:11:18.312604 29681 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.004s
I20260709 13:11:18.339668 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:18.341691 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.309201 29625 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.306676 29493 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:18.307277 29560 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:18.230195 29742 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:18.338552 29543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.021s
I20260709 13:11:18.291020 29737 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.338809 29430 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:18.343856 29546 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.266551 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2031) took 1112 ms. Trace:
I20260709 13:11:18.389549 27305 rpcz_store.cc:276] 0709 13:11:17.153052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.301179 (+148127us) service_pool.cc:224] Handling call
0709 13:11:18.262154 (+960975us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54003129d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:18.262310 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871442816}
W20260709 13:11:18.381402 29689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.545s	user 0.006s	sys 0.011s
I20260709 13:11:18.314008 29550 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.342829 29672 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:18.377775 29648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.002s	sys 0.019s
I20260709 13:11:18.343693 29545 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.369024 29527 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:18.376515 29533 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.390226 27232 rpcz_store.cc:276] 0709 13:11:16.432734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.522938 (+1090204us) service_pool.cc:224] Handling call
0709 13:11:17.523278 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.572643 (+ 49365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.572691 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.572750 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:17.572803 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.263624 (+690821us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b540037b754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:18.263681 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.263841 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112926592}
W20260709 13:11:18.805682 27226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.020s	sys 0.029s
I20260709 13:11:18.865175 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.865557 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:18.866096 27152 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:18.866219 27232 raft_consensus.cc:2376] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3. Re-sending same reply.
I20260709 13:11:18.415894 27837 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:11:18.533145 29757 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 13:11:18.868171 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:18.868973 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 656) took 1186 ms. Trace:
W20260709 13:11:18.543881 29494 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
I20260709 13:11:18.869624 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:18.869724 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1735) took 1599 ms. Trace:
I20260709 13:11:18.543759 29739 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:18.870370 27232 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:18.518119 29509 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.870404 27225 rpcz_store.cc:276] 0709 13:11:17.270044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.570948 (+300904us) service_pool.cc:224] Handling call
0709 13:11:17.571357 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.571627 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.571664 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.637415 (+ 65751us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.835241 (+197826us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:17.835295 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.835369 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.532513 (+697144us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:18.869418 (+336905us) raft_consensus.cc:1685] finished
0709 13:11:18.869442 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.869663 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14092544,"thread_start_us":124609,"threads_started":1,"wal-append.queue_time_us":580880}
I20260709 13:11:18.388269 29743 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.872591 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:18.872682 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:18.873520 29680 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:18.873663 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:18.874199 29680 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:18.874634 29640 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:18.537249 29566 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:18.518426 27154 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:18.876734 27841 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:18.877372 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 649) took 1236 ms. Trace:
I20260709 13:11:18.878101 29693 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:18.871460 29739 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.528030 27840 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:18.874722 29743 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.899507 27838 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:18.681146 29707 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.799s	user 0.009s	sys 0.006s
I20260709 13:11:18.870338 29494 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:18.864236 29770 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:18.904891 27833 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:18.974578 29773 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.856973 29732 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.251s	user 0.011s	sys 0.003s
I20260709 13:11:18.369939 29734 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:18.877929 27841 rpcz_store.cc:276] 0709 13:11:17.641413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.339309 (+697896us) service_pool.cc:224] Handling call
0709 13:11:18.877289 (+537980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.026034 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 826) took 1248 ms. Trace:
I20260709 13:11:19.026418 27841 rpcz_store.cc:276] 0709 13:11:17.777725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.025127 (+1247402us) service_pool.cc:224] Handling call
0709 13:11:19.025508 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.025716 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.025737 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.025782 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:19.025809 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.025856 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.025976 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.028093 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 828) took 1246 ms. Trace:
I20260709 13:11:19.028383 27841 rpcz_store.cc:276] 0709 13:11:17.781480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.027358 (+1245878us) service_pool.cc:224] Handling call
0709 13:11:19.027601 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.027774 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.027796 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.027833 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:19.027887 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.027931 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.028042 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.456808 27839 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:19.032914 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 660) took 1161 ms. Trace:
I20260709 13:11:19.033340 27839 rpcz_store.cc:276] 0709 13:11:17.871556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.403310 (+531754us) service_pool.cc:224] Handling call
0709 13:11:19.032820 (+629510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.034657 27839 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Advancing to term 5
I20260709 13:11:18.905423 29493 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:18.897253 29648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.018s	sys 0.045s
I20260709 13:11:18.875258 29640 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:18.936048 29566 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:18.938414 29739 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.875224 29680 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:18.898038 29689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.061s	user 0.010s	sys 0.018s
I20260709 13:11:18.877470 29672 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:18.525236 29736 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:18.908947 29543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.014s	sys 0.027s
I20260709 13:11:18.533732 29415 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.551576 29747 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.900853 29546 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:18.381733 29696 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.527987 29627 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:18.930936 29752 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.000s
I20260709 13:11:18.900370 29430 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:18.530195 29571 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.531754 29557 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:18.390442 29754 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:18.905639 29625 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:18.975911 29737 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:18.993516 29738 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:19.017433 29683 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.007s
I20260709 13:11:18.556370 29744 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.018898 29538 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.035672 29620 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:18.994015 29560 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.024230 29773 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.151707 29773 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:19.038446 29732 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.042465 29640 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.042352 29566 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.158372 29566 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.164206 29732 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.114071 29752 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.044236 29689 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:19.167037 29689 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.145715 29538 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.175217 29752 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.113709 29627 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:19.184473 29627 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.206215 29627 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:19.195001 29771 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:19.195753 29560 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.113562 29696 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:19.180622 29769 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:11:19.204968 29767 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:11:19.120111 29625 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.117185 29754 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:19.227823 29780 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:11:19.230912 29749 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:19.232613 29781 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:19.234900 29708 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.148151 29683 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.238286 29683 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.239825 29736 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.208732 29672 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.276988 29672 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:19.042013 29735 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.251s	user 0.013s	sys 0.004s
I20260709 13:11:19.282582 29735 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:19.223237 29731 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.757s	user 0.013s	sys 0.006s
I20260709 13:11:19.286525 29731 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.289357 29731 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.274278 29640 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:19.305565 29640 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.285689 29735 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.325246 29742 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:18.904997 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:19.380467 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:18.497608 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 305385us
I20260709 13:11:19.591941 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:18.896257 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:19.382294 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:18.890868 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:19.383344 27150 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:18.892438 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:19.600659 27155 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:19.383682 27197 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.005s	sys 0.014s
I20260709 13:11:19.601804 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:19.384466 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.387442 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.388105 27148 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:18.498814 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:18.865253 27226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.023s	sys 0.029s
I20260709 13:11:19.605804 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1738) took 2334 ms. Trace:
W20260709 13:11:19.602355 27197 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.006s	sys 0.015s
I20260709 13:11:19.601984 27151 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:11:18.930373 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 625317us
I20260709 13:11:19.403514 27302 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:19.609917 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 1.16455e+06us
I20260709 13:11:18.880082 27303 rpcz_store.cc:276] 0709 13:11:17.154018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.269528 (+115510us) service_pool.cc:224] Handling call
0709 13:11:18.266379 (+996851us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54003a9654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:18.266488 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27486976}
I20260709 13:11:19.610334 27224 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:19.611461 27224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1749) took 1285 ms (client timeout 1697 ms). Trace:
W20260709 13:11:19.408222 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 1.08358e+06us
W20260709 13:11:19.411499 27807 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.007s
W20260709 13:11:19.411748 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.612735 27807 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.007s	sys 0.007s
W20260709 13:11:19.415548 27806 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.547s (SENT)
W20260709 13:11:19.613384 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.31595e+06us
I20260709 13:11:19.403872 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1648) took 1581 ms. Trace:
W20260709 13:11:18.897671 27300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.012s	sys 0.010s
W20260709 13:11:19.614540 27807 leader_election.cc:336] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.125s (SENT)
I20260709 13:11:18.869413 27837 rpcz_store.cc:276] 0709 13:11:17.682306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.415097 (+732791us) service_pool.cc:224] Handling call
0709 13:11:18.415564 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.868568 (+453004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.868912 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:19.612031 27224 rpcz_store.cc:269] 0709 13:11:18.326422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.429853 (+103431us) service_pool.cc:224] Handling call
0709 13:11:19.611234 (+1181381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.575798 29305 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.449579 29353 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.614248 27298 rpcz_store.cc:276] 0709 13:11:17.822355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.148226 (+325871us) service_pool.cc:224] Handling call
0709 13:11:18.148723 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.179990 (+ 31267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.180025 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.576250 (+396225us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:18.576766 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.928755 (+351989us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:18.928813 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.928922 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.402967 (+474045us) raft_consensus.cc:1685] finished
0709 13:11:19.403026 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.403546 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2352,"raft.queue_time_us":33754,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":24327,"spinlock_wait_cycles":38473984,"thread_start_us":351491,"threads_started":1,"wal-append.queue_time_us":516561}
I20260709 13:11:19.629925 29353 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.630992 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:19.631923 27303 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:19.614400 29737 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.632954 29353 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.114519 29430 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.633504 29737 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.611459 29366 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:19.634691 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:19.635880 27299 raft_consensus.cc:2410] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:19.636574 29737 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.637089 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:19.111655 29494 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.458384 29527 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.229552 29566 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.460217 29533 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.463301 29545 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.464591 29546 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:19.643232 27839 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.000s
I20260709 13:11:19.644078 29566 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.644276 29546 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.644556 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:19.246393 29550 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.466668 29567 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.645473 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:19.645828 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:19.470539 29571 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:19.646366 27297 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.647562 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:19.647199 29571 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:19.648378 27298 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.559634 29696 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:19.512799 29735 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.593866 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:19.383757 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:19.602129 27156 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:18.416327 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:19.388141 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.610088 29415 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:19.613253 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:18.660477 27835 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:19.660187 27225 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:19.661424 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 824) took 1978 ms. Trace:
I20260709 13:11:19.661896 27835 rpcz_store.cc:276] 0709 13:11:17.682997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.507252 (+824255us) service_pool.cc:224] Handling call
0709 13:11:18.659932 (+152680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.660528 (+1000596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.661138 (+   610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.664237 27835 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:19.664958 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 830) took 1789 ms. Trace:
I20260709 13:11:19.665279 27835 rpcz_store.cc:276] 0709 13:11:17.876014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.662969 (+1786955us) service_pool.cc:224] Handling call
0709 13:11:19.663582 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.664632 (+  1050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.664885 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.433902 27836 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:19.667018 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 823) took 1984 ms. Trace:
I20260709 13:11:19.667414 27836 rpcz_store.cc:276] 0709 13:11:17.682712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.433066 (+750354us) service_pool.cc:224] Handling call
0709 13:11:18.433561 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.666460 (+1232899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.666800 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:18.905378 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 648) took 1263 ms. Trace:
I20260709 13:11:19.668740 27838 rpcz_store.cc:276] 0709 13:11:17.641121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.332931 (+691810us) service_pool.cc:224] Handling call
0709 13:11:18.904669 (+571738us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:19.615077 27300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.012s	sys 0.010s
I20260709 13:11:19.438989 27841 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:11:19.615242 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 199993us
I20260709 13:11:19.612368 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:19.620929 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 702615us
I20260709 13:11:19.622399 29732 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:19.671211 29732 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.623070 27837 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:11:19.672262 27197 connection.cc:256] RPC call timeout handler was delayed by -1.1644516829999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:11:19.672818 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 659) took 1837 ms. Trace:
I20260709 13:11:19.673303 27837 rpcz_store.cc:276] 0709 13:11:17.835844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.621465 (+1785621us) service_pool.cc:224] Handling call
0709 13:11:19.622409 (+   944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.672413 (+ 50004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.672733 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.625730 27154 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.675493 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 829) took 1872 ms. Trace:
I20260709 13:11:19.675997 27841 rpcz_store.cc:276] 0709 13:11:17.803209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.029454 (+1226245us) service_pool.cc:224] Handling call
0709 13:11:19.029752 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.675059 (+645307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.675394 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.677359 27151 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.606351 27226 rpcz_store.cc:276] 0709 13:11:17.271326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.169219 (+897893us) service_pool.cc:224] Handling call
0709 13:11:18.178243 (+  9024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.207882 (+ 29639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.207918 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.219571 (+ 11653us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.604855 (+1385284us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:19.604984 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.605119 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.605206 (+    87us) raft_consensus.cc:1685] finished
0709 13:11:19.605222 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.605460 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3232,"raft.queue_time_us":16098,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":21051,"thread_start_us":1361572,"threads_started":1,"wal-append.queue_time_us":695013}
I20260709 13:11:19.613487 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:19.679411 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:19.680568 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67369.4us
I20260709 13:11:19.456163 29493 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.682171 29567 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.627930 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:19.640411 29738 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.683367 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:19.683892 29738 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.685377 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:19.686342 29545 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.683892 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2568) took 1442 ms. Trace:
I20260709 13:11:19.650645 27807 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:19.686687 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73989.8us
I20260709 13:11:19.654479 27153 raft_consensus.cc:2368] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:19.687770 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:19.687814 29550 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:19.657572 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:19.688604 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:19.689188 27227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 585) took 1372 ms (client timeout 1592 ms). Trace:
W20260709 13:11:19.689718 27227 rpcz_store.cc:269] 0709 13:11:18.316918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.415978 (+ 99060us) service_pool.cc:224] Handling call
0709 13:11:19.689088 (+1273110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.690250 29732 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.690501 29567 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.690904 29385 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:19.691123 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:19.692059 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 584) took 1375 ms. Trace:
I20260709 13:11:19.692493 27227 rpcz_store.cc:276] 0709 13:11:18.316626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.690693 (+1374067us) service_pool.cc:224] Handling call
0709 13:11:19.691982 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.658324 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:19.687002 27224 rpcz_store.cc:276] 0709 13:11:18.241623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.627191 (+1385568us) service_pool.cc:224] Handling call
0709 13:11:19.683791 (+ 56600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.695335 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:19.640622 27155 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:19.689726 29566 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.651705 29696 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.696141 27224 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:19.696173 29566 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:19.696899 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 582) took 1380 ms. Trace:
I20260709 13:11:19.697305 27224 rpcz_store.cc:276] 0709 13:11:18.316078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.694941 (+1378863us) service_pool.cc:224] Handling call
0709 13:11:19.696839 (+  1898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.698375 29696 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.658856 29571 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:19.677721 27306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1649) took 1853 ms (client timeout 1827 ms). Trace:
I20260709 13:11:19.698778 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:19.699168 27306 rpcz_store.cc:269] 0709 13:11:17.824287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.871912 (+ 47625us) service_pool.cc:224] Handling call
0709 13:11:19.677257 (+1805345us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400267fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:19.677471 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3485552000}
I20260709 13:11:19.684492 29493 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:19.688033 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73612.9us
I20260709 13:11:19.657774 29735 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.702412 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:19.693751 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:19.644100 27839 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:19.645459 27303 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.681773 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:19.671721 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1647) took 1860 ms. Trace:
I20260709 13:11:19.702876 29493 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:19.686992 29545 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:19.697733 29566 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:19.708000 27807 connection.cc:256] RPC call timeout handler was delayed by -1.5834910910000417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:11:19.709995 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 657) took 1899 ms. Trace:
W20260709 13:11:19.711311 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.717669 27839 rpcz_store.cc:276] 0709 13:11:17.810790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.034139 (+1223349us) service_pool.cc:224] Handling call
0709 13:11:19.034493 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.709599 (+675106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.709931 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.714744 27227 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:19.651676 29407 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:19.724916 27298 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:19.691143 29567 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:19.744757 27154 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:19.729620 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1747) took 1403 ms. Trace:
I20260709 13:11:19.746353 27227 rpcz_store.cc:276] 0709 13:11:18.317801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.693267 (+1375466us) service_pool.cc:224] Handling call
0709 13:11:19.721605 (+ 28338us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:19.734639 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 127348us
I20260709 13:11:19.710033 29493 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.752702 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:19.759423 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2564) took 1523 ms. Trace:
I20260709 13:11:19.759811 27224 rpcz_store.cc:276] 0709 13:11:18.236115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.698023 (+1461908us) service_pool.cc:224] Handling call
0709 13:11:19.759349 (+ 61326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.731192 29737 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:19.779596 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.780131 27807 connection.cc:256] RPC call timeout handler was delayed by -1.2789015500000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2928s for a response
I20260709 13:11:19.714214 29742 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.764251 29693 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.767158 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 85612us
W20260709 13:11:19.767371 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 77441.9us
I20260709 13:11:19.768301 29736 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:19.771010 29567 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:19.778497 29560 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.009s
I20260709 13:11:19.704226 27300 rpcz_store.cc:276] 0709 13:11:17.811114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.896498 (+ 85384us) service_pool.cc:224] Handling call
0709 13:11:18.194497 (+297999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.194741 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:18.337427 (+142686us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.671058 (+1333631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.671176 (+   118us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:19.671300 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.671401 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.671651 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252492,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":3576,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":213,"thread_start_us":1445273,"threads_started":2,"wal-append.queue_time_us":678902}
W20260709 13:11:19.788962 27232 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.882s	user 0.013s	sys 0.011s
I20260709 13:11:19.755738 29571 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.791738 29696 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.807129 27226 raft_consensus.cc:2410] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:19.791632 29736 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.711412 29545 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.803387 29735 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.815644 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:19.817305 27303 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:19.813028 27232 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:19.812237 29736 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.816545 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:19.816917 27297 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:19.825721 29571 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.827100 29696 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.829020 29527 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.829571 29527 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.830017 29571 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.831779 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1739) took 2560 ms. Trace:
I20260709 13:11:19.832202 27224 rpcz_store.cc:276] 0709 13:11:17.271569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.794215 (+2522646us) service_pool.cc:224] Handling call
0709 13:11:19.820862 (+ 26647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.830527 (+  9665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.830555 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.831413 (+   858us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:19.831492 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.831558 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.831701 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.819499 29683 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:19.835338 29683 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.815442 29738 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.808760 29627 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:11:19.817670 29680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.022s	sys 0.015s
W20260709 13:11:19.842470 27232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 580) took 1509 ms (client timeout 1815 ms). Trace:
I20260709 13:11:19.842548 29732 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.825799 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:19.843806 27227 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:19.844133 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1737) took 2545 ms. Trace:
I20260709 13:11:19.811843 29693 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:19.847810 29672 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.005s
I20260709 13:11:19.848238 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1740) took 2565 ms. Trace:
I20260709 13:11:19.829909 29696 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:19.851099 29430 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.935401 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:19.937232 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 133997us
W20260709 13:11:19.856447 27232 rpcz_store.cc:269] 0709 13:11:18.315503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.869394 (+553891us) service_pool.cc:224] Handling call
0709 13:11:19.822525 (+953131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.938679 27224 rpcz_store.cc:276] 0709 13:11:17.271789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.833149 (+2561360us) service_pool.cc:224] Handling call
0709 13:11:19.833661 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.834018 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.834044 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.837400 (+  3356us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:19.837459 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.837529 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.837642 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.877782 29566 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:19.930094 29532 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.943591 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 578) took 1623 ms. Trace:
W20260709 13:11:19.887842 27832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 653) took 2245 ms (client timeout 2119 ms). Trace:
W20260709 13:11:19.856412 29680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.022s	sys 0.017s
I20260709 13:11:19.948261 27227 rpcz_store.cc:276] 0709 13:11:18.314874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.757385 (+1442511us) service_pool.cc:224] Handling call
0709 13:11:19.938583 (+181198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:19.945379 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 134899us
I20260709 13:11:19.950670 27839 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.954180 27224 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:19.955029 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1745) took 2682 ms. Trace:
I20260709 13:11:19.955711 27224 rpcz_store.cc:276] 0709 13:11:17.273023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.945794 (+2672771us) service_pool.cc:224] Handling call
0709 13:11:19.953578 (+  7784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.954690 (+  1112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.954940 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.956126 29715 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.956944 29735 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:19.957994 29621 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:19.958518 29621 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:19.958767 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 135509us
W20260709 13:11:19.948345 27832 rpcz_store.cc:269] 0709 13:11:17.642669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.894264 (+251595us) service_pool.cc:224] Handling call
0709 13:11:19.887258 (+1992994us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540057f3d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:19.887531 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490247040}
I20260709 13:11:19.960166 29566 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:19.966259 29638 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:19.966817 29638 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:19.967298 29638 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:19.966984 29566 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:19.967512 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:19.968463 27838 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:19.969614 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:19.963989 29735 consensus_queue.cc:1243] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:19.937825 27223 rpcz_store.cc:276] 0709 13:11:17.271073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.772019 (+500946us) service_pool.cc:224] Handling call
0709 13:11:17.802984 (+ 30965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.805985 (+  3001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.806015 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.806537 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.877054 (+1070517us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:19.650430 (+773376us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.802130 (+151700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.807998 (+  5868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.811171 (+  3173us) raft_consensus.cc:1685] finished
0709 13:11:19.811192 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.816764 (+  5572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50213,"prepare.queue_time_us":768473,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":88,"raft.queue_time_us":13384,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":16539,"thread_start_us":1323613,"threads_started":3,"wal-append.queue_time_us":859794,"wal-append.run_cpu_time_us":2170,"wal-append.run_wall_time_us":1009901}
W20260709 13:11:19.970567 27197 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 2.115s (SENT)
I20260709 13:11:19.973129 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:19.975610 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:19.953961 29732 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.983575 27839 raft_consensus.cc:2410] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:19.974699 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:19.987502 27301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2024) took 2828 ms (client timeout 2925 ms). Trace:
I20260709 13:11:19.986157 29532 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:19.988179 29430 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:19.989004 27838 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:19.960099 29621 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:19.992369 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1732) took 2722 ms. Trace:
I20260709 13:11:19.992621 29621 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.992789 27228 rpcz_store.cc:276] 0709 13:11:17.269272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.570548 (+301276us) service_pool.cc:224] Handling call
0709 13:11:17.647847 (+ 77299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.870025 (+222178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.991741 (+2121716us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540038c7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:19.992100 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365317888}
W20260709 13:11:19.987962 27301 rpcz_store.cc:269] 0709 13:11:17.146190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.146312 (+   122us) service_pool.cc:224] Handling call
0709 13:11:19.970715 (+2824403us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540031c4d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:19.974551 (+  3836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126928768}
I20260709 13:11:19.995481 27832 raft_consensus.cc:2368] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3.
I20260709 13:11:19.986265 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:19.997370 27232 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:19.999333 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2566) took 1758 ms. Trace:
I20260709 13:11:19.999851 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:20.007800 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.041966 27838 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:20.057677 29735 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:20.059456 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 95821.7us
I20260709 13:11:20.002808 27224 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:11:20.036320 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 65481us
I20260709 13:11:20.086897 27227 rpcz_store.cc:276] 0709 13:11:18.240935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.950915 (+1709980us) service_pool.cc:224] Handling call
0709 13:11:19.982629 (+ 31714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.998954 (+ 16325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.998987 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.999051 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:19.999089 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.999154 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.999262 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:20.105541 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.243259 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.310212 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 832) took 2062 ms. Trace:
I20260709 13:11:20.310851 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.311990 27305 raft_consensus.cc:2368] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4.
I20260709 13:11:20.313138 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:20.315245 27227 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:11:20.315685 27227 pending_rounds.cc:85] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
I20260709 13:11:20.315979 27227 pending_rounds.cc:107] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:11:20.316285 27227 raft_consensus.cc:2889] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.317046 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1746) took 1999 ms. Trace:
I20260709 13:11:20.317365 27227 rpcz_store.cc:276] 0709 13:11:18.317526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.314139 (+1996613us) service_pool.cc:224] Handling call
0709 13:11:20.314668 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.316788 (+  2120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.316966 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.317790 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2565) took 1851 ms. Trace:
I20260709 13:11:20.318856 27232 rpcz_store.cc:276] 0709 13:11:18.236415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.961204 (+1724789us) service_pool.cc:224] Handling call
0709 13:11:19.973749 (+ 12545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.997828 (+ 24079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.088115 (+ 90287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.310292 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2569) took 1824 ms. Trace:
I20260709 13:11:20.324373 27224 rpcz_store.cc:276] 0709 13:11:18.241918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.964176 (+1722258us) service_pool.cc:224] Handling call
0709 13:11:19.998331 (+ 34155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:20.065739 (+ 67408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.066193 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:19.991014 29493 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.431830 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.443600 27223 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.444209 27223 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:20.443699 27301 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:20.448210 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.442494 29627 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:20.457209 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.457574 27223 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.459023 27223 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:20.459156 29799 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:11:20.460009 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 486939us
I20260709 13:11:20.465538 27232 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:20.466413 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1748) took 2148 ms. Trace:
I20260709 13:11:20.466784 27232 rpcz_store.cc:276] 0709 13:11:18.325924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.370878 (+2044954us) service_pool.cc:224] Handling call
0709 13:11:20.449532 (+ 78654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.466075 (+ 16543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.466342 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.468101 29732 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:20.471351 29683 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:20.465590 27832 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:20.450659 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.468137 29693 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:20.481019 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:20.478430 29802 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:20.487010 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.484200 27300 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:11:20.482000 29638 consensus_meta.cc:287] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.003s
I20260709 13:11:20.489755 27301 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:20.491691 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.493012 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.491451 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:20.496752 27305 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:20.496901 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:20.498320 29700 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:20.498790 29700 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:20.499495 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2065) took 2305 ms. Trace:
I20260709 13:11:20.499951 27148 rpcz_store.cc:276] 0709 13:11:18.193717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.193846 (+   129us) service_pool.cc:224] Handling call
0709 13:11:18.220061 (+ 26215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.604602 (+1384541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.499076 (+894474us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540037f0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:20.499395 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2671643392}
I20260709 13:11:20.500061 29700 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.501550 29700 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.502727 29493 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:20.504742 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:20.505744 29732 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:20.506699 29732 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:20.511059 27838 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:20.493904 29638 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.517685 27303 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:20.517798 29693 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.310879 27835 rpcz_store.cc:276] 0709 13:11:18.027758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.728253 (+1700495us) service_pool.cc:224] Handling call
0709 13:11:19.770457 (+ 42204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.770934 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:19.822962 (+ 52028us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.982707 (+159745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.985650 (+  2943us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:19.997190 (+ 11540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.038499 (+ 41309us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.086424 (+ 47925us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181922,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6765,"raft.queue_time_us":6829,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4599,"thread_start_us":80463,"threads_started":2,"wal-append.queue_time_us":491867}
I20260709 13:11:20.539973 29693 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.560920 29693 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:20.565074 29621 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.001s
W20260709 13:11:20.541149 29736 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.002s
W20260709 13:11:20.576339 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.677044 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.705637 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.706612 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.704653 27223 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:20.707479 27223 pending_rounds.cc:85] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:20.720943 27223 pending_rounds.cc:107] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:20.721318 27223 raft_consensus.cc:2889] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.719933 27301 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
W20260709 13:11:20.785869 27229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 567) took 4163 ms (client timeout 4755 ms). Trace:
I20260709 13:11:20.789660 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 583) took 2470 ms. Trace:
I20260709 13:11:20.790469 27223 rpcz_store.cc:276] 0709 13:11:18.316334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.981725 (+1665391us) service_pool.cc:224] Handling call
0709 13:11:20.443321 (+461596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.786721 (+343400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.787027 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:20.792183 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.823616 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 318939us
I20260709 13:11:20.834235 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:20.835541 29621 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:20.836139 29621 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:20.789103 27229 rpcz_store.cc:269] 0709 13:11:16.360941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.181136 (+820195us) service_pool.cc:224] Handling call
0709 13:11:20.518459 (+3337323us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54001261d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:20.524559 (+  6100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36694400}
I20260709 13:11:20.720474 29736 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.858716 29621 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:20.868068 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 143882us
I20260709 13:11:20.857379 29627 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:20.870048 29551 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:20.872074 29551 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.875236 29551 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:20.875756 29736 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:20.876965 27149 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:20.877678 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:20.870110 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:20.889694 29638 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:20.893666 29640 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:20.894872 29551 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:20.895298 29551 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:20.896474 29551 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:20.897112 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1071) took 3154 ms (client timeout 2106 ms). Trace:
W20260709 13:11:20.897516 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.898200 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.898085 29551 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:20.899441 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.900131 27841 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.902266 29627 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:20.902786 27226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 581) took 2587 ms (client timeout 1949 ms). Trace:
I20260709 13:11:20.902869 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:20.897644 27833 rpcz_store.cc:269] 0709 13:11:17.742974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.190478 (+447504us) service_pool.cc:224] Handling call
0709 13:11:20.896734 (+2706256us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54003377d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:20.896896 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641165696}
I20260709 13:11:20.910576 29677 raft_consensus.cc:1064] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:20.918815 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:20.920029 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:20.920990 29732 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.921455 29732 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.921837 29732 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:20.921962 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.922200 29805 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:20.922617 27272 connection.cc:256] RPC call timeout handler was delayed by -2.0341136530000767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:11:20.923009 27272 connection.cc:256] RPC call timeout handler was delayed by -2.025857250999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:11:20.923357 27272 connection.cc:256] RPC call timeout handler was delayed by -1.8431572510000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:11:20.923689 27272 connection.cc:256] RPC call timeout handler was delayed by -1.5976614450000852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:11:20.924057 27272 connection.cc:256] RPC call timeout handler was delayed by -1.4429182490000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:11:20.923524 29677 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.924774 27841 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:20.912945 27226 rpcz_store.cc:269] 0709 13:11:18.315804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.678844 (+1363040us) service_pool.cc:224] Handling call
0709 13:11:20.902500 (+1223656us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540038d1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:20.902669 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287057792}
W20260709 13:11:20.924381 27272 connection.cc:256] RPC call timeout handler was delayed by -1.2923572510001122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2437s for a response
W20260709 13:11:20.910884 27804 connection.cc:256] RPC call timeout handler was delayed by -1.8655670069999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:11:20.924597 29638 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:20.929388 27804 connection.cc:256] RPC call timeout handler was delayed by -1.731467006999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:11:20.930594 29638 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.934437 29638 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.936947 29638 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:20.939653 27807 connection.cc:256] RPC call timeout handler was delayed by -1.8827706839999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.47550000000000003s for a response
I20260709 13:11:20.939330 29732 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.946233 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:20.914023 29627 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.950420 29627 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:20.950611 29640 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:20.947032 27804 connection.cc:256] RPC call timeout handler was delayed by -1.5946670069999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:11:20.952551 27804 connection.cc:256] RPC call timeout handler was delayed by -1.5712670069999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:11:20.952885 27804 connection.cc:256] RPC call timeout handler was delayed by -1.5271670069998891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
W20260709 13:11:20.953192 27804 connection.cc:256] RPC call timeout handler was delayed by -1.4884670069998265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:11:20.953315 27231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1742) took 3680 ms (client timeout 1500 ms). Trace:
W20260709 13:11:20.953536 27804 connection.cc:256] RPC call timeout handler was delayed by -1.2193670069998461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:11:20.953847 27804 connection.cc:256] RPC call timeout handler was delayed by -1.1505306310000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:11:20.953748 27231 rpcz_store.cc:269] 0709 13:11:17.272250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.306072 (+ 33822us) service_pool.cc:224] Handling call
0709 13:11:20.952909 (+3646837us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400392bd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:20.953117 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052125568}
I20260709 13:11:20.951717 29678 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:20.961400 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.962337 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.961407 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.963608 27835 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:20.963733 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.964390 27839 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:20.964599 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.965364 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.962428 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.966326 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.967144 27832 raft_consensus.cc:2393] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 2: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:20.967734 27838 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:20.967011 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.961630 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.970273 27834 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:20.971189 27833 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:20.971365 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.965850 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.973869 29678 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:20.974871 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.974633 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.968429 29805 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:20.974840 27841 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 2 LEARNER]: Advancing to term 4
I20260709 13:11:20.975394 27834 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:20.973875 27836 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:20.967834 29551 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:20.977599 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.978838 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.979352 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.978962 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:20.980190 27833 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:20.980645 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.981127 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:20.981521 27836 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:20.981918 27833 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:20.982154 27835 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:20.979691 27834 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:20.984392 29551 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.984863 29551 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.980780 27838 raft_consensus.cc:2376] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4. Re-sending same reply.
W20260709 13:11:20.986647 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.987293 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:20.991885 29700 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.992449 29700 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:20.986683 29640 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 13:11:20.995975 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.3107e+06us
I20260709 13:11:20.999305 29327 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:20.996011 29640 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.000187 29640 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.000586 29640 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.983429 29711 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:21.003734 29700 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:20.977046 27832 raft_consensus.cc:2376] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4. Re-sending same reply.
I20260709 13:11:21.004886 27839 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
W20260709 13:11:21.012244 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54892.4us
I20260709 13:11:21.014837 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:21.021214 29568 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:21.021660 29568 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:21.022192 29568 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.023672 29736 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.025013 29347 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:21.007264 27230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2547) took 5553 ms (client timeout 2437 ms). Trace:
W20260709 13:11:21.026255 27230 rpcz_store.cc:269] 0709 13:11:15.454116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.454238 (+   122us) service_pool.cc:224] Handling call
0709 13:11:21.006817 (+5552579us) spinlock_profiling.cc:243] Waited 4.33 s on lock 0x7b5400217d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.007030 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9948845824}
I20260709 13:11:21.026780 29677 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.027175 29677 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.021654 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:21.027576 27839 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:21.007934 27841 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:20.983599 29805 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.043821 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.044247 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.044699 27833 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:21.044977 27832 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.045868 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.028267 29677 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.048269 29677 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:21.049186 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.043882 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.053675 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.054471 27839 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.049477 29568 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.060586 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.061542 27838 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:21.067670 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.067865 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.068497 27834 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:21.068904 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.069748 27841 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:21.087886 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:21.091580 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 104334us
I20260709 13:11:21.088233 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.089094 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.087939 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.096944 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.096949 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.097854 27838 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:21.099924 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 78343.3us
I20260709 13:11:21.097513 27231 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:21.110000 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.102185 27226 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:21.119071 29640 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.123623 27839 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:21.123864 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.115782 29627 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.129580 29627 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:21.130508 27223 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.133946 27153 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:21.135341 27153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2076) took 1528 ms (client timeout 1958 ms). Trace:
W20260709 13:11:21.135730 27153 rpcz_store.cc:269] 0709 13:11:19.606908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.688186 (+ 81278us) service_pool.cc:224] Handling call
0709 13:11:21.135110 (+1446924us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003566d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.135254 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3321603968}
I20260709 13:11:21.137362 29809 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:21.137643 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:21.139685 29809 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.140734 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.143191 27229 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.144181 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.148105 29640 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:21.148692 27225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1750) took 2822 ms (client timeout 1827 ms). Trace:
W20260709 13:11:21.155000 27225 rpcz_store.cc:269] 0709 13:11:18.326716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.872453 (+545737us) service_pool.cc:224] Handling call
0709 13:11:21.148441 (+2275988us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540037ad54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.148618 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781456128}
I20260709 13:11:21.150563 29737 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:21.156131 29737 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.157205 29737 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.158385 27838 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
W20260709 13:11:21.152989 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.158609 27304 raft_consensus.cc:2410] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:11:21.160822 27304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1662) took 1465 ms (client timeout 1695 ms). Trace:
I20260709 13:11:21.161069 29538 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:21.161319 27304 rpcz_store.cc:269] 0709 13:11:19.695043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.697740 (+  2697us) service_pool.cc:224] Handling call
0709 13:11:21.160563 (+1462823us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54002dc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.160749 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354523008}
I20260709 13:11:21.158562 29737 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.163378 29732 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:21.100694 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.171038 27835 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:21.172227 29814 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:21.178412 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60208.2us
I20260709 13:11:21.179795 29812 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.124585 27834 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:21.188370 27151 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.510s	user 0.019s	sys 0.000s
I20260709 13:11:21.188922 27151 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:21.189585 27151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2077) took 1582 ms (client timeout 1630 ms). Trace:
W20260709 13:11:21.190150 27151 rpcz_store.cc:269] 0709 13:11:19.607391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.611973 (+  4582us) service_pool.cc:224] Handling call
0709 13:11:21.189511 (+1577538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:21.150615 29735 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.180421 29812 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.198715 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.201042 27838 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.202771 27834 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:21.203816 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 136291us
I20260709 13:11:21.201283 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.204619 27225 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:21.206699 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.207135 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.213195 27839 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:21.211464 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.214766 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.215536 27232 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.216934 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.217610 27223 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:21.220305 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.221362 27225 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:21.222402 29538 raft_consensus.cc:1064] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:21.222641 27835 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:21.224967 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.225564 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.226517 27226 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.226400 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.227023 27227 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.227432 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.230393 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.230988 27231 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.225597 27229 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:21.234015 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:21.235448 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45851.1us
I20260709 13:11:21.226531 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.240424 27838 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:21.245509 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:21.245743 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:21.247051 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.250029 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:21.250670 27838 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:21.247092 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:21.258808 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:21.260368 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.261260 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.209967 29735 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.262180 27232 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:21.263159 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.264645 27232 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:21.277841 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.265965 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:21.267067 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:21.268356 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.253643 27151 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:21.265923 27271 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:21.298135 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.302639 27834 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.302871 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:21.311692 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:21.312206 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75413.5us
W20260709 13:11:21.312836 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 132223us
I20260709 13:11:21.314054 27227 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:21.314272 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48413.5us
I20260709 13:11:21.293856 29353 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.242548 29493 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:11:21.299960 29820 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:21.321137 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:21.322099 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73010.8us
I20260709 13:11:21.323710 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:21.323858 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 76868.9us
I20260709 13:11:21.325574 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.314668 29677 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.326285 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.318166 29353 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.304512 29551 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.330790 27153 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:21.329324 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.329958 29353 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:21.340297 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.327430 29568 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:21.268963 29538 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.329979 29819 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:21.355134 27151 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.356685 27231 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:21.354897 29812 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:21.362618 27230 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:21.356005 29814 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.356258 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.365844 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.364627 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:21.263031 29735 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.331665 29737 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:21.371583 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.266132 29815 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:11:21.350142 29546 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.346381 29821 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:21.352864 29819 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.348438 29678 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:21.379184 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1074) took 3161 ms. Trace:
W20260709 13:11:21.388751 27122 connection.cc:256] RPC call timeout handler was delayed by -1.6076708909999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:11:21.369918 29715 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.398468 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.347069 29826 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:21.394443 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:21.404718 27806 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.569s (SENT)
I20260709 13:11:21.405191 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:21.391676 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.393028 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:21.400650 27835 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:21.401223 27838 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:21.401059 29493 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:21.401877 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.402577 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.418286 29826 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:21.418455 27305 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:21.419448 29826 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.402927 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:21.422739 27301 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.348588 29640 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:21.391390 27837 rpcz_store.cc:276] 0709 13:11:18.209047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.153585 (+2944538us) service_pool.cc:224] Handling call
0709 13:11:21.153976 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.154286 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:21.310398 (+156112us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.367660 (+ 57262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:21.367716 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:21.369760 (+  2044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.369831 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.369966 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172987,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":11018,"raft.queue_time_us":18018,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":9253,"thread_start_us":182581,"threads_started":2}
W20260709 13:11:21.426641 27302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1646) took 3616 ms (client timeout 2000 ms). Trace:
W20260709 13:11:21.427204 27302 rpcz_store.cc:269] 0709 13:11:17.810440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.875742 (+ 65302us) service_pool.cc:224] Handling call
0709 13:11:21.426391 (+3550649us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000ea454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.426566 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815929088}
I20260709 13:11:21.368182 29813 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:21.400548 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69915.5us
I20260709 13:11:21.428283 29568 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:21.428722 29568 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:21.429126 29568 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.434242 27153 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.437201 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.438139 27297 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:21.439074 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:21.439730 27300 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.440832 29730 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:21.391427 29819 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:21.429973 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:21.442691 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:21.442922 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52448.2us
I20260709 13:11:21.417167 27151 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:21.403638 29715 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.470033 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:21.477197 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72506.2us
W20260709 13:11:21.489535 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 122249us
I20260709 13:11:21.460443 29627 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.478986 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2072) took 3101 ms. Trace:
I20260709 13:11:21.470793 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:21.559934 27303 raft_consensus.cc:2368] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:21.543669 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.469586 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.415534 29407 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:21.406106 29546 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.428277 29813 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.406347 29678 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.544000 27301 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:21.470530 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:21.558689 27149 rpcz_store.cc:276] 0709 13:11:18.377399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.377684 (+   285us) service_pool.cc:224] Handling call
0709 13:11:18.389604 (+ 11920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.877564 (+2487960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.478553 (+600989us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400098b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:21.478905 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5719225088}
I20260709 13:11:21.562629 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:21.558017 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 143187us
I20260709 13:11:21.566813 27153 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:21.574383 27305 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.576135 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.556751 29715 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.582242 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.574738 29415 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.576082 29680 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.572415 29820 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:21.587694 29546 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:21.587909 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.588133 29551 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.589641 27153 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:21.590309 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.591810 29568 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.584950 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.592216 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:21.574960 29813 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.606009 27155 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:21.613646 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:21.564725 29353 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.583585 29407 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:21.586544 29415 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.605666 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.606761 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:21.622464 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46420.2us
I20260709 13:11:21.615512 27300 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:21.607649 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:21.607952 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.611071 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:21.614255 27155 raft_consensus.cc:2376] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5. Re-sending same reply.
W20260709 13:11:21.624400 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.608916 27297 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:21.627511 29737 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:21.632915 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.612491 29546 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:21.634961 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.609747 29568 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.625649 29415 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.638625 27225 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:21.642635 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 86961.6us
W20260709 13:11:21.643039 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 85239.7us
I20260709 13:11:21.604110 29680 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.643600 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:21.644280 27806 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.592s (SENT)
I20260709 13:11:21.646299 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.628896 29730 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:21.655073 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:21.636624 29551 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:21.656289 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.636266 29546 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:21.666036 27806 leader_election.cc:336] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.841s (SENT)
I20260709 13:11:21.666531 27155 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:21.667838 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:21.668116 29831 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:21.669445 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:21.675892 27300 raft_consensus.cc:2376] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4. Re-sending same reply.
I20260709 13:11:21.676928 29741 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:21.678758 29832 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.679208 29832 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.679577 29832 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.632099 29640 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:11:21.657864 29730 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.640113 29538 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:11:21.665516 29546 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.669376 29805 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.702569 29805 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:21.693439 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 82435.7us
W20260709 13:11:21.705065 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.681357 29551 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:21.705153 29805 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:21.706651 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 276771us
I20260709 13:11:21.706817 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:21.708323 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:21.707098 29551 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.709506 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.713166 29538 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.713752 29538 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:21.713276 29840 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:21.714406 29538 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.719019 27841 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:21.723152 29843 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.723661 29741 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:21.724965 29741 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.728902 29843 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.729542 29843 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.721611 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.690296 29831 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:21.732882 29819 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:21.737571 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 337840us
I20260709 13:11:21.733886 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:21.741456 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 72084.1us
I20260709 13:11:21.741776 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.692001 29568 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:11:21.690949 29407 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.674656 29678 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:21.750283 27840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1072) took 3867 ms (client timeout 1841 ms). Trace:
I20260709 13:11:21.752238 27155 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:21.733956 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:21.761011 27840 rpcz_store.cc:269] 0709 13:11:17.833505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.874120 (+ 40615us) service_pool.cc:224] Handling call
0709 13:11:21.689974 (+3815854us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540051ead4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.700511 (+ 10537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828081536}
I20260709 13:11:21.760713 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:21.733677 29839 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:11:21.782192 29835 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:21.782747 29835 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.783154 29835 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.786834 29680 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.744124 29820 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:21.770102 29640 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:21.793560 29353 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.796172 27302 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:21.732352 29737 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.802418 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.804657 27300 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:21.807616 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 586) took 3490 ms. Trace:
W20260709 13:11:21.830106 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.917244 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 114225us
I20260709 13:11:21.808171 27228 rpcz_store.cc:276] 0709 13:11:18.317222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.993819 (+1676597us) service_pool.cc:224] Handling call
0709 13:11:20.902627 (+908808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.903047 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:20.903077 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.903121 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:20.903152 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.903221 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.807378 (+904157us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540038d1d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:21.807537 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":505,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":2087380736}
I20260709 13:11:21.810916 29415 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.810449 29693 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:21.928570 29415 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.916857 29568 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:21.929539 29568 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.913863 29546 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.932292 29546 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:21.929979 29568 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:21.939944 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 166896us
I20260709 13:11:21.941951 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:21.942287 29546 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:21.946601 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:21.947538 27302 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
W20260709 13:11:21.965382 29833 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:11:21.973627 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.791142 29842 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 13:11:21.944416 29812 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.983562 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 222876us
W20260709 13:11:21.985649 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 43815.9us
I20260709 13:11:21.989077 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:21.990355 29627 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:21.990931 29627 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.991418 29627 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.994144 29845 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.994714 29845 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.000561 29845 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:21.986305 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 280316us
I20260709 13:11:22.002331 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.003539 29493 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:22.005034 29834 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:22.006233 29812 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.007402 29843 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:21.949405 29805 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:22.015118 29819 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.017220 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.018527 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.020762 27305 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:22.026827 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.030259 27302 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:22.023927 29849 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:22.049428 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.055262 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.028151 29845 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:21.948876 29730 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.063591 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.063652 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.018848 29821 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:22.052034 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.047261 29840 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:22.056777 29741 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:11:22.079221 29730 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.079756 29813 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.081832 29546 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:22.052356 29407 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:22.082330 29546 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:22.082788 29546 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.058331 29839 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:22.043009 29814 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:11:21.984288 29831 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.069353 29568 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.130431 29812 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.068849 29845 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:22.117913 29407 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.134688 29845 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.067365 29735 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:11:22.053819 29538 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.139405 29538 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:22.090174 29846 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:22.100806 29847 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:22.147178 29715 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:11:22.147699 29715 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.153414 29415 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:22.085637 29835 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.149855 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.126806 29839 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:22.154004 29415 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:22.172252 27123 connection.cc:256] RPC call timeout handler was delayed by -1.7825182190001669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:11:22.173250 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 125521us
I20260709 13:11:22.174316 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.176771 27122 leader_election.cc:400] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3.
I20260709 13:11:22.177073 27122 leader_election.cc:403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.178289 29814 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:22.178982 29814 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:22.179844 29830 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3.
I20260709 13:11:22.180666 29415 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.182214 29415 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.194689 29839 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.201807 27152 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:22.179584 29835 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.205788 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.205854 27152 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:22.207333 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.208031 27154 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:22.208786 29832 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.007s
I20260709 13:11:22.209302 29832 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:22.206159 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.219135 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.221118 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.222092 27148 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:22.217188 27154 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:22.223286 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.232605 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.234382 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.235026 27154 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:22.250463 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.251343 27152 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:22.252411 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.253625 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.254525 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.255854 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.249857 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.256851 27153 raft_consensus.cc:2410] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:22.257836 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.258443 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.259253 27154 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:22.260756 29832 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.258628 27149 raft_consensus.cc:2368] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
W20260709 13:11:22.299142 29817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.038s
W20260709 13:11:22.299722 29817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.005s	sys 0.039s
I20260709 13:11:22.306377 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.307078 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.310456 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.311100 27153 raft_consensus.cc:2376] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8. Re-sending same reply.
I20260709 13:11:22.312052 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.313766 27152 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:22.314239 27152 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:22.315161 27152 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.305763 29843 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.317050 27152 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.328179 29821 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.328434 29546 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.328976 29821 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.351780 27297 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.353574 29821 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:22.334800 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.358779 29821 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:22.358871 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:22.359432 29821 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.359926 29821 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.361284 29859 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:22.361884 29859 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:22.362932 29859 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:22.363981 27050 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 335) took 11659 ms (client timeout 15000 ms). Trace:
I20260709 13:11:22.355870 29546 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:22.370235 27050 rpcz_store.cc:269] 0709 13:11:10.697416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.748618 (+ 51202us) service_pool.cc:224] Handling call
0709 13:11:13.019751 (+2271133us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:11:13.343519 (+323768us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b540022ff10. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec13640 00007f9a57aeab76 00007f9a57bf4c3e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:11:22.357018 (+9013499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.151672 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.447358 (+295686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.470083 (+ 22725us) write_op.cc:435] Acquired schema lock
0709 13:11:15.474176 (+  4093us) tablet.cc:662] Decoding operations
0709 13:11:15.532003 (+ 57827us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.532072 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.532099 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:11:15.532683 (+   584us) tablet.cc:701] Row locks acquired
0709 13:11:15.532706 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:11:15.532892 (+   186us) write_op.cc:270] Start()
0709 13:11:15.533019 (+   127us) write_op.cc:276] Timestamp: P: 1783602675532839 usec, L: 0
0709 13:11:15.533043 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.533749 (+   706us) log.cc:844] Serialized 2089 byte log entry
0709 13:11:17.397719 (+1863970us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b
0709 13:11:19.023830 (+1626111us) op_driver.cc:464] REPLICATION: finished
0709 13:11:21.015376 (+1991546us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18001abba0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:21.015646 (+   270us) write_op.cc:301] APPLY: starting
0709 13:11:21.015769 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:21.016025 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:21.016065 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:21.017046 (+   981us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:21.017420 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:11:21.017488 (+    68us) write_op.cc:312] APPLY: finished
0709 13:11:21.017950 (+   462us) log.cc:844] Serialized 47 byte log entry
0709 13:11:21.199569 (+181619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:21.229028 (+ 29459us) write_op.cc:454] Released schema lock
0709 13:11:21.229103 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:21.229727 (+   624us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:21.229760 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1031902,"reported_tablets":9,"spinlock_wait_cycles":3521656448,"child_traces":[["op",{"apply.queue_time_us":233753,"apply.run_cpu_time_us":74762,"apply.run_wall_time_us":214062,"num_ops":5,"prepare.queue_time_us":392394,"prepare.run_cpu_time_us":52712,"prepare.run_wall_time_us":2683933,"raft.queue_time_us":685409,"raft.run_cpu_time_us":6587,"raft.run_wall_time_us":299429,"replication_time_us":3462375,"spinlock_wait_cycles":52763776,"thread_start_us":3118958,"threads_started":5,"wal-append.queue_time_us":2318694,"wal-append.run_cpu_time_us":30411,"wal-append.run_wall_time_us":3113619}]]}
I20260709 13:11:22.392969 29821 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.340830 27152 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:22.341746 29627 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:22.397780 29700 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:11:22.400009 29627 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:22.407806 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.409021 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.418509 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.420172 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.420976 27301 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.410573 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2581) took 1153 ms. Trace:
I20260709 13:11:22.426802 27225 rpcz_store.cc:276] 0709 13:11:21.257084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.258520 (+  1436us) service_pool.cc:224] Handling call
0709 13:11:22.410338 (+1151818us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54002274d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:22.410504 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867195264}
I20260709 13:11:22.428556 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.429296 27301 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:22.432754 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.433291 29527 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:22.436458 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.438683 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.440771 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.446673 29813 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.447189 29821 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.457440 29568 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:22.460960 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.149878 29715 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.465546 29847 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:22.465899 29839 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:22.466154 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 402598us
I20260709 13:11:22.471297 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:22.448779 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.476281 29715 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:22.477734 29813 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.479477 29813 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.481703 29813 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.474498 29415 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:22.482968 29415 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:22.483445 29415 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.473526 29847 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:22.477965 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.487215 27149 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:22.478840 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.488600 27152 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:22.496536 27806 leader_election.cc:336] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.846s (SENT)
I20260709 13:11:22.508646 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.510375 29819 raft_consensus.cc:2764] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:22.512121 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.513482 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.514124 27152 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.516036 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.516505 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.517402 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:22.517966 27149 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.499657 29415 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:22.507412 27150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2063) took 4314 ms (client timeout 5055 ms). Trace:
W20260709 13:11:22.522295 27150 rpcz_store.cc:269] 0709 13:11:18.192768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.192969 (+   201us) service_pool.cc:224] Handling call
0709 13:11:22.507117 (+4314148us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400170cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:22.507305 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2654570880}
I20260709 13:11:22.522778 27151 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.506472 29815 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.524628 29815 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.527518 29815 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:22.541682 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 478080us
I20260709 13:11:22.548244 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.505749 29407 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.551525 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:22.557973 27231 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:22.562350 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:22.563966 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:22.564821 27231 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:22.568176 27224 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:22.559321 27225 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.571221 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.546443 29415 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.572103 27150 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:22.551937 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:22.565829 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:22.588953 27149 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:22.589403 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:22.590322 27838 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:22.593317 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.593743 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.613072 27152 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:22.617635 27835 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:11:22.620095 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.627427 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.619863 27151 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:22.623728 27838 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:22.623977 27148 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:22.606431 27228 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:22.628445 29813 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:22.632045 29813 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:22.633059 29813 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:22.634920 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:22.626121 29415 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:11:22.635640 27223 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.636121 29415 consensus_queue.cc:1243] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:22.628774 29546 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:22.636827 29546 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:22.637820 29546 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.640836 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:22.644882 27230 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:22.646827 27223 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:22.662156 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:22.666527 29627 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:22.669322 27230 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:22.696887 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.698124 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:22.701568 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.702349 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:22.692180 29627 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:22.714478 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.716645 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:22.717597 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.718825 27305 raft_consensus.cc:2410] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:22.721601 27297 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:22.724447 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:22.725373 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:22.727545 27839 raft_consensus.cc:2376] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5. Re-sending same reply.
I20260709 13:11:22.730978 27305 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.732939 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:22.734165 27837 raft_consensus.cc:2410] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:22.735183 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:22.737450 27833 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:22.748767 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 86705.9us
I20260709 13:11:22.751278 29627 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:22.751708 29877 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.752545 29877 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.752892 29627 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.755684 29877 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:22.752962 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.768884 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.769532 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.720788 29821 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:22.742496 29842 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:22.723513 29407 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:22.798405 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.799155 27303 raft_consensus.cc:2368] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:22.778899 29627 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:22.772423 29877 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:22.786831 27838 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:22.787139 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:22.825963 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:22.787683 27304 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.787909 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:22.788362 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:22.788846 27837 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.788769 29875 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:22.789639 27300 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:22.790485 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.791553 29821 consensus_queue.cc:1243] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:22.792070 29842 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.796928 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.838012 27306 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.797703 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.830312 27226 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:22.840281 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.841795 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:22.843082 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.843525 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.845122 27299 raft_consensus.cc:2368] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3.
I20260709 13:11:22.834934 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:22.845878 27838 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:22.837548 27836 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.848872 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.850111 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.850785 27303 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.851480 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.852492 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.853474 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.854347 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.854756 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:22.855688 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.855984 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.856685 27300 raft_consensus.cc:2410] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:22.825153 29877 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.861578 27837 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:22.863744 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.834615 27835 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:22.864714 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.860147 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.867906 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.868645 27305 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.866089 27306 raft_consensus.cc:2376] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4. Re-sending same reply.
I20260709 13:11:22.876348 27836 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:22.879145 29842 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:22.888083 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.889418 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.887486 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.890937 27306 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:22.893589 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.893811 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.894613 27306 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:22.864766 29877 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.909420 27299 raft_consensus.cc:2410] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:22.910540 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.887831 27297 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:22.925004 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.937551 27151 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.937136 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:22.932785 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 145716us
I20260709 13:11:22.917212 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.941741 27304 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:22.914536 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.942349 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.943817 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.944645 27303 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:11:22.952498 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 97874.3us
I20260709 13:11:22.953101 29884 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.964242 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.964156 29884 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:22.964953 27303 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:22.965451 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:22.953631 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.965899 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.966152 27841 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:22.966651 27303 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:22.954232 29736 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.954452 29883 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:11:22.982342 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:22.955610 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.983940 27304 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.956583 27300 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:22.956902 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:22.958968 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.985718 27229 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:22.963634 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.967993 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:22.970580 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.976646 27306 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:22.961354 29538 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:22.988312 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:22.988525 27148 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:22.989293 27302 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 6. Ops: [4.6-4.6]
I20260709 13:11:22.990265 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:22.991559 27303 raft_consensus.cc:2376] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5. Re-sending same reply.
W20260709 13:11:22.992029 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 49748.9us
I20260709 13:11:22.994333 27271 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:22.918768 29886 raft_consensus.cc:2764] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:22.996280 27300 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:23.006485 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.002733 29407 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:23.007943 29407 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.967326 29568 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:23.008708 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.004897 27269 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:23.014853 29407 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.995761 29885 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.945329 29627 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:11:22.981765 29677 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:11:23.019107 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.066555 27300 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:22.992267 29736 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:11:23.069947 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65591.3us
I20260709 13:11:23.075048 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:23.050181 29347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.028s	sys 0.057s
I20260709 13:11:23.017783 29735 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:23.062721 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:23.017630 29678 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:23.019409 29889 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.040906 29884 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.017239 29840 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:11:23.088433 27232 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:23.088191 27300 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:23.077682 29347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.028s	sys 0.057s
W20260709 13:11:23.084070 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75444.2us
I20260709 13:11:23.087857 27226 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:23.092617 27227 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:23.093067 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88242.5us
I20260709 13:11:23.096517 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:23.093394 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 122879us
I20260709 13:11:23.099797 27300 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:23.100131 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:23.080705 29885 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.104794 27223 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.105234 27223 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:23.108397 27300 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:23.109772 27230 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:11:23.110198 27230 pending_rounds.cc:85] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 6
I20260709 13:11:23.088176 29677 consensus_queue.cc:1243] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:23.095075 29865 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.111295 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.083855 29887 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:23.088274 29815 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.110044 27837 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:23.088030 29819 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.106448 29678 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:23.116140 29821 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:23.076496 29568 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.019606 29527 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:11:23.014963 29493 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:11:23.116163 27838 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:23.120404 29736 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:23.125694 27297 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:11:23.126433 29882 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:11:23.127767 27154 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.103168 29884 raft_consensus.cc:2764] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:23.110653 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.155743 27154 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:23.119771 27230 pending_rounds.cc:107] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:23.158443 27230 raft_consensus.cc:2889] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.141566 27223 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.094935 29831 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:11:23.145663 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.159700 27223 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:23.117621 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.151393 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:23.132187 29865 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.157835 27841 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:23.107414 29885 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.144680 29677 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:23.156379 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56592.6us
W20260709 13:11:23.170212 27178 debug-util.cc:398] Leaking SignalData structure 0x7b0800367ee0 after lost signal to thread 26041
W20260709 13:11:23.171893 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080026bac0 after lost signal to thread 27089
I20260709 13:11:23.172025 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.130626 29898 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:23.188293 27223 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:23.195714 27223 pending_rounds.cc:85] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
I20260709 13:11:23.196100 27223 pending_rounds.cc:107] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:23.196436 27223 raft_consensus.cc:2889] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:23.198153 27178 debug-util.cc:398] Leaking SignalData structure 0x7b0800246f40 after lost signal to thread 27181
I20260709 13:11:23.156225 29887 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:23.164150 27835 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:23.155743 29896 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.173830 27154 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.212860 27304 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:23.154186 29347 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:11:23.200225 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:23.215831 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:23.148699 29815 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:23.168015 29735 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:23.219605 29700 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.195906 27836 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.176072 29865 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.217808 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:23.228921 29568 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.258880 27154 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:23.230131 29897 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.223794 29832 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.230755 29678 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.231774 29680 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:23.235045 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2597) took 6125 ms. Trace:
I20260709 13:11:23.237257 27297 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:23.238471 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:23.239598 27804 leader_election.cc:400] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:23.271432 27804 leader_election.cc:403] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.243038 29887 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.245344 29886 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:23.175931 29885 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.248574 29407 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.249001 29831 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:23.249292 29863 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.639s	user 0.001s	sys 0.002s
I20260709 13:11:23.214520 29884 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.251073 27229 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:23.265313 27833 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:23.266155 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66036.2us
I20260709 13:11:23.268666 27157 rpcz_store.cc:276] 0709 13:11:17.109553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.241860 (+132307us) service_pool.cc:224] Handling call
0709 13:11:17.242255 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.779584 (+537329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.779637 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.780234 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.801938 (+ 21704us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:17.801995 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.234437 (+5432442us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:23.234516 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.234575 (+    59us) raft_consensus.cc:1685] finished
0709 13:11:23.234586 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.234859 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9807,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18281,"spinlock_wait_cycles":172127104,"thread_start_us":483308,"threads_started":2,"wal-append.queue_time_us":94360,"wal-append.run_cpu_time_us":2433,"wal-append.run_wall_time_us":1359596}
I20260709 13:11:23.272051 29680 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:23.291013 27226 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:11:23.305815 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 88057.4us
I20260709 13:11:23.291160 27154 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:23.296298 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56863.9us
I20260709 13:11:23.267262 29819 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:23.290397 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 90645.2us
I20260709 13:11:23.261059 29700 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.292500 27055 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
W20260709 13:11:23.302538 27123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.636s (SENT) [suppressed 56 similar messages]
I20260709 13:11:23.312541 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.290311 29886 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:23.311892 29826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.684s	user 0.015s	sys 0.030s
W20260709 13:11:23.316686 29826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.692s	user 0.015s	sys 0.031s
I20260709 13:11:23.317581 27055 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:11:23.318470 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:23.312479 29859 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:11:23.268057 29897 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.326668 29884 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.328958 29700 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.329891 29680 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.331082 29680 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:23.323048 29568 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:11:23.339672 29886 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.341145 29886 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.325093 29735 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.323180 29834 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:23.347246 29832 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.347537 29834 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.351302 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:23.354350 29819 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:23.356055 29831 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:23.356846 29845 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:23.354663 27833 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:11:23.364555 27226 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:23.356379 29819 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:23.380383 29407 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:23.370940 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.371698 29903 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.372849 29891 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:23.373451 29907 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:23.387161 29907 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:23.387596 29906 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:23.388234 29907 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.389678 29907 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.360133 29568 consensus_queue.cc:1243] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:23.375066 29815 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.372900 27832 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:23.320472 29347 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:23.391474 29347 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:23.376999 29889 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.393471 27305 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:11:23.342289 27055 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:23.393659 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75257.6us
I20260709 13:11:23.390627 29832 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:23.394402 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81939.2us
I20260709 13:11:23.393865 27305 pending_rounds.cc:85] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 1
I20260709 13:11:23.392472 29347 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.406682 27305 pending_rounds.cc:107] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:23.408938 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.409001 27305 raft_consensus.cc:2889] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.412469 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:23.414299 29896 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.407094 29819 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:23.435868 29819 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:23.440347 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 137838us
W20260709 13:11:23.441341 27123 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.660s (SENT)
I20260709 13:11:23.441794 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:23.460212 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47808.6us
W20260709 13:11:23.461467 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.468052 29902 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:23.471037 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.475095 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:23.472373 29815 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.472501 29911 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:23.472625 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:23.457108 29842 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:23.482740 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.493165 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:23.495592 27299 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:23.496887 29881 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:23.500764 29877 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 13:11:23.501232 29877 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.501936 27836 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:23.502162 29842 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.504563 29842 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.505300 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:23.505923 27305 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.416257 29891 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:11:23.511274 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.512663 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.513726 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.497709 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:23.524060 27305 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:23.490413 27055 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 2 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.535185 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:23.482205 29902 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:23.536648 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 53190.2us
I20260709 13:11:23.537644 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:23.538337 27303 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:23.488808 29889 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:23.540928 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.542316 29875 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.549443 27055 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:23.485944 29896 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:23.554371 27055 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 3, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.496330 29347 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:11:23.567233 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:23.598351 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 63249.1us
I20260709 13:11:23.555115 29900 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.555418 29735 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.558962 29700 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.556080 29815 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.610283 27055 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:23.492983 29911 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:23.612883 29407 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:23.564260 29831 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.558586 29891 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.561769 29889 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:23.565243 29897 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:23.630532 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63425.4us
I20260709 13:11:23.634032 27300 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:23.635705 27055 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 3 to 5, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 5 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.641016 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:23.643684 27055 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 2, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:23.651363 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:23.648571 29730 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.569s	user 0.006s	sys 0.015s
I20260709 13:11:23.622799 29735 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.653987 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:23.657097 27151 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:23.643497 29407 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:23.658743 27301 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:23.652907 29700 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.662710 29700 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:23.663203 29700 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.616892 29900 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.643779 29831 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.659901 29347 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.674525 29407 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.674360 29889 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.691854 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:23.660780 29819 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.681499 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080038e9e0 after lost signal to thread 27256
I20260709 13:11:23.683282 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.684481 29845 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:23.684917 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:23.686542 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.695941 27839 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:23.684506 27835 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:11:23.688310 29538 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:23.716845 27151 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:23.717365 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.718037 27839 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:23.693102 29877 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.700503 29831 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.702390 29911 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.638949 29902 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.704015 29735 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.710816 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2033) took 1018 ms. Trace:
I20260709 13:11:23.720929 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:23.727530 27301 rpcz_store.cc:276] 0709 13:11:22.692273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.692419 (+   146us) service_pool.cc:224] Handling call
0709 13:11:23.710631 (+1018212us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003aa054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:23.710745 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210018560}
W20260709 13:11:23.712002 27178 debug-util.cc:398] Leaking SignalData structure 0x7b08003c99a0 after lost signal to thread 27330
I20260709 13:11:23.729367 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:23.730042 27833 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.722162 29347 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.716461 29845 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:23.721918 29538 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:23.725948 29826 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:11:23.738139 29815 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:23.766835 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:23.767570 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:23.768426 29680 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.735900 29902 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.732262 29875 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.769062 29680 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.736434 29881 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:23.779017 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.780934 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.730013 29715 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:23.723160 29819 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.762723 29347 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.733667 29885 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.761257 29886 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:11:23.823004 29865 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.006s
I20260709 13:11:23.823585 29865 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:23.793092 29347 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.778703 29834 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:23.832113 29834 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:23.833847 29680 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.836419 29885 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:23.837788 27832 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:23.839843 27833 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:23.840306 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 117543us
W20260709 13:11:23.845506 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.852622 27839 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:23.863839 27301 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:23.870692 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:23.871445 27301 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:23.872712 27301 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:23.873337 29924 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:23.781967 29875 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:23.904925 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.929456 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.971439 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.979607 27157 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:23.880657 29865 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:23.806366 29538 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:24.011987 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.915457 29881 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:23.878417 27297 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:23.875329 29821 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.042661 27301 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:23.988713 29834 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.048699 29900 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:24.044906 29700 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.045291 29821 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:24.076794 29928 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:24.079305 29744 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:24.080746 29881 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:24.109172 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.113540 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 113005us
I20260709 13:11:24.049213 29834 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.111284 29835 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:24.120255 29865 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.140071 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 263101us
I20260709 13:11:24.133548 29835 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:24.152964 27229 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:24.156303 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 463885us
I20260709 13:11:24.157734 27301 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:24.159471 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.160013 27226 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:24.159533 29835 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.160827 29835 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.163074 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.164590 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.164855 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.165201 27230 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.165490 27223 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.171257 29899 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:24.142153 29865 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.171759 29899 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:24.172766 29899 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:24.173907 29899 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.175074 29834 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.163000 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.180135 27230 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:24.196376 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.197158 27230 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:24.199172 29821 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.204247 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.205171 27301 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:24.209834 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.214076 27833 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:24.218008 27223 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:24.220260 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.222311 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.221715 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.223059 27230 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:24.219679 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.226286 27232 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:24.228344 27231 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:24.234704 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:24.237381 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.189759 29347 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.241209 27232 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:24.238368 29897 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:24.239614 29948 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.246856 29948 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.249693 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.250656 27232 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 2.
I20260709 13:11:24.254123 29948 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:23.736101 29909 consensus_queue.cc:1175] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4afe81810944d70bc2cc31754392f3d" responder_term: 5 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:24.259006 29347 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.242923 29897 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.261922 27231 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:11:24.265902 29894 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.118s	user 0.004s	sys 0.000s
I20260709 13:11:24.267086 27230 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:11:24.268380 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 853) took 1543 ms. Trace:
I20260709 13:11:24.268810 27834 rpcz_store.cc:276] 0709 13:11:22.724889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.725005 (+   116us) service_pool.cc:224] Handling call
0709 13:11:22.736038 (+ 11033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.945643 (+209605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.945677 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.963279 (+ 17602us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.085676 (+122397us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:23.085727 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.085799 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.265286 (+1179487us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:24.268075 (+  2789us) raft_consensus.cc:1685] finished
0709 13:11:24.268099 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.268314 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20423,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":9519488,"thread_start_us":327936,"threads_started":2,"wal-append.queue_time_us":139280}
I20260709 13:11:24.271548 29415 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.272142 29415 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.276504 27230 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:24.276566 29897 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:24.279022 27230 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:24.279968 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.281395 27228 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:24.277897 29415 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.238500 29859 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:11:24.296593 27232 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:24.410234 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.417968 27224 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:24.315014 27223 raft_consensus.cc:1217] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-5.4]   Dedup: 4.3->[5.4-5.4]
I20260709 13:11:24.423182 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.423497 27223 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:11:24.424408 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.424999 27232 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:24.425804 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:24.298292 27807 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.647s (SENT)
I20260709 13:11:24.427294 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:24.407083 29700 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.440189 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.441718 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.442481 27224 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:24.443377 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.444505 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.444746 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1688) took 1047 ms. Trace:
I20260709 13:11:24.445188 27303 rpcz_store.cc:276] 0709 13:11:23.397478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.545621 (+148143us) service_pool.cc:224] Handling call
0709 13:11:23.557309 (+ 11688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.201314 (+644005us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b18003c3dc0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d2fbfb 00007f9a51d3a64b
0709 13:11:24.201515 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.201549 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.202215 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.369895 (+167680us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:24.369968 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.370047 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.444412 (+ 74365us) raft_consensus.cc:1685] finished
0709 13:11:24.444443 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.444680 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3976,"raft.queue_time_us":72020,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7555,"spinlock_wait_cycles":18361216,"thread_start_us":247017,"threads_started":2,"wal-append.queue_time_us":240212}
I20260709 13:11:24.416702 29945 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:24.450258 29945 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:24.450433 29835 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:24.451344 29945 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.452208 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.453766 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.455358 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.458673 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.459764 27224 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.470355 27224 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:24.471650 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.473016 27224 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:24.474045 27178 debug-util.cc:398] Leaking SignalData structure 0x7b08003935e0 after lost signal to thread 27865
W20260709 13:11:24.474483 27178 debug-util.cc:398] Leaking SignalData structure 0x7b080031fa60 after lost signal to thread 27866
I20260709 13:11:24.474162 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.475428 27224 raft_consensus.cc:2376] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3. Re-sending same reply.
I20260709 13:11:24.476713 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.478468 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.479287 27224 raft_consensus.cc:2376] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4. Re-sending same reply.
I20260709 13:11:24.480425 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.481194 27224 raft_consensus.cc:2376] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4. Re-sending same reply.
I20260709 13:11:24.483036 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.497987 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:24.499121 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.484808 29493 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:24.499645 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 332314us
I20260709 13:11:24.500236 29493 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:24.500578 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.501536 27224 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:24.489683 27148 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:24.502506 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.503036 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:24.485594 29819 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:24.490180 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2608) took 1120 ms. Trace:
I20260709 13:11:24.503880 27229 rpcz_store.cc:276] 0709 13:11:23.369949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.370083 (+   134us) service_pool.cc:224] Handling call
0709 13:11:23.375246 (+  5163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.153528 (+778282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.489893 (+336365us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540037b754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:24.490119 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787959040}
I20260709 13:11:24.505275 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:24.491983 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:24.507771 27229 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:24.508234 29819 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:24.509277 27229 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:24.512507 27123 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.827s (SENT)
I20260709 13:11:24.512753 29407 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:24.513155 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:24.513548 29407 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:24.514014 27224 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:24.516281 29407 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:24.516907 29407 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.517094 29415 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:24.518328 29415 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:24.518688 29415 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:24.518986 29903 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:24.519770 29415 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.524313 29415 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.524741 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.509152 29819 consensus_queue.cc:1243] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:24.496490 29888 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:24.533000 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.536213 27224 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:24.537768 27224 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:24.538952 27224 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:24.540194 27224 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:24.490031 27155 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.501379 29493 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:24.522746 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 865) took 1044 ms. Trace:
W20260709 13:11:24.493665 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 195427us
I20260709 13:11:24.543977 27832 rpcz_store.cc:276] 0709 13:11:23.478665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.479110 (+   445us) service_pool.cc:224] Handling call
0709 13:11:23.495178 (+ 16068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.838303 (+343125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.522436 (+684133us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54004bc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:24.522654 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787246336}
I20260709 13:11:24.492611 29845 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:24.501619 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.550329 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.551008 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.551435 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:24.552619 27833 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:24.548134 27197 connection.cc:256] RPC call timeout handler was delayed by -2.4258268659998521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 13:11:24.554478 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:24.556380 27306 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:24.556737 27306 pending_rounds.cc:85] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 3
I20260709 13:11:24.557003 27306 pending_rounds.cc:107] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:24.557312 27306 raft_consensus.cc:2889] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.559326 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:24.574265 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.560352 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47895.2us
I20260709 13:11:24.559672 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:24.558986 27197 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.580s (SENT)
I20260709 13:11:24.577978 27834 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:24.561626 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:24.579056 27197 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.603s (SENT)
I20260709 13:11:24.580062 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:24.580961 27834 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.560807 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:24.584697 27306 raft_consensus.cc:2368] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:24.585244 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:24.599382 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.599859 27301 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.600942 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.587658 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:24.602985 27837 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.605669 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.606599 27306 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:24.606743 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.607580 27305 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:24.552407 29493 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.552158 29888 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.599382 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:24.612352 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.618803 27197 connection.cc:256] RPC call timeout handler was delayed by -2.3826268660000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 13:11:24.614216 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:24.613662 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:24.615404 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.619644 27197 leader_election.cc:336] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.746s (SENT)
W20260709 13:11:24.620095 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.620558 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.620230 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:24.605293 29865 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.598408 29693 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.624403 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:24.623109 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:24.627660 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.552763 29847 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:11:24.612111 29845 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:24.629437 27302 raft_consensus.cc:2368] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6.
W20260709 13:11:24.632789 27197 connection.cc:256] RPC call timeout handler was delayed by -2.3475268659999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:11:24.611961 27833 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
W20260709 13:11:24.636204 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.638397 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 589) took 1648 ms. Trace:
I20260709 13:11:24.638880 27302 rpcz_store.cc:276] 0709 13:11:22.989638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.612462 (+1622824us) service_pool.cc:224] Handling call
0709 13:11:24.638327 (+ 25865us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:24.639482 27197 connection.cc:256] RPC call timeout handler was delayed by -2.288287382000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:11:24.639916 27197 connection.cc:256] RPC call timeout handler was delayed by -2.2863268659998539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 13:11:24.640538 27197 connection.cc:256] RPC call timeout handler was delayed by -2.2647268660000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 13:11:24.635367 27833 pending_rounds.cc:85] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 4
W20260709 13:11:24.640849 27197 connection.cc:256] RPC call timeout handler was delayed by -2.2567873820000841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:11:24.640726 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:24.621727 29960 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.642184 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.625182 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:24.643776 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.648264 27839 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.629770 29744 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:24.662540 27839 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:24.641033 27833 pending_rounds.cc:107] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:11:24.650179 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:24.651029 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:24.643849 27197 connection.cc:256] RPC call timeout handler was delayed by -2.2405873820000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:11:24.667307 27197 connection.cc:256] RPC call timeout handler was delayed by -2.2404268660000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
I20260709 13:11:24.670229 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:24.671175 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.678479 27297 raft_consensus.cc:2410] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:24.678977 27157 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:24.679659 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.633263 29693 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.684878 29693 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:24.688900 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:24.689774 27305 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:24.692871 27837 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:24.695231 27833 raft_consensus.cc:2917] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:11:24.698547 27833 raft_consensus.cc:2889] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.701357 27834 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:24.703323 27305 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:24.707748 27305 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:24.626398 29888 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.718972 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:24.722576 27156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2614) took 2115 ms (client timeout 2134 ms). Trace:
W20260709 13:11:24.723029 27156 rpcz_store.cc:269] 0709 13:11:22.607366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.718677 (+2111311us) service_pool.cc:224] Handling call
0709 13:11:24.722491 (+  3814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:24.720988 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:24.730026 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:24.730509 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60471.3us
I20260709 13:11:24.731158 27302 raft_consensus.cc:2410] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:11:24.830835 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.831554 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.832079 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.841004 27197 connection.cc:256] RPC call timeout handler was delayed by -2.1425432039998213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28550000000000003s for a response
W20260709 13:11:24.841621 27197 connection.cc:256] RPC call timeout handler was delayed by -2.1409039829998164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.5055s for a response
W20260709 13:11:24.842027 27197 connection.cc:256] RPC call timeout handler was delayed by -1.858987382000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:11:24.842419 27197 connection.cc:256] RPC call timeout handler was delayed by -1.8139873820000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 13:11:24.842796 27197 connection.cc:256] RPC call timeout handler was delayed by -1.7681432039998981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3271s for a response
W20260709 13:11:24.854351 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.853896 27197 connection.cc:256] RPC call timeout handler was delayed by -1.1665519589998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:11:24.733698 29909 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:24.649502 29960 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:24.838227 29922 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:11:24.858816 27197 connection.cc:256] RPC call timeout handler was delayed by -1.1665519589998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:11:24.862713 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 142967us
I20260709 13:11:24.838558 29347 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:24.871006 27197 connection.cc:256] RPC call timeout handler was delayed by -1.133587382000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2925s for a response
I20260709 13:11:24.861188 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:24.859957 29821 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:24.716498 29693 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
W20260709 13:11:24.873672 27197 connection.cc:256] RPC call timeout handler was delayed by -1.0909519589997672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:11:24.856673 29744 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.882397 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:24.884311 27156 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:24.861155 29909 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:24.888741 27806 leader_election.cc:336] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.286s (SENT)
I20260709 13:11:24.893944 27156 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:24.894101 27229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:24.894802 27229 raft_consensus.cc:606] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:24.892685 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:24.900063 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:24.875216 29821 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:24.895183 27229 raft_consensus.cc:614] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:24.863400 29859 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:11:24.934717 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 201953us
I20260709 13:11:24.892292 29909 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:24.978541 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:24.910835 29415 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:24.932464 29847 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:25.001958 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1672) took 2052 ms. Trace:
W20260709 13:11:24.988133 29965 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:11:24.994741 29974 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:11:24.889722 29744 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:24.995018 27835 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:24.995253 29969 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:24.996061 27303 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:25.002595 27299 rpcz_store.cc:276] 0709 13:11:22.949830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.236188 (+286358us) service_pool.cc:224] Handling call
0709 13:11:23.236507 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.528390 (+291883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.001605 (+1473215us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540031c9d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:25.001870 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595357056}
W20260709 13:11:25.015013 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 79083.8us
W20260709 13:11:24.996140 29966 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:11:25.004073 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 267699us
I20260709 13:11:25.032725 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.004019 29875 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:25.040822 29875 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.041024 29972 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:25.039103 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:25.051772 29989 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:25.053328 29988 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:25.053779 29988 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:25.054153 29988 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:25.024113 29415 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.059814 29888 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:25.060007 29986 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:25.022966 29887 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:25.071672 27153 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:25.074378 27156 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:25.084424 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.076244 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:25.077427 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 591) took 1593 ms. Trace:
I20260709 13:11:25.089423 27300 rpcz_store.cc:276] 0709 13:11:23.483601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.651892 (+168291us) service_pool.cc:224] Handling call
0709 13:11:23.652232 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.706523 (+ 54291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.706557 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.707126 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.786395 (+ 79269us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:23.786460 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.077010 (+1290550us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b540005d2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:25.077061 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.077112 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:25.077125 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.077359 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500,"raft.queue_time_us":9451,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6567,"spinlock_wait_cycles":123798400,"thread_start_us":78747,"threads_started":1,"wal-append.queue_time_us":82723,"wal-append.run_cpu_time_us":2135,"wal-append.run_wall_time_us":1040988}
W20260709 13:11:25.117509 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.123175 29960 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:25.124341 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.125418 27151 raft_consensus.cc:2368] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7.
I20260709 13:11:25.095839 29902 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:25.031433 29821 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.069466 29875 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.132814 27151 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:25.135325 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 187294us
W20260709 13:11:25.147671 29985 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:25.144119 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:25.131943 29902 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:25.164049 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.135430 29700 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:25.169651 29700 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:25.170931 29700 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.108440 29887 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.171955 29813 raft_consensus.cc:1064] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:25.165416 27157 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:25.175491 29887 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:25.175706 27155 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:25.176746 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.176898 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.178177 29700 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:25.180617 29493 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.005s
I20260709 13:11:25.181861 29744 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.183727 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.185410 27149 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:25.186710 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.187844 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.184566 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:25.191624 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.188596 27148 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:25.142580 29910 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:25.195950 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:25.195633 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 208025us
W20260709 13:11:25.200613 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 154530us
I20260709 13:11:25.203840 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:25.204504 27837 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:25.204865 27833 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:25.205106 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:25.205508 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:25.205777 27834 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:25.136909 29989 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:11:25.207154 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.209565 27153 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
W20260709 13:11:25.201474 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.212059 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.212972 27152 raft_consensus.cc:2368] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7.
I20260709 13:11:25.214620 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:25.215457 27838 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:25.217872 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.197011 29415 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.168815 29991 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:25.214666 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:25.223480 29845 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.237401 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.240201 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.240880 29859 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:25.243494 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:25.244006 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.244359 27152 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
W20260709 13:11:25.244758 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.248099 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 216285us
I20260709 13:11:25.250304 27151 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:25.206211 29910 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.254712 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.245384 29347 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:25.247186 29677 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:25.266614 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.237464 29991 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:25.234267 29845 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:25.293474 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.325876 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.348649 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.353474 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:25.252660 29859 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:25.357210 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.233912 29902 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.270324 27835 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:25.246651 29909 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.257170 29995 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.249954 29923 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:11:25.282591 29887 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.250130 29737 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:11:25.367252 29859 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.453570 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.454568 27151 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:25.400367 29997 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:25.464670 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 207913us
I20260709 13:11:25.368088 29840 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
W20260709 13:11:25.481032 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 270120us
I20260709 13:11:25.486964 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:25.487986 27151 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:25.466629 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:25.490971 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 299399us
I20260709 13:11:25.460258 29902 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:25.491580 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 237792us
I20260709 13:11:25.493819 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.452414 29859 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:25.489347 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:25.455544 29887 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.475384 29995 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:25.499286 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 252526us
I20260709 13:11:25.465951 29875 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:25.507874 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:25.464413 29997 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.509893 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.518328 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:25.502766 29992 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:11:25.502987 29990 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
I20260709 13:11:25.528599 29845 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.528823 29994 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:11:25.529773 29997 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.529891 29835 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:25.530421 29835 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:25.531347 29835 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:25.531769 27150 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:25.532636 29835 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:25.536255 29934 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:25.536700 29934 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:25.474859 29988 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:25.515980 29677 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:25.548388 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:25.493147 29347 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:25.569271 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 102734us
I20260709 13:11:25.544900 29815 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.502760 30001 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:11:25.570382 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:25.571995 27150 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:25.554679 29845 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:25.537583 29934 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:25.601835 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 567) took 4166 ms (client timeout 1569 ms). Trace:
W20260709 13:11:25.602578 27298 rpcz_store.cc:269] 0709 13:11:21.435742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.460268 (+ 24526us) service_pool.cc:224] Handling call
0709 13:11:25.601556 (+4141288us) spinlock_profiling.cc:243] Waited 3.1 s on lock 0x7b540002c6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:25.601719 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7122483328}
I20260709 13:11:25.593168 29538 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:25.599165 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:25.564303 29677 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:25.498275 29991 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.623710 27227 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:25.546284 29986 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:11:25.624358 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2619) took 1207 ms. Trace:
I20260709 13:11:25.507081 29813 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.620601 29934 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:25.583554 29999 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.210s
I20260709 13:11:25.617357 29840 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:25.625905 29909 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.626400 30003 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:25.628748 29715 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:25.629228 29998 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:25.634348 30016 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:25.521396 29995 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.638378 27227 rpcz_store.cc:276] 0709 13:11:24.416918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.420943 (+  4025us) service_pool.cc:224] Handling call
0709 13:11:25.598945 (+1178002us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:25.624290 (+ 25345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17949440}
I20260709 13:11:25.601873 29910 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.651551 29859 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:25.700879 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63189.6us
I20260709 13:11:25.704243 30003 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.643133 29923 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:25.700001 29875 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.715041 29897 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:25.724861 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.723850 29998 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:25.727703 30000 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:11:25.727571 29998 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.708264 30016 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.729090 30016 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:25.718410 30003 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:25.731025 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 233852us
I20260709 13:11:25.735826 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:25.729840 29998 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.706702 29840 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:25.706269 30005 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.179s
I20260709 13:11:25.734422 29887 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:25.721035 29923 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:25.779150 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:25.790234 30010 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:25.792150 29840 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:25.777407 30013 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:25.794447 29988 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:25.799259 29859 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:25.806624 30010 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.724217 29897 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.726615 29875 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.820828 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:25.822330 27227 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:25.831797 29897 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:25.738477 29677 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:25.839928 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.840704 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.848353 29700 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.002s
I20260709 13:11:25.863492 30005 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:25.878189 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 263895us
W20260709 13:11:25.882844 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 103797us
I20260709 13:11:25.888212 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:25.878002 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 193258us
I20260709 13:11:25.872195 29744 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:25.913616 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 370840us
W20260709 13:11:25.915122 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.916355 27227 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:11:25.910302 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.919020 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.920008 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:25.931869 30003 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:25.905069 30005 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.882570 29923 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:25.901573 29877 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:25.937837 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.967649 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.937150 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 419111us
I20260709 13:11:25.916896 29899 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.970893 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:25.973829 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.985045 27232 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:25.993798 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:25.963649 30005 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.005604 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 875) took 1399 ms. Trace:
I20260709 13:11:26.007901 27841 rpcz_store.cc:276] 0709 13:11:24.606230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.971639 (+1365409us) service_pool.cc:224] Handling call
0709 13:11:26.004775 (+ 33136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.005082 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.005127 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.005194 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:26.005247 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.005340 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.005515 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:26.013288 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1699) took 1489 ms. Trace:
I20260709 13:11:26.013809 27303 rpcz_store.cc:276] 0709 13:11:24.524243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.524395 (+   152us) service_pool.cc:224] Handling call
0709 13:11:26.013090 (+1488695us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54002689d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:26.013220 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082097536}
I20260709 13:11:25.993530 29945 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:26.016816 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 96866.4us
I20260709 13:11:26.002733 30033 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.999274 29923 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:26.003523 29677 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:26.027580 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.986387 29877 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.045197 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 121849us
I20260709 13:11:26.000496 29899 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.029342 29902 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.001s
I20260709 13:11:26.034241 29677 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:26.062443 30034 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:26.063401 30034 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:26.063993 29677 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.065634 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:26.073364 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 77744.8us
I20260709 13:11:26.041947 29875 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:26.057389 30003 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.068109 30035 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:26.049993 29897 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:26.090430 29875 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:26.103858 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.031165 29923 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.174731 27151 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:26.171916 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.067420 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 689) took 2372 ms. Trace:
I20260709 13:11:26.173921 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2610) took 1889 ms. Trace:
I20260709 13:11:26.177421 27228 rpcz_store.cc:276] 0709 13:11:24.285067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.285197 (+   130us) service_pool.cc:224] Handling call
0709 13:11:24.285513 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.286110 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.286154 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.286791 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.720448 (+1433657us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b1800382d20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:25.864560 (+144112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:25.864630 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.864750 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.151862 (+287112us) raft_consensus.cc:1685] finished
0709 13:11:26.151884 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.173837 (+ 21953us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3345,"raft.queue_time_us":134,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":115676,"spinlock_wait_cycles":3440384,"thread_start_us":143762,"threads_started":1,"wal-append.queue_time_us":1661672}
I20260709 13:11:26.030984 30033 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.151881 30035 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:26.155815 29968 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:11:26.202214 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 466432us
I20260709 13:11:26.152261 30009 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:26.171962 29994 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:26.172127 29934 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:26.190971 29493 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:26.174816 29884 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:26.227696 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 657353us
I20260709 13:11:26.199497 29835 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:26.228693 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:26.208101 29988 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:26.202819 30035 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.170280 29897 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.235833 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 166028us
I20260709 13:11:26.207952 30009 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:26.201712 29735 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:11:26.202598 29875 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.232766 29884 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.246657 29884 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:26.226836 29493 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:26.226897 29934 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:26.229030 29835 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:26.238010 30024 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:11:26.253095 30009 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:26.254693 30009 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:26.257100 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.259477 29493 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.262454 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 59430.1us
I20260709 13:11:26.262286 29934 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.263638 29934 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.265440 27840 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
W20260709 13:11:26.269760 29538 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.005s
I20260709 13:11:26.271562 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:26.275481 27305 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.269989 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:26.277217 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:26.182479 27836 rpcz_store.cc:276] 0709 13:11:23.682243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.682404 (+   161us) service_pool.cc:224] Handling call
0709 13:11:23.682828 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.539636 (+856808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.539671 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.540218 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.645430 (+105212us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:24.658186 (+ 12756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.015561 (+1357375us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400510754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:26.017233 (+  1672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.019458 (+  2225us) raft_consensus.cc:1685] finished
0709 13:11:26.024611 (+  5153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.054701 (+ 30090us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6751,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":7702,"spinlock_wait_cycles":1969447168,"thread_start_us":98155,"threads_started":1,"wal-append.queue_time_us":177195,"wal-append.run_cpu_time_us":3459,"wal-append.run_wall_time_us":1409533}
I20260709 13:11:26.277915 27302 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:26.278582 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:26.279219 27304 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:26.276472 27306 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:26.280985 30033 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:26.285431 30038 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:11:26.251910 29835 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.292124 27301 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:26.294142 30029 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.294577 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65988.3us
I20260709 13:11:26.294752 30029 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.295524 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:26.295997 29744 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:26.296451 29744 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.294157 30042 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:26.298709 27297 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:11:26.299103 27297 pending_rounds.cc:85] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 4
I20260709 13:11:26.299379 27297 pending_rounds.cc:107] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:11:26.299544 30017 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:26.299682 27297 raft_consensus.cc:2917] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:11:26.300310 30017 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:26.300920 27301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 600) took 1727 ms (client timeout 1575 ms). Trace:
I20260709 13:11:26.301096 29988 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:26.301338 27301 rpcz_store.cc:269] 0709 13:11:24.566576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.600667 (+ 34091us) service_pool.cc:224] Handling call
0709 13:11:26.293890 (+1693223us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540031bfd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:26.294021 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3887487232}
I20260709 13:11:26.302090 29988 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.300333 27297 raft_consensus.cc:2889] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:26.306161 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2079) took 1749 ms. Trace:
W20260709 13:11:26.306330 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.306602 27297 rpcz_store.cc:276] 0709 13:11:24.556811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.680709 (+123898us) service_pool.cc:224] Handling call
0709 13:11:26.298334 (+1617625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.304514 (+  6180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.305925 (+  1411us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540031bfd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:26.306099 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3719266176}
I20260709 13:11:26.311228 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.311084 29815 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:26.322404 27148 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:26.322337 29815 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.323942 29821 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.324784 29815 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:26.311244 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.314963 29899 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.326962 29899 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.327417 29899 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:26.329416 29899 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.236083 30041 consensus_queue.cc:1059] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:11:26.315982 29923 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.330813 29923 raft_consensus.cc:3055] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:26.331182 29923 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:26.335714 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.316054 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.317879 29897 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.318574 29877 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:26.320058 29875 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.297834 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:26.340025 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:26.301781 30016 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:11:26.364203 27154 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:26.365738 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 67963.4us
I20260709 13:11:26.329921 29899 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.286456 29945 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.361202 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:26.370384 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:26.371925 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:26.381187 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.367554 29744 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.382561 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.383385 29744 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.332103 29923 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.376180 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:26.385380 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.380954 29899 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.401432 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:26.403937 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.379374 27305 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:26.416376 27154 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:26.419782 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49515.6us
I20260709 13:11:26.359829 29996 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.359373 29884 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.438248 27304 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:26.418877 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:26.302186 30042 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.417153 29986 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:26.461179 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:26.435467 29933 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:26.470011 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:26.440549 29815 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:26.393597 30016 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.484966 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 410652us
I20260709 13:11:26.367673 30005 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:26.400246 29945 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.488714 27841 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:26.465454 29909 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:26.460428 29897 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:26.473673 30017 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:26.489905 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.472123 29986 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:26.474895 29900 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:26.498245 27834 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:26.444892 29996 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.484287 29815 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:26.445736 29884 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.484730 30009 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:26.501669 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:26.498412 30004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.015s	sys 0.015s
I20260709 13:11:26.508404 30042 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.494031 29909 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:26.488682 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 62991.1us
I20260709 13:11:26.527376 29884 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:26.527683 30029 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:26.532585 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.536980 29945 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.538687 30005 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.506191 29815 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.556069 29899 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.556628 29909 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.501888 29986 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.523571 30017 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:26.506433 29900 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.564299 27840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 703) took 2012 ms (client timeout 1922 ms). Trace:
I20260709 13:11:26.566447 30016 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.569937 29493 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:26.570245 29835 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.606531 29835 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.582664 27304 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.624365 29995 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.580586 30009 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:26.575846 29889 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:26.600519 27840 rpcz_store.cc:269] 0709 13:11:24.551457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.551612 (+   155us) service_pool.cc:224] Handling call
0709 13:11:26.563993 (+2012381us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54005e15d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:26.564185 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786836736}
I20260709 13:11:26.583671 29997 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:26.609829 30052 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.583997 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.522329 30004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.015s	sys 0.015s
I20260709 13:11:26.635615 29988 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:26.629101 29923 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:26.637908 27150 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.630324 29933 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.638731 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.641675 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.642007 27151 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:26.631944 29889 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:26.643353 29889 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.644686 29889 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:26.645503 29884 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.648247 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.648785 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.648905 27840 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:26.649933 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.650405 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.651145 29886 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:26.651902 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.651727 29886 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.653389 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.646320 29988 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.647099 29933 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.655570 27151 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:26.663076 27149 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:26.656458 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.655485 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:26.657785 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 689029us
I20260709 13:11:26.666414 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.658167 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.693434 27156 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:26.669150 27150 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:26.694270 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:26.694136 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.628214 30035 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.695837 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:26.704829 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.696141 27838 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:26.705263 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.638924 30017 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:26.701943 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.698037 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:26.660192 27123 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.637s (SENT)
W20260709 13:11:26.753134 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 92955.7us
W20260709 13:11:26.725977 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.697531 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.758498 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:26.732609 27839 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:26.733639 27838 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.646014 29884 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.748327 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:26.654000 29886 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:26.780611 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.780632 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.748684 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:26.656257 29988 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.662276 30020 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:26.695647 29875 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.795995 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:26.796718 27839 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:26.782213 27838 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:26.771775 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:26.790701 27807 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.738s (SENT)
I20260709 13:11:26.731542 29934 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:26.798985 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:26.804109 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:26.693130 29945 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:11:26.640223 30052 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.834254 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:26.835150 27832 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:26.837796 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 89196us
I20260709 13:11:26.864233 27832 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
W20260709 13:11:26.868369 27807 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.296s (SENT)
W20260709 13:11:26.824149 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 70443.1us
W20260709 13:11:26.824715 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.873838 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.874279 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.876176 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:26.872320 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.731232 30059 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:11:26.813390 29877 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:26.802845 29934 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:26.780139 29991 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:11:26.834957 29897 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:26.891013 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:26.899468 27228 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:26.800360 29886 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:11:26.795552 30008 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:11:26.896616 27223 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:26.905359 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:26.909819 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 68771.4us
I20260709 13:11:26.814119 29875 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.879012 30004 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:26.939272 30021 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.940162 30021 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.900671 29934 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:26.919127 27231 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:26.909180 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:26.946764 27227 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.888460 29877 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.801137 30009 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.947166 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:26.948225 30004 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:26.961531 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2132) took 1446 ms. Trace:
I20260709 13:11:26.963827 29909 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:26.965689 30071 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:11:27.006328 29993 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:26.934268 29744 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:26.969311 30035 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.969640 29900 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:26.970890 30051 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:26.972270 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 470656us
I20260709 13:11:27.032577 27153 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:27.032714 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.005762 29877 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:26.974956 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 332969us
I20260709 13:11:26.975296 29737 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:26.976665 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 278754us
I20260709 13:11:26.977887 29538 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:26.982553 29996 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:26.983173 30043 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:26.987551 29945 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:26.993044 29815 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:26.997195 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:26.998318 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 89288.1us
W20260709 13:11:26.997912 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.000451 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 53415.5us
I20260709 13:11:27.001552 27152 rpcz_store.cc:276] 0709 13:11:25.515122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.523248 (+  8126us) service_pool.cc:224] Handling call
0709 13:11:25.544574 (+ 21326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.623066 (+ 78492us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:25.625357 (+  2291us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.411781 (+786424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.411872 (+    91us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:26.411957 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.961255 (+549298us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54003a0cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:26.961304 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.961435 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520408,"prepare.queue_time_us":2349,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":548060,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":17406,"spinlock_wait_cycles":179775360,"thread_start_us":331843,"threads_started":1}
I20260709 13:11:27.010178 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:27.063527 27230 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.966679 29884 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:27.013213 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:27.020686 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:27.083461 27224 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:26.996511 29897 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.034495 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:26.973004 30057 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:27.007189 29415 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.019068 29407 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.088896 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.043073 29538 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:27.092794 27148 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:27.101447 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.102384 27150 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:27.103734 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:27.050014 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 218454us
I20260709 13:11:27.021858 29993 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:27.053335 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:26.817139 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:27.035617 29900 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:27.067638 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.112849 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 78424.3us
I20260709 13:11:27.114259 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:27.114413 27837 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.115571 27269 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.115584 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:27.118204 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:27.067484 29886 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:27.127463 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:27.127576 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:27.130329 27269 leader_election.cc:400] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7.
I20260709 13:11:27.131497 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:27.091689 29995 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.089576 30035 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.087198 29415 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:27.090844 29991 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.145107 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.146538 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:27.157651 27230 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:27.102982 29538 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:27.104717 30008 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.123212 29737 consensus_queue.cc:1243] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:27.173851 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:27.195638 27832 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:27.177560 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 46150.7us
I20260709 13:11:27.196964 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.126492 30005 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:27.187333 30045 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.187863 29845 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:27.187597 29991 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:27.177546 30035 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:27.188694 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:27.178011 29900 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:11:27.171362 30016 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:27.172610 29998 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.189551 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:27.189867 29889 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:11:27.190267 30042 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.212324 27300 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:27.133751 29744 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.134382 30051 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.140556 29835 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.140409 29899 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:27.258131 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46239.6us
I20260709 13:11:27.259624 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.271253 27303 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:27.261219 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64377.5us
I20260709 13:11:27.094339 29407 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.170935 29415 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:27.263057 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 74440.1us
I20260709 13:11:27.152859 30041 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:27.213136 30054 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:11:27.135144 30057 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:11:27.229393 29910 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:27.258033 30014 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.280088 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 69069.7us
I20260709 13:11:27.258930 29945 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:27.278271 30075 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 13:11:27.273582 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.263084 29998 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.258903 30016 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:27.270625 27835 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.263672 29845 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:27.110783 30004 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.170709 29995 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.266573 30055 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.270496 30034 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:27.207424 30021 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:27.288610 29493 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.006s
I20260709 13:11:27.270834 30051 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:27.273499 30064 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.274351 29899 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.276607 30041 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.216602 30008 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:27.297216 27123 leader_election.cc:336] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.306s (SENT)
I20260709 13:11:27.297698 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:27.256976 30045 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.290710 29909 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.275686 29744 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:27.312631 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.294559 29998 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.296226 30016 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.268405 27227 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:27.265568 27837 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:27.325168 27232 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:27.328387 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.329517 29933 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.331138 30045 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.294443 29945 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.289426 29910 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:27.316989 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 448639us
I20260709 13:11:27.303141 29875 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:27.341745 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.342794 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:27.305722 30041 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.343250 27300 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:27.345013 27301 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:27.346259 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.298569 29835 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:27.347287 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.356593 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.344058 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.269948 30042 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:27.306203 29899 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.267594 30052 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.305459 30051 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.315824 29677 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:27.319804 30034 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:27.354828 27300 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:27.294304 30014 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.350162 30021 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:27.355938 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.356178 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:27.361092 27807 leader_election.cc:336] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.409s (SENT)
I20260709 13:11:27.349792 30029 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:11:27.381263 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:27.382843 30080 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:27.383157 29995 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.383872 29945 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:27.384146 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.384467 29945 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.387311 29845 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.391007 29991 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:27.366309 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.283950 29993 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.353220 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.374936 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:27.354815 27804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.073s	sys 0.130s
W20260709 13:11:27.401767 27804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.073s	sys 0.130s
I20260709 13:11:27.375020 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:27.403105 27837 raft_consensus.cc:2410] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:27.352653 29815 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.394775 27306 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:27.395537 27197 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.376475 27300 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.408702 27300 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.368402 30042 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.399919 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:27.402190 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 643756us
W20260709 13:11:27.414124 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61009us
W20260709 13:11:27.416036 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.410728 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.410831 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:27.422456 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.422607 27304 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:27.376205 29677 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:27.418462 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.409085 27153 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:27.420075 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.429915 27151 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:27.430176 30035 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:27.430804 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.431908 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.432462 27151 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:27.433183 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:27.434283 30021 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:27.434916 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:27.435025 30021 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.435616 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.437548 30021 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.420075 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.424744 27834 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:27.313872 30064 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.434387 29744 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.445132 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:27.428867 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.439333 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:27.491294 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.371925 29900 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:11:27.442425 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:27.377691 30057 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:11:27.445089 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:27.438000 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:27.451174 30085 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:27.455432 29877 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.419593 29835 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:27.462230 30034 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:27.464973 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:27.518680 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.519855 27153 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:11:27.520861 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:27.521512 27153 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.486388 30014 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.529388 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:27.471045 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.487512 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:27.531262 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43853.9us
I20260709 13:11:27.532353 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.518129 29744 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.441799 29677 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:27.445964 29986 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.841s	user 0.004s	sys 0.009s
I20260709 13:11:27.435566 27833 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:27.483968 27269 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:27.497117 27151 raft_consensus.cc:2376] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5. Re-sending same reply.
I20260709 13:11:27.443159 30021 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:27.505352 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60317.2us
I20260709 13:11:27.511968 27834 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:27.513477 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75551.7us
I20260709 13:11:27.514650 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:27.465896 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.491955 29875 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:27.536135 27300 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:11:27.646471 27300 pending_rounds.cc:85] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 7
I20260709 13:11:27.646775 27300 pending_rounds.cc:107] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:27.647037 27300 raft_consensus.cc:2889] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:27.564575 30086 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:27.571931 29998 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.551147 30014 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:27.573362 29877 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:27.574327 29994 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.576233 30078 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.443s	user 0.003s	sys 0.000s
I20260709 13:11:27.492833 30051 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:27.576892 29899 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.639243 30042 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.551486 30079 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:27.558169 29945 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.526515 29835 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:27.584746 30004 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.491421 30035 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:11:27.626642 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.533787 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.634411 27154 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:27.641886 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 157993us
I20260709 13:11:27.807912 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:27.808568 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 274764us
I20260709 13:11:27.640151 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.647948 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.623518 27835 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:27.709563 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54411.6us
I20260709 13:11:27.715636 27153 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:27.644192 30082 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:27.650940 30055 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.831389 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.712678 29995 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.809620 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.810513 27151 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:27.714758 30014 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:27.817898 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:27.820050 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:27.828099 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:27.831094 27297 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:27.832378 27153 raft_consensus.cc:2410] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:27.842967 27157 raft_consensus.cc:2410] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:11:27.813879 29415 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.004s
I20260709 13:11:27.837301 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:27.847754 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 205797us
I20260709 13:11:27.809507 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.716511 29886 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:11:27.645540 29986 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:27.841104 29945 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:27.924137 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:27.943797 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:27.837096 29923 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.196s	user 0.015s	sys 0.000s
I20260709 13:11:27.807328 29877 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:27.847522 30079 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:27.925530 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.746191 29994 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.840920 29993 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:27.942256 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 132846us
I20260709 13:11:27.962443 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.963810 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:27.938369 30042 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:27.811354 30004 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.766222 30016 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:27.927114 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:27.950737 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:27.966514 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:27.970677 27155 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:27.963481 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1118) took 1295 ms. Trace:
I20260709 13:11:27.974787 27841 rpcz_store.cc:276] 0709 13:11:26.667836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.667976 (+   140us) service_pool.cc:224] Handling call
0709 13:11:26.668513 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.668966 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.668998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.749423 (+ 80425us) log.cc:844] Serialized 572 byte log entry
0709 13:11:26.897673 (+148250us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:26.897710 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.897775 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.575558 (+677783us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:27.963057 (+387499us) raft_consensus.cc:1685] finished
0709 13:11:27.963093 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.963377 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276961152,"thread_start_us":147879,"threads_started":1,"wal-append.queue_time_us":330672}
W20260709 13:11:27.988099 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 63624.5us
I20260709 13:11:28.072533 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:28.073364 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 122715us
I20260709 13:11:27.946425 29991 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.075143 27152 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.946189 29886 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.944384 30055 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:27.977169 29538 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.756s	user 0.011s	sys 0.003s
I20260709 13:11:27.950188 29715 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:27.965160 30079 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:27.925633 29415 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:28.091208 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.970643 30045 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:27.970460 29737 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:27.974097 29845 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.088020 29945 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.075906 29998 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.086931 29875 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.088402 30021 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:27.947992 29835 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.107286 30057 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:28.197681 27227 raft_consensus.cc:2410] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:28.202365 27152 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:28.194701 30057 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:28.212533 30093 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 13:11:28.088516 30081 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.484s
I20260709 13:11:28.119841 30079 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:28.203708 30088 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.178s	user 0.007s	sys 0.004s
W20260709 13:11:28.210440 30101 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260709 13:11:28.144876 30021 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:28.219341 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 141723us
I20260709 13:11:28.144845 30051 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.194901 30030 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:28.221022 30100 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
W20260709 13:11:28.128511 30089 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:11:28.128435 29945 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.234171 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:28.206425 30053 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:28.251561 29415 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.251744 30053 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:28.238602 30021 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:28.252265 29910 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.253153 29407 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.248600 29884 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:28.255412 29884 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:28.256328 29884 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.257330 29884 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:28.260649 30021 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:28.263032 30021 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.109126 29538 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:28.129194 30055 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.241884 27807 leader_election.cc:336] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.515s (SENT)
W20260709 13:11:28.275553 27807 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.575s (SENT)
I20260709 13:11:28.276006 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:28.226682 30104 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:11:28.248528 29934 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.239s	user 0.017s	sys 0.006s
W20260709 13:11:28.249334 30041 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
W20260709 13:11:28.249471 30074 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.237s	user 0.003s	sys 0.000s
I20260709 13:11:28.249676 30057 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.250876 29998 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.224265 29899 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.210620 29886 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:11:28.253952 30053 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.147212 29845 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.254462 30064 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.281450 30042 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.282025 30081 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:28.298660 30107 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:11:28.299463 30103 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:11:28.309974 30004 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:28.312839 27223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.009s	sys 0.006s
W20260709 13:11:28.337666 27223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.009s	sys 0.006s
W20260709 13:11:28.295208 30109 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:11:28.292150 29986 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:28.296211 30105 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
W20260709 13:11:28.309634 27150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.011s	sys 0.055s
W20260709 13:11:28.341718 27150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.011s	sys 0.055s
W20260709 13:11:28.300108 30095 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 13:11:28.293829 30016 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:28.312441 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 208200us
I20260709 13:11:28.284880 30041 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.286353 29934 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:28.314740 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.656s (SENT) [suppressed 43 similar messages]
W20260709 13:11:28.315116 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 81038us
I20260709 13:11:28.304291 29994 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.316402 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1132) took 1142 ms. Trace:
W20260709 13:11:28.355280 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.355152 27838 rpcz_store.cc:276] 0709 13:11:27.173712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.173830 (+   118us) service_pool.cc:224] Handling call
0709 13:11:27.174348 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.174668 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.174704 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.190270 (+ 15566us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.511401 (+321131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:27.511450 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.511537 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.316133 (+804596us) raft_consensus.cc:1685] finished
0709 13:11:28.316161 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.316320 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":320649,"threads_started":1,"wal-append.queue_time_us":424750}
I20260709 13:11:28.333628 30053 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.327135 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.328966 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.330119 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.286580 30055 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:28.281244 30014 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.372473 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:28.346132 30090 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.443s	user 0.000s	sys 0.001s
I20260709 13:11:28.347985 30041 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.352895 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:28.331843 29493 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.264458 29945 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.367538 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.369319 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.340034 30042 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.375332 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.382288 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:28.373620 30096 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:11:28.390764 30064 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.394544 30064 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:28.394981 30064 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.395785 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 658) took 1755 ms. Trace:
I20260709 13:11:28.396178 27154 rpcz_store.cc:276] 0709 13:11:26.640098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.640246 (+   148us) service_pool.cc:224] Handling call
0709 13:11:26.640542 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.807688 (+1167146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.395515 (+587827us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54000681d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:28.395721 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285003008}
I20260709 13:11:28.383662 30004 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.372817 30016 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.388387 29538 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.414098 30004 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:28.430945 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.398687 30030 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.434471 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1133) took 1119 ms. Trace:
I20260709 13:11:28.402016 29934 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.435062 27832 rpcz_store.cc:276] 0709 13:11:27.315190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.315387 (+   197us) service_pool.cc:224] Handling call
0709 13:11:27.326457 (+ 11070us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:27.347286 (+ 20829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.347345 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:27.354122 (+  6777us) log.cc:844] Serialized 52 byte log entry
0709 13:11:27.638945 (+284823us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:27.639000 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.639073 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.434130 (+795057us) raft_consensus.cc:1685] finished
0709 13:11:28.434162 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.434385 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19477,"raft.queue_time_us":13366,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6298,"thread_start_us":226783,"threads_started":1,"wal-append.queue_time_us":429214}
I20260709 13:11:28.439232 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:28.433825 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.440255 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.443487 27197 leader_election.cc:400] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:28.443835 27197 leader_election.cc:403] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:28.388731 29493 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.379355 30053 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:28.454108 27807 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.621s (SENT)
I20260709 13:11:28.452936 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.471627 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:28.443989 29998 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:11:28.472617 29715 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:28.476004 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.476105 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1718) took 1285 ms. Trace:
I20260709 13:11:28.470597 29415 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:28.475368 29991 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.444142 30021 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.477567 27305 rpcz_store.cc:276] 0709 13:11:27.190464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.192496 (+  2032us) service_pool.cc:224] Handling call
0709 13:11:27.192845 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.193250 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.193281 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.262564 (+ 69283us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.640498 (+377934us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:27.640543 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.640616 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.475843 (+835227us) raft_consensus.cc:1685] finished
0709 13:11:28.475881 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.476036 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1892,"raft.queue_time_us":67263,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7835,"thread_start_us":354101,"threads_started":1,"wal-append.queue_time_us":360521}
I20260709 13:11:28.479382 30021 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:28.479816 30021 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.480190 30021 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.477090 30110 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.482384 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.486562 29991 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.494771 30021 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.496552 29991 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:28.496043 30079 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.501859 30113 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:28.502951 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 615) took 1121 ms. Trace:
I20260709 13:11:28.501533 30110 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.430979 30004 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.507352 30042 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.507978 27305 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:28.508448 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:28.514611 30112 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:11:28.509465 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.533540 27300 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:28.451923 29995 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:11:28.534861 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2657) took 1053 ms. Trace:
I20260709 13:11:28.535387 27153 rpcz_store.cc:276] 0709 13:11:27.481053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.848645 (+367592us) service_pool.cc:224] Handling call
0709 13:11:27.935790 (+ 87145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.947852 (+ 12062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.947909 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.948589 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.136067 (+187478us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:28.136100 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.136156 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.534550 (+398394us) raft_consensus.cc:1685] finished
0709 13:11:28.534590 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.534784 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11465,"raft.queue_time_us":16199,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11875,"thread_start_us":111055,"threads_started":1,"wal-append.queue_time_us":304153}
I20260709 13:11:28.512079 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:28.503196 30117 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:28.516127 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.542235 27304 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:28.517382 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.471197 30119 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:28.546595 30119 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.504485 30081 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:28.549765 30021 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:28.550403 29735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:11:28.517383 27303 rpcz_store.cc:276] 0709 13:11:27.381128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.385841 (+  4713us) service_pool.cc:224] Handling call
0709 13:11:27.386321 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.386770 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.386802 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.387330 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.807422 (+420092us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:27.807474 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.807540 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.502695 (+695155us) raft_consensus.cc:1685] finished
0709 13:11:28.502727 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.502885 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2498,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":419655,"threads_started":1,"wal-append.queue_time_us":730758}
I20260709 13:11:28.508963 29538 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:28.552274 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.552040 29538 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:28.523041 30079 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.519889 29934 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.529419 29677 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.884s	user 0.007s	sys 0.006s
I20260709 13:11:28.531524 30053 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.537775 27299 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:28.591183 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:28.553048 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 613) took 1179 ms (client timeout 1515 ms). Trace:
W20260709 13:11:28.564728 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.576779 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:28.592193 27298 rpcz_store.cc:269] 0709 13:11:27.374005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.374161 (+   156us) service_pool.cc:224] Handling call
0709 13:11:28.552105 (+1177944us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:28.552987 (+   882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5968768}
I20260709 13:11:28.593205 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:28.593912 27232 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:28.577515 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.579836 27305 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:28.594801 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.594944 27300 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:28.581928 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.595451 27299 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:28.550401 29910 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:11:28.596310 30053 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:28.596750 30053 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.597113 30053 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.583726 29538 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.598105 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.598308 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:28.598874 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.599655 30055 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:28.592342 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.602116 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.602737 27230 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.602996 27224 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:28.603799 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.604498 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.584426 30004 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.605484 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.606189 27833 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.606444 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.606658 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.607713 27841 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.607852 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.609215 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.610282 29986 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.610737 29986 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.611089 29986 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.613754 27833 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:28.614219 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.614913 27838 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:28.616109 27306 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:28.616185 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.616963 27303 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:28.617111 27837 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 2.
I20260709 13:11:28.618495 27298 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:28.619504 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.620523 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.621871 30079 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.622539 30079 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.623117 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.623941 27224 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6.
I20260709 13:11:28.628211 30118 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.628758 30118 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:28.631424 29997 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:28.632136 29997 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:28.634375 30118 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.588449 29493 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.588850 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.590009 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:28.635105 29677 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.635933 27226 raft_consensus.cc:2376] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4. Re-sending same reply.
I20260709 13:11:28.578210 29889 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:28.591794 27228 raft_consensus.cc:2376] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5. Re-sending same reply.
I20260709 13:11:28.636839 29889 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:28.580089 27302 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:28.637290 29677 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.638520 27302 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:28.580164 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2647) took 1155 ms. Trace:
I20260709 13:11:28.605208 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.639935 27302 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:28.639019 27150 rpcz_store.cc:276] 0709 13:11:27.424621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.438591 (+ 13970us) service_pool.cc:224] Handling call
0709 13:11:27.450951 (+ 12360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.451427 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.451467 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.452002 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.342222 (+890220us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:28.344239 (+  2017us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.371562 (+ 27323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.371655 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.543038 (+171383us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800210160. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:28.555037 (+ 11999us) raft_consensus.cc:1685] finished
0709 13:11:28.579944 (+ 24907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.580099 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81424,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3094,"raft.queue_time_us":25096,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":6678,"spinlock_wait_cycles":12957952,"thread_start_us":916674,"threads_started":2,"wal-append.queue_time_us":922819}
I20260709 13:11:28.604815 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.637914 29889 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.642885 29889 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.643663 29845 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.605772 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.644490 29493 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:28.596346 29875 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:28.644042 30014 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.645871 29875 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:28.646452 30014 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.647017 29875 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.648579 30014 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.642803 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:11:28.648974 29997 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.649726 29897 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:28.650779 30079 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:28.651800 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.654274 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 617) took 1272 ms. Trace:
I20260709 13:11:28.654004 29945 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.656213 30008 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.654289 30118 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:11:28.658461 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.659487 27154 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:28.659974 27298 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:28.705955 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.657249 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.608593 27300 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:28.660697 27157 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.607028 27832 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:28.661959 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.666721 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.668874 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:28.654023 27834 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:28.711320 27306 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:28.712425 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.712854 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.713184 27306 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:28.713491 27300 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.664472 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.679651 27150 raft_consensus.cc:606] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:28.714469 27150 raft_consensus.cc:614] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.663789 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.663661 29993 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.715225 27301 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:28.715296 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:28.715727 27301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 614) took 1338 ms (client timeout 1575 ms). Trace:
I20260709 13:11:28.716111 27306 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:28.716101 27301 rpcz_store.cc:269] 0709 13:11:27.377122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.377321 (+   199us) service_pool.cc:224] Handling call
0709 13:11:28.663631 (+1286310us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:28.715669 (+ 52038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008960}
W20260709 13:11:28.716977 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 48254.4us
I20260709 13:11:28.718412 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.719816 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.720450 27154 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:28.716360 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.723577 27157 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:28.724277 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.725001 27834 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:28.675280 30119 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.701539 29875 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.665831 29934 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.740834 27834 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:28.728566 29884 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.693822 29897 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.694402 30014 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:11:28.749938 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.750234 27153 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.750880 27301 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:28.754789 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.755988 27834 raft_consensus.cc:2410] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:28.756688 30079 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.757232 30079 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.759516 30079 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.734784 29993 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:28.768121 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.772056 27834 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:28.767419 27306 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:28.693305 27297 rpcz_store.cc:276] 0709 13:11:27.381873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.385244 (+  3371us) service_pool.cc:224] Handling call
0709 13:11:27.385627 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.849522 (+463895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.653969 (+804447us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400057dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:28.654209 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969295616}
I20260709 13:11:28.773743 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.776193 27306 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:28.762102 27300 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:28.776824 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:28.777712 27301 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:28.780375 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.781224 27834 raft_consensus.cc:2410] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:28.785821 29897 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:28.788667 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:28.789259 27197 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46400 dropped due to backpressure: service queue is full with 50 items
W20260709 13:11:28.790987 30116 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:28.792590 27297 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:28.794005 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.794654 27840 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.796034 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2142) took 1729 ms. Trace:
I20260709 13:11:28.796581 27297 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:28.798265 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.796439 27155 rpcz_store.cc:276] 0709 13:11:27.067149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.067807 (+   658us) service_pool.cc:224] Handling call
0709 13:11:27.068206 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.974096 (+905890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.795790 (+821694us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400355a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:28.795969 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074956544}
I20260709 13:11:28.799062 29934 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.799979 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.800774 27228 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:28.802134 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.804476 29993 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:28.805437 30075 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.978s	user 0.005s	sys 0.001s
I20260709 13:11:28.807133 27156 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:28.812063 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.815047 27835 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:28.815618 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2653) took 1336 ms. Trace:
I20260709 13:11:28.818632 27152 rpcz_store.cc:276] 0709 13:11:27.479535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.744796 (+265261us) service_pool.cc:224] Handling call
0709 13:11:28.815408 (+1070612us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540037f5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:28.815552 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539209088}
I20260709 13:11:28.819088 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.820385 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:28.821380 30042 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:28.822085 30042 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:28.822717 30126 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:28.822829 30082 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:28.823371 30082 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.823096 30042 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.827924 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.816752 27840 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:28.830821 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.831286 29945 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:28.831609 27224 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:28.833233 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2646) took 1497 ms. Trace:
I20260709 13:11:28.834570 27231 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:28.834780 29986 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.837095 29986 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.818038 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.753413 30064 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.816859 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:28.869644 27225 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:28.779395 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.838778 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.844831 30053 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.846940 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.833592 27227 rpcz_store.cc:276] 0709 13:11:27.336014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.342537 (+  6523us) service_pool.cc:224] Handling call
0709 13:11:28.833040 (+1490503us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54001ba154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:28.833174 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937847552}
I20260709 13:11:28.828783 27303 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:11:28.892076 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45228.1us
I20260709 13:11:28.830789 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.873224 27153 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:28.894578 27840 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:28.894286 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.898099 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:28.900951 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:28.789597 27197 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46400 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 637)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 640)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2659)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 634)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2662)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 617)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 639)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 623)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2653)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1802)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1805)
I20260709 13:11:28.901610 27303 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.903167 29923 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:28.903772 29923 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:28.904748 29923 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:28.908998 30115 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.486s	user 0.002s	sys 0.000s
I20260709 13:11:28.909454 30111 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:28.910023 30111 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:28.900822 30055 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:28.912204 30111 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:28.915532 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2651) took 1333 ms. Trace:
I20260709 13:11:28.893846 27835 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.915967 27223 rpcz_store.cc:276] 0709 13:11:27.582259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.583580 (+  1321us) service_pool.cc:224] Handling call
0709 13:11:27.583921 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.584397 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:27.584425 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.584955 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.338108 (+753153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:28.338154 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.338224 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.908331 (+570107us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:28.912608 (+  4277us) raft_consensus.cc:1685] finished
0709 13:11:28.912631 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.915459 (+  2828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1123,"raft.run_cpu_time_us":2961,"raft.run_wall_time_us":27333,"spinlock_wait_cycles":20328704,"thread_start_us":752725,"threads_started":1,"wal-append.queue_time_us":787553}
I20260709 13:11:28.895824 30041 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.923076 27148 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:28.920140 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.925489 27832 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.917641 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:28.933104 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.936672 30055 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:28.938506 30055 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.938938 30055 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:28.948227 30121 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:11:28.949368 27301 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:28.953400 27837 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:28.954797 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:28.955575 27223 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:11:28.958670 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 164225us
I20260709 13:11:28.962087 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.962954 27152 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:28.963020 30056 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.799s	user 0.001s	sys 0.003s
I20260709 13:11:28.932525 27297 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:28.966104 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.966759 27834 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:28.967736 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.968518 27834 raft_consensus.cc:2410] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:28.969240 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.970319 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:28.970597 27156 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:28.971738 27123 leader_election.cc:336] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.051s (SENT)
I20260709 13:11:28.972177 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:28.972756 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:28.975555 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.976935 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.977160 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:28.978955 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 674) took 1561 ms. Trace:
W20260709 13:11:28.978392 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.981838 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.982685 27154 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:28.983649 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:28.984267 27840 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:28.985005 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:28.985546 27155 raft_consensus.cc:2410] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:28.988916 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:28.979319 27149 rpcz_store.cc:276] 0709 13:11:27.417643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.417802 (+   159us) service_pool.cc:224] Handling call
0709 13:11:27.418187 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.425419 (+  7232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:28.346087 (+920668us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800434440. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:11:28.375481 (+ 29394us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.536096 (+160615us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.578781 (+ 42685us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.578943 (+   162us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:28.578979 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.579051 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.947608 (+368557us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:28.978761 (+ 31153us) raft_consensus.cc:1685] finished
0709 13:11:28.978785 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.978900 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56862,"prepare.queue_time_us":144592,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":15414,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":13080,"spinlock_wait_cycles":10467072,"thread_start_us":138776,"threads_started":2,"wal-append.queue_time_us":309320}
I20260709 13:11:28.994339 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:29.005944 27303 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:29.008850 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:28.995620 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 336098us
I20260709 13:11:29.003964 27839 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:28.997897 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:28.998018 27832 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:29.014855 27840 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:28.996528 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:29.015977 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:29.015995 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.018451 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:29.018944 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:29.019112 27832 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Advancing to term 6
I20260709 13:11:29.019071 27150 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.018231 27840 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:11:29.021021 27840 pending_rounds.cc:85] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 4
I20260709 13:11:29.021291 27840 pending_rounds.cc:107] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:11:29.022579 27841 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:29.023245 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.021517 27840 raft_consensus.cc:2889] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.026700 27834 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:29.028262 27225 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:29.029481 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:29.029436 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 76714.5us
W20260709 13:11:29.033089 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.033823 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.034116 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:29.035483 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:29.038501 27223 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:28.990659 29988 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:28.991019 30054 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.011204 30041 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.041332 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:29.058727 27155 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:29.041901 27123 leader_election.cc:336] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.619s (SENT)
I20260709 13:11:29.059170 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:29.031518 29986 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:29.044628 27807 leader_election.cc:336] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.177s (SENT)
I20260709 13:11:29.046682 30110 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.047415 30029 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:29.047879 29677 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:29.050519 30106 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.924s	user 0.004s	sys 0.000s
I20260709 13:11:29.051067 30064 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:29.040844 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.055056 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:29.055557 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.054294 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:29.056641 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:29.056895 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.057734 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.062294 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:29.062342 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:29.063483 27152 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:29.024737 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:29.028177 29945 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.081967 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.083161 27231 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 2.
I20260709 13:11:29.084719 27832 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:29.078094 27223 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.077874 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:29.098798 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44582.6us
I20260709 13:11:29.098961 27225 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:29.022033 30081 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:11:29.099900 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:29.054641 30042 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:11:29.063977 30054 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.102258 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60976us
I20260709 13:11:29.077294 30029 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:29.077827 30041 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:29.082698 29988 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:29.053406 29934 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:11:29.053686 30059 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:11:29.082263 29886 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.062870 30021 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:11:29.106362 30017 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:29.081841 30079 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.084616 29945 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.114825 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.123409 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:29.126976 30118 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.113678 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.126768 30029 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:29.112725 27223 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:29.151271 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.112195 27149 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:29.135612 30081 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.136770 30041 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.142671 27123 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.811s (SENT)
I20260709 13:11:29.086998 29995 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:11:29.114552 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.153563 27228 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:29.156700 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.157526 27225 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:29.141485 29875 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.158234 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.160586 27223 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:29.161473 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.162006 27223 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.164559 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.131131 30054 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:29.145004 30017 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:29.153406 30118 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:29.152729 29945 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.164052 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:29.170142 27807 leader_election.cc:336] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.702s (SENT)
I20260709 13:11:29.152454 29886 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:29.154562 30081 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:29.165665 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.178610 27223 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:29.183152 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.185178 27231 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:29.184610 27225 raft_consensus.cc:2410] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:29.189047 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.172514 29995 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:29.192488 29995 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:29.176189 30118 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.172655 30129 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:29.199617 30129 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:29.200723 30129 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:29.187490 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.189858 27225 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:29.172582 30119 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.191648 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.203513 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.209910 27225 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:29.177454 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:29.162577 30053 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:29.203513 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.175380 30017 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.177454 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.173462 29875 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:29.237629 27123 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.739s (SENT)
I20260709 13:11:29.237836 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.240190 27225 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:29.238871 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:29.225564 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.235050 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 57714.1us
I20260709 13:11:29.221324 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:29.228039 27223 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:29.241278 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 96515.4us
I20260709 13:11:29.242249 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.243296 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.245646 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:29.193397 29995 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.246295 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.246464 27300 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:29.243299 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 97081.4us
I20260709 13:11:29.243949 27223 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:29.248431 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.172062 30146 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:29.256968 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:29.248560 27300 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:29.257593 27301 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:29.257673 27299 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:29.244793 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 92973.4us
I20260709 13:11:29.251474 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.259634 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:29.261054 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.261423 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:29.261622 27223 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:29.227759 30129 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.183512 29997 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:11:29.262178 27301 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.277200 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:29.248751 30143 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.050s	user 0.000s	sys 0.002s
I20260709 13:11:29.264978 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.246716 29493 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:29.266556 30144 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:29.267027 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.281342 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.281816 27223 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:29.269523 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.262390 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:29.283427 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:29.280939 27225 raft_consensus.cc:2410] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:29.285274 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.254462 30079 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:29.254199 30128 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.175734 30082 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.282759 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.246448 30119 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:29.290266 27223 raft_consensus.cc:2368] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
W20260709 13:11:29.291013 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 213234us
I20260709 13:11:29.291775 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.291982 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:29.292570 27223 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:29.243896 29897 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:11:29.303494 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.247042 29884 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:11:29.304256 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.325248 27223 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.308856 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:29.277369 30042 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:29.327462 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.290274 30110 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:29.294968 30079 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:29.354907 27150 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:29.281733 30053 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:11:29.294646 29995 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.323472 29493 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:29.339214 30105 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:11:29.294351 29538 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:29.367090 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.269061 30081 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.363806 30142 log.cc:927] Time spent T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:11:29.365047 30079 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.293833 29886 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.382253 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.338825 29934 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:11:29.369554 29493 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.382125 27223 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:29.391335 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.394671 27230 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.394762 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.374841 30053 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.375022 30042 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:29.397550 29493 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.405305 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.408578 30042 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.414533 30110 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.403630 27123 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.107s (SENT)
I20260709 13:11:29.416277 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.419236 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.420539 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.421299 27228 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:29.423125 27230 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:29.355865 29875 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.375648 29538 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.430948 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.429931 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.432598 27223 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.432648 27227 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.428387 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.434661 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.436383 30082 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:29.469972 27230 raft_consensus.cc:2376] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:29.470902 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.401106 30147 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.399549 30053 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:29.430471 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.444252 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.479507 27229 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:29.447111 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:29.400641 30054 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:29.449342 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:29.424551 30081 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.429157 29884 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:29.451810 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.454103 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:29.490491 27838 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.456843 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:29.404739 30161 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:29.492048 27150 raft_consensus.cc:2368] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:29.428722 29897 consensus_queue.cc:1243] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:11:29.495859 27123 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.124s (SENT)
I20260709 13:11:29.460160 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:29.497083 27832 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.469336 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:29.502874 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.504156 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.504877 27227 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:29.505585 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:29.471585 27230 raft_consensus.cc:2376] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:29.394109 30119 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:29.474160 27223 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:29.509450 27223 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:29.481953 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 96572.8us
I20260709 13:11:29.442883 30162 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:29.511876 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:29.512799 27227 raft_consensus.cc:2368] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:29.471016 30082 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.514441 30082 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.515547 30156 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:11:29.516665 30082 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.485266 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.517771 27832 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:29.518404 27232 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:29.518764 29538 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:29.486289 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:29.480381 27840 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:29.488126 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.520411 27232 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 8. Ops: [6.7-6.7]
I20260709 13:11:29.418660 29993 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:11:29.521112 27227 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:29.518792 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:29.527360 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:29.571072 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.586333 27232 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:29.586912 27232 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:29.592659 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.593422 27228 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:29.495003 30161 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.587976 27232 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.585045 27835 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
I20260709 13:11:29.597544 27232 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.606290 27228 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:29.606890 27838 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
W20260709 13:11:29.611565 30158 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260709 13:11:29.592756 30146 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:29.641713 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 335975us
W20260709 13:11:29.641122 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 113845us
I20260709 13:11:29.643148 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:29.646479 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:29.647311 27224 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6.
I20260709 13:11:29.643517 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:29.650976 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.651337 27224 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:29.652431 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.597874 30161 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:29.522269 30017 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:29.601095 27835 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:29.711437 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.625525 30167 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:29.705118 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.649421 30162 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.649175 30157 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:29.726495 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.657388 30021 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:29.704212 29995 raft_consensus.cc:2764] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:29.753072 27231 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:29.720116 30146 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:29.723098 29993 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.745839 30157 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:29.641183 30053 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:29.773587 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 620) took 1088 ms. Trace:
I20260709 13:11:29.751273 30175 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.754709 30162 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:29.770035 30157 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:29.769184 30166 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.754212 30021 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:29.788213 30169 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:29.788381 30053 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.733939 30167 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:29.800266 30055 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.002s
I20260709 13:11:29.800772 30055 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.802865 30017 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.784377 30079 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.803714 30146 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.814858 30055 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:29.817374 30029 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.001s
I20260709 13:11:29.817893 30029 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.784510 30175 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.820034 30029 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:29.818261 30057 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:29.820710 30129 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.004s
I20260709 13:11:29.821393 30175 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.823776 30021 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.826393 30152 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:29.826812 30152 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:29.828210 30152 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.829638 30152 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.830734 30161 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.831439 30167 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.832994 30161 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:29.813339 30118 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260709 13:11:29.808763 30162 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.845820 30154 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:29.846264 30154 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:29.847164 30154 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.848472 30154 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.851786 30157 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:29.714003 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:29.889925 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 175807us
W20260709 13:11:29.900454 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.901715 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:29.904667 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:29.906876 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:29.908438 27055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 243) took 11634 ms (client timeout 15000 ms). Trace:
I20260709 13:11:29.919003 27153 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:29.921736 27154 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:11:29.923332 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:29.926651 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:29.930835 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2144) took 2639 ms. Trace:
I20260709 13:11:29.932498 27154 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:29.931363 27148 rpcz_store.cc:276] 0709 13:11:27.290914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.292642 (+  1728us) service_pool.cc:224] Handling call
0709 13:11:27.293066 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.923576 (+1630510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.930148 (+1006572us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400138b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:29.930616 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3748123904}
I20260709 13:11:29.776852 27297 rpcz_store.cc:276] 0709 13:11:28.685433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.797945 (+112512us) service_pool.cc:224] Handling call
0709 13:11:28.914569 (+116624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.963908 (+ 49339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.773320 (+809412us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000bac50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:29.773514 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265563520}
I20260709 13:11:29.951020 27837 raft_consensus.cc:2368] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
W20260709 13:11:29.951180 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.954754 27839 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:29.955853 30157 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:29.971689 30059 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:29.972359 30059 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.972909 30059 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:29.973001 29407 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:29.973507 29407 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.973876 29407 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.976447 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 641) took 1293 ms. Trace:
W20260709 13:11:29.972424 30138 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.822s	user 0.003s	sys 0.000s
W20260709 13:11:29.980382 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 275796us
I20260709 13:11:29.980659 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2655) took 2500 ms. Trace:
I20260709 13:11:29.837554 30118 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:29.981197 27151 rpcz_store.cc:276] 0709 13:11:27.480419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.836846 (+356427us) service_pool.cc:224] Handling call
0709 13:11:27.837176 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.837557 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.837589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.838178 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.838222 (+1000044us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b1800369f40. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:29.007999 (+169777us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:29.050924 (+ 42925us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.054960 (+  4036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.055045 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.971183 (+916138us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:29.980239 (+  9056us) raft_consensus.cc:1685] finished
0709 13:11:29.980263 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.980458 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23767,"prepare.queue_time_us":42960,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":10923,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":102809,"spinlock_wait_cycles":23789184,"thread_start_us":169561,"threads_started":1,"wal-append.queue_time_us":1243467}
I20260709 13:11:29.984632 27157 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:29.985437 30118 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:29.836920 30079 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:29.976889 27230 rpcz_store.cc:276] 0709 13:11:28.682693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.507726 (+825033us) service_pool.cc:224] Handling call
0709 13:11:29.508064 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.523787 (+ 15723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.523819 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.524318 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.647974 (+123656us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:29.940499 (+292525us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.975656 (+ 35157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.975801 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.975861 (+    60us) raft_consensus.cc:1685] finished
0709 13:11:29.975873 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.976136 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74494,"prepare.queue_time_us":131144,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":2401,"raft.queue_time_us":77030,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4786,"thread_start_us":296073,"threads_started":2,"wal-append.queue_time_us":159228}
I20260709 13:11:29.993474 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:29.994989 27151 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:29.996340 30119 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:29.997293 30119 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:29.998517 27304 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:29.810551 29493 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.017066 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2091) took 1440 ms. Trace:
I20260709 13:11:30.017606 27304 rpcz_store.cc:276] 0709 13:11:28.576541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.576694 (+   153us) service_pool.cc:224] Handling call
0709 13:11:30.016802 (+1440108us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540005dcd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:30.016983 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3088498432}
I20260709 13:11:30.004544 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.000551 30021 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:11:29.981777 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.019109 29493 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.020491 27150 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:30.021243 30172 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:30.021715 30172 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:30.022181 30172 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:30.000350 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:30.020243 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:29.909040 27055 rpcz_store.cc:269] 0709 13:11:18.273957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.274153 (+   196us) service_pool.cc:224] Handling call
0709 13:11:29.908118 (+11633965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:24.266719 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:24.267425 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:24.267476 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:24.267495 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:24.268652 (+  1157us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:24.268767 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:24.292838 (+ 24071us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:24.440416 (+147578us) tablet.cc:701] Row locks acquired
0709 13:11:24.440479 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:11:24.440680 (+   201us) write_op.cc:270] Start()
0709 13:11:24.440859 (+   179us) write_op.cc:276] Timestamp: P: 1783602684440597 usec, L: 0
0709 13:11:24.440884 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:11:24.441729 (+   845us) log.cc:844] Serialized 3756 byte log entry
0709 13:11:25.506974 (+1065245us) op_driver.cc:464] REPLICATION: finished
0709 13:11:26.017374 (+510400us) write_op.cc:301] APPLY: starting
0709 13:11:26.021010 (+  3636us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:26.062483 (+ 41473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:26.062636 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:26.063883 (+  1247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:26.064137 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:26.064192 (+    55us) write_op.cc:312] APPLY: finished
0709 13:11:26.064481 (+   289us) log.cc:844] Serialized 71 byte log entry
0709 13:11:26.064663 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:26.064807 (+   144us) write_op.cc:454] Released schema lock
0709 13:11:26.068257 (+  3450us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:26.075161 (+  6904us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:26.075193 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18420,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":496209,"apply.run_cpu_time_us":3614,"apply.run_wall_time_us":62768,"num_ops":9,"prepare.queue_time_us":124812,"prepare.run_cpu_time_us":27388,"prepare.run_wall_time_us":393616,"raft.queue_time_us":328256,"raft.run_cpu_time_us":23528,"raft.run_wall_time_us":402063,"replication_time_us":1051874,"spinlock_wait_cycles":42880,"thread_start_us":731509,"threads_started":4,"wal-append.queue_time_us":622230,"wal-append.run_cpu_time_us":24934,"wal-append.run_wall_time_us":2144151}]]}
I20260709 13:11:29.953821 30017 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:30.009220 27807 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.575s (SENT)
W20260709 13:11:30.044575 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 125631us
I20260709 13:11:30.055415 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:30.062188 27156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.013s
W20260709 13:11:30.062685 27156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.013s
I20260709 13:11:30.070256 30146 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.076103 30057 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:30.077122 30057 consensus_queue.cc:1243] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:30.081277 27154 pending_rounds.cc:85] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 6
I20260709 13:11:30.081746 27154 pending_rounds.cc:107] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:30.082196 27154 raft_consensus.cc:2889] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.089387 30161 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:30.090469 30161 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.095781 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:30.096969 27226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1806) took 1309 ms (client timeout 1600 ms). Trace:
W20260709 13:11:30.097534 27226 rpcz_store.cc:269] 0709 13:11:28.787611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.094981 (+1307370us) service_pool.cc:224] Handling call
0709 13:11:30.096876 (+  1895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:30.096858 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:30.103582 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 83623.5us
I20260709 13:11:30.104712 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:30.053030 29945 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.007s
I20260709 13:11:30.107017 29945 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.053355 30021 consensus_queue.cc:1243] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:30.111159 29945 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.061560 30059 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.093912 30161 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.105973 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:30.137822 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 79681.9us
I20260709 13:11:30.153213 30055 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:30.154306 30055 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.156016 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1815) took 1028 ms. Trace:
I20260709 13:11:30.161801 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.162544 29986 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:30.163061 27151 raft_consensus.cc:2410] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:30.163106 29986 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:30.164336 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.165251 27151 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:30.164702 29986 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.166896 29407 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.157846 27225 rpcz_store.cc:276] 0709 13:11:29.127882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.303629 (+175747us) service_pool.cc:224] Handling call
0709 13:11:30.096461 (+792832us) spinlock_profiling.cc:243] Waited 899 us on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:30.155942 (+ 59481us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067200}
I20260709 13:11:30.175529 27804 leader_election.cc:400] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:30.183928 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2666) took 1392 ms. Trace:
W20260709 13:11:30.198765 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 93005.9us
I20260709 13:11:30.233678 27804 leader_election.cc:403] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:11:30.173951 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.173401 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.165936 29986 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.157291 30146 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.249073 30146 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:30.181345 30185 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.201402 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:30.250579 30146 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.251466 29407 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.201215 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:30.252667 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:30.253055 27226 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:30.253453 27226 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:30.254686 27226 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.255203 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:30.256031 27226 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.256120 27231 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
W20260709 13:11:30.256826 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 247864us
I20260709 13:11:30.184235 29945 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.160509 30055 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.258814 30055 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.259238 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 118050us
I20260709 13:11:30.259711 30055 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:30.257658 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.263193 27230 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:30.264690 30147 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:30.264896 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:30.265337 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2159) took 1113 ms. Trace:
W20260709 13:11:30.266014 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 97501.3us
I20260709 13:11:30.219681 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.175092 30157 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.204270 27297 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:30.186818 30161 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.253947 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.183882 27224 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.202447 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:30.266352 30147 raft_consensus.cc:670] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:30.248104 29993 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.265756 27157 rpcz_store.cc:276] 0709 13:11:29.151988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.152202 (+   214us) service_pool.cc:224] Handling call
0709 13:11:29.166869 (+ 14667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.985173 (+818304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.265011 (+279838us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003a0cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:30.265251 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879496960}
I20260709 13:11:30.271564 27224 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:30.233563 27229 rpcz_store.cc:276] 0709 13:11:28.791169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.527368 (+736199us) service_pool.cc:224] Handling call
0709 13:11:29.527662 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.527881 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:29.745940 (+218059us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.183147 (+437207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:30.183265 (+   118us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:30.183381 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.183504 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.183716 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61901,"prepare.queue_time_us":245825,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":442,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"thread_start_us":565289,"threads_started":2}
I20260709 13:11:30.273742 30042 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.277119 30064 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:30.278373 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.278928 30157 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.280051 29994 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:30.287693 30185 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:30.287981 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:30.288918 29995 raft_consensus.cc:1064] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:30.306737 30059 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.289038 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:30.289608 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:30.310557 27839 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.310825 30055 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:30.311112 30081 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.009s
W20260709 13:11:30.312609 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.290429 27832 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:30.313920 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:30.314677 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.290926 27834 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:30.316187 30199 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 13:11:30.290863 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:30.319412 30172 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.291986 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:30.294931 27303 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:30.295910 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:30.254686 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:30.297158 30004 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:30.323055 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.324093 27299 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.325930 27232 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.326253 30064 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:30.327656 27225 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:30.313679 30157 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:30.341311 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 53540us
I20260709 13:11:30.325459 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:30.333947 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 55771.4us
W20260709 13:11:30.328040 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63463.4us
I20260709 13:11:30.338459 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.322021 30172 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.326107 30004 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:30.359318 27839 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:30.359791 27226 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:30.325075 27224 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.340999 30185 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.305287 29994 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:30.367884 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.358958 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.370250 30111 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:30.361019 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.370631 30157 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:30.370982 27156 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:30.351949 30059 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:30.338968 30161 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.385680 27150 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:30.390951 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45184.6us
I20260709 13:11:30.389089 29994 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.403118 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.404263 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:30.407367 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1827) took 1211 ms. Trace:
I20260709 13:11:30.408664 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:30.407786 27228 rpcz_store.cc:276] 0709 13:11:29.195350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.607227 (+411877us) service_pool.cc:224] Handling call
0709 13:11:29.711953 (+104726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.930961 (+219008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.931015 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.974788 (+ 43773us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.050628 (+ 75840us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:30.149378 (+ 98750us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.171486 (+ 22108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.406765 (+235279us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003930d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:30.406820 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.406868 (+    48us) raft_consensus.cc:1685] finished
0709 13:11:30.407011 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.407161 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50697,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":23976,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"spinlock_wait_cycles":501595392,"thread_start_us":74762,"threads_started":1,"wal-append.queue_time_us":127503}
I20260709 13:11:30.409758 30029 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:30.410611 30029 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:30.407809 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:30.412221 30029 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:30.386636 30059 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:30.417280 27837 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:30.392441 30185 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:30.331700 29995 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.338589 30064 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:30.479341 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 98283.8us
I20260709 13:11:30.423312 30059 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:30.450711 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:30.397142 30172 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:11:30.496799 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.492959 29900 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.413676 29993 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:11:30.498522 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 136448us
I20260709 13:11:30.487187 29994 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:30.508196 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 57580.2us
I20260709 13:11:30.514541 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:30.516803 30161 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.517457 30152 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:30.519778 29910 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:30.521054 29910 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:30.521395 29910 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:30.449664 30157 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.492993 30057 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:30.502566 29945 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:30.505476 30147 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.531507 29910 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.532838 30157 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.491575 30111 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:30.500247 30029 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.551012 30029 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.554134 27224 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.538316 30057 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.557118 30057 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:30.541283 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:30.557588 29910 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:30.548971 29934 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:30.558372 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 642) took 1875 ms. Trace:
I20260709 13:11:30.558871 29934 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:30.558612 30004 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.558836 27223 rpcz_store.cc:276] 0709 13:11:28.683094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.510202 (+827108us) service_pool.cc:224] Handling call
0709 13:11:29.510553 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.592583 (+ 82030us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:30.083163 (+490580us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.180544 (+ 97381us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.181337 (+   793us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.181589 (+   252us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:30.184409 (+  2820us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.184630 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.184761 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.233113 (+ 48352us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:30.529848 (+296735us) raft_consensus.cc:1685] finished
0709 13:11:30.529890 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.558140 (+ 28250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115944,"prepare.queue_time_us":184203,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":121,"raft.queue_time_us":159571,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":14170,"spinlock_wait_cycles":68941056,"thread_start_us":553321,"threads_started":2,"wal-append.queue_time_us":76393}
I20260709 13:11:30.560348 29934 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.561504 29875 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:30.558426 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49973.9us
I20260709 13:11:30.562191 29875 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.563186 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:30.564589 29875 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.564807 29900 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:30.565191 30154 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.565646 29900 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:30.566267 29900 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:30.568009 27300 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:30.568845 27297 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:30.570432 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:30.570761 30053 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.571401 30053 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.571319 30185 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.572253 27303 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:30.567382 29900 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:30.550103 30111 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:30.564610 27272 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:30.565728 30154 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.578044 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:30.578737 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.579363 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:30.553792 30029 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:30.580029 27301 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.573933 30053 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.581235 27272 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:30.578773 27302 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:30.585196 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.585283 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.590394 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:30.582237 30057 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:30.615296 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.595978 30147 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:11:30.618755 27835 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:30.622495 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:30.631564 30154 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:30.628804 27050 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.639065 27232 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:30.640286 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59189.4us
I20260709 13:11:30.651024 27150 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:30.649259 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:30.654534 27838 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.609253 30057 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.666491 27224 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:30.667153 27224 pending_rounds.cc:85] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:30.673544 27224 pending_rounds.cc:107] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:30.673955 27224 raft_consensus.cc:2889] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.682595 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2668) took 1030 ms. Trace:
W20260709 13:11:30.682911 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.661373 30057 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.685292 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:30.683073 27224 rpcz_store.cc:276] 0709 13:11:29.651950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.652925 (+   975us) service_pool.cc:224] Handling call
0709 13:11:29.653140 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.183561 (+530421us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b54002d12a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:11:30.682212 (+498651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.682518 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9521536}
I20260709 13:11:30.693106 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.665951 30154 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:30.695549 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:30.702004 30004 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:30.699772 27834 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 4 LEARNER]: Advancing to term 5
W20260709 13:11:30.705456 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 447701us
I20260709 13:11:30.700628 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.714529 27301 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:30.715229 27832 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:30.722241 27151 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:30.700269 30154 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.718904 27050 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.758231 27834 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:11:30.771301 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 79281us
I20260709 13:11:30.694881 30152 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:30.729905 30154 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:30.825285 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 153962us
W20260709 13:11:30.825628 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 416989us
I20260709 13:11:30.781638 30161 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:30.817589 29986 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.836882 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.837579 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.827219 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:30.830008 27050 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:30.823127 30111 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:30.819254 30152 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.835646 30161 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:30.865545 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.892621 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.868008 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 374927us
W20260709 13:11:30.866542 30149 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:11:30.845839 29986 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:30.913242 30118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.018s	sys 0.037s
I20260709 13:11:30.849680 30059 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.846727 30008 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:11:30.932233 27050 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
W20260709 13:11:30.936213 30118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.018s	sys 0.037s
W20260709 13:11:30.952862 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 454650us
I20260709 13:11:30.874353 30111 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:30.941203 29845 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:30.941551 30029 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:30.973325 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 127763us
I20260709 13:11:30.948630 30172 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.003724 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.005360 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.995647 27050 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:31.010099 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.973052 29900 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.012221 27197 leader_election.cc:400] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
I20260709 13:11:31.030828 27197 leader_election.cc:403] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:31.023005 30146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.022s	sys 0.073s
W20260709 13:11:31.014868 27154 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.015s
I20260709 13:11:31.036260 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:31.027731 30064 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.024209 27050 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 4, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:31.006147 29845 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:31.035538 27154 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.000s	sys 0.016s
W20260709 13:11:31.010516 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 239207us
I20260709 13:11:31.012652 30172 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.043239 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.029856 30212 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:31.034536 30146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.023s	sys 0.074s
W20260709 13:11:31.042769 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 215625us
I20260709 13:11:30.993801 30161 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.050822 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:31.059715 27155 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:31.065908 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.067008 27157 raft_consensus.cc:2410] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:31.078958 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:31.079746 27300 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:31.080940 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.098289 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:31.091470 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 197342us
I20260709 13:11:31.110497 27834 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.036037 29900 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.122412 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:31.092440 29407 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:31.112057 30152 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.114234 30146 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:31.142639 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 143326us
I20260709 13:11:31.123737 30147 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:31.112027 29986 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:31.130241 30203 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:11:31.131834 30111 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.103308 30064 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:31.156876 30207 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:11:31.157624 30147 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:31.158135 30189 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:11:31.158455 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 687) took 1701 ms. Trace:
W20260709 13:11:31.158828 30202 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 13:11:31.159348 30172 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.160137 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:31.160449 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 907) took 2214 ms. Trace:
W20260709 13:11:31.180125 27807 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.687s (SENT)
I20260709 13:11:31.119170 30185 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.138422 29407 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:31.186208 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:31.187758 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:31.195638 30215 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:11:31.196727 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:31.177445 30222 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.198532 30222 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.201105 30222 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:31.202782 30228 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:11:31.202886 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:31.204140 29889 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.204859 30221 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.196938 30214 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:31.180302 27841 rpcz_store.cc:276] 0709 13:11:28.851505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.023340 (+171835us) service_pool.cc:224] Handling call
0709 13:11:30.346618 (+1323278us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:30.377610 (+ 30992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.396801 (+ 19191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:30.824864 (+428063us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.052239 (+227375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.052289 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:31.052331 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.052398 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.065610 (+ 13212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12256,"prepare.queue_time_us":541423,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":7344,"raft.queue_time_us":394,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":22221,"spinlock_wait_cycles":2710400,"thread_start_us":543314,"threads_started":2}
I20260709 13:11:31.221175 27834 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:31.174983 27149 rpcz_store.cc:276] 0709 13:11:29.357669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.357867 (+   198us) service_pool.cc:224] Handling call
0709 13:11:29.359917 (+  2050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.360211 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:29.380006 (+ 19795us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.256291 (+876285us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003e9ec0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a 00007f9a51d41a2a
0709 13:11:30.714047 (+457756us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.030365 (+316318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.033175 (+  2810us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:31.040454 (+  7279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.045847 (+  5393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.058678 (+ 12831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65144,"prepare.queue_time_us":56974,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2758,"raft.queue_time_us":114594,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":4434,"spinlock_wait_cycles":10794624,"thread_start_us":657020,"threads_started":2,"wal-append.queue_time_us":1475444}
I20260709 13:11:31.201663 30222 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:11:31.236985 30219 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:11:31.231659 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:31.206295 30146 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.241940 30146 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.216653 30185 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.244117 30185 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:31.246567 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 72859.3us
W20260709 13:11:31.247390 27807 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.323s (SENT)
I20260709 13:11:31.247800 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:31.254798 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:31.258772 27302 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.002s
I20260709 13:11:31.259267 27302 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
W20260709 13:11:31.261081 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 190599us
W20260709 13:11:31.271028 27838 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 13:11:31.274158 27838 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:31.271989 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.178450 29845 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:31.261711 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 173318us
I20260709 13:11:31.271736 30185 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:31.289175 30218 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:31.289911 30185 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.291071 30218 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:31.291802 30218 consensus_queue.cc:1243] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:31.292358 30185 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.293006 30218 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:31.293468 30021 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:31.295429 29986 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.296092 29986 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:31.298169 30231 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:11:31.298835 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:31.299674 30245 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:31.300849 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:31.302203 30118 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.302796 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:31.299777 30059 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.300451 30245 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.273902 29875 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:31.274223 30154 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:31.302737 30118 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.308879 27305 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:31.272119 30212 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:31.315747 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.277981 30081 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:31.371645 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63367.3us
I20260709 13:11:31.371479 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.375576 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:31.293947 30021 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:31.216713 29407 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:31.400444 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.410956 30014 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:31.411566 30233 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.230718 27224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:31.412319 30239 raft_consensus.cc:2764] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:31.412778 27224 raft_consensus.cc:606] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:31.413118 30239 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:31.413837 29900 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.415198 30239 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:31.416709 27123 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.600s (SENT)
I20260709 13:11:31.417249 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:31.418700 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.419116 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.422976 30234 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:31.423722 30234 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:31.424221 30234 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:31.428901 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 180623us
I20260709 13:11:31.429224 27232 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:11:31.430330 30081 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.431002 30081 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.376137 30152 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.433187 30152 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.434438 27148 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:31.411350 27225 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:31.413165 27224 raft_consensus.cc:614] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:31.443114 30021 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.444377 30021 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:31.444857 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.445727 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 198380us
I20260709 13:11:31.316020 29875 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.450320 29875 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.454931 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:31.455672 27297 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:31.441156 30212 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.463920 30064 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.464968 29986 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:31.468796 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.473554 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.477746 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.411923 30014 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.502628 29945 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:31.503329 29945 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:31.504680 29945 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.516322 30234 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.532828 27149 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 13:11:31.516279 30204 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.567s	user 0.000s	sys 0.011s
I20260709 13:11:31.520818 29993 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.524474 29945 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:31.547550 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.558889 30248 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.559710 30248 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:31.562198 29994 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.040s	user 0.011s	sys 0.011s
I20260709 13:11:31.562938 30248 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:31.564929 30081 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.568013 30245 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.572840 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:31.579941 30152 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:31.580435 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:31.587356 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 306429us
I20260709 13:11:31.590272 27269 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:31.577185 30004 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.875s	user 0.020s	sys 0.000s
I20260709 13:11:31.598554 30118 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.599115 30245 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:31.605860 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.605096 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:31.613140 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2174) took 1381 ms. Trace:
I20260709 13:11:31.549636 29993 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.613616 27155 rpcz_store.cc:276] 0709 13:11:30.235070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.364837 (+129767us) service_pool.cc:224] Handling call
0709 13:11:30.365312 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.064386 (+699074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.609298 (+544912us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54003566d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:31.613057 (+  3759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342047488}
I20260709 13:11:31.600980 30014 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:31.637312 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 363965us
I20260709 13:11:31.638376 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:31.621061 30118 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.612792 30245 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.646041 27230 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:31.623106 30111 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.603943 30161 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:11:31.649111 27123 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.825s (SENT)
I20260709 13:11:31.652913 27225 pending_rounds.cc:85] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 6
I20260709 13:11:31.613547 30249 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.659960 27225 pending_rounds.cc:107] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:11:31.663784 27225 raft_consensus.cc:2889] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:31.658632 30057 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.961s	user 0.019s	sys 0.001s
W20260709 13:11:31.658738 30128 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.017s
I20260709 13:11:31.653267 30245 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.658201 30214 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4.
W20260709 13:11:31.675830 30128 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.007s	sys 0.018s
I20260709 13:11:31.668726 30004 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.711473 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51938us
W20260709 13:11:31.711712 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85307.2us
I20260709 13:11:31.658517 30166 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:11:31.653931 30118 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:31.709978 27807 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.834s (SENT)
I20260709 13:11:31.699579 30253 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:31.724193 27123 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.843s (SENT)
I20260709 13:11:31.699545 30212 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:11:31.729177 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 90902.8us
W20260709 13:11:31.743705 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87056.2us
I20260709 13:11:31.698618 30057 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.717170 30004 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:31.758756 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48826.4us
I20260709 13:11:31.745055 30259 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:31.767264 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:31.747792 30253 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:31.786067 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.797128 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 72994.4us
I20260709 13:11:31.769366 29993 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:31.812403 30255 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:11:31.812757 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:31.813978 30260 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:11:31.814905 30261 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:31.825110 30269 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.825695 30269 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.828387 30064 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.828933 30064 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.835388 30004 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.799446 30185 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:31.845465 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 78303.5us
W20260709 13:11:31.820580 27123 leader_election.cc:336] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.861s (SENT)
I20260709 13:11:31.795418 30218 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:31.847292 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:31.791901 30259 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:31.880040 30264 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
W20260709 13:11:31.880496 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.869293 29407 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:31.887548 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.893147 30268 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:31.875118 30218 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.885393 30118 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.900445 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:31.900449 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88427.2us
I20260709 13:11:31.902197 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:31.903013 27838 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:31.903795 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:31.904551 27835 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:31.905821 30259 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.906342 29875 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.907238 30218 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:31.907706 27836 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:31.908715 29875 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.909950 30057 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:31.899434 29945 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.911638 29945 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.913273 30233 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.913772 30233 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.916081 30233 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.920540 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:31.932464 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.932078 30245 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.934420 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:31.934604 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:31.923010 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:31.936780 27835 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:31.937071 30280 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:11:31.938709 27123 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.238s (SENT)
I20260709 13:11:31.913730 29945 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:31.944981 30253 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.946872 30269 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:31.949100 27834 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:31.942013 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.950604 30276 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:31.951808 30157 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:31.952375 30157 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:31.955508 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:31.956058 27838 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:31.953644 30157 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:31.964910 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:31.958266 30265 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:31.990972 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.959995 29875 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:31.989019 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.991667 27151 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:31.991972 27148 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:31.990226 27154 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:31.988247 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:31.993783 27149 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.978528 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:31.994702 29945 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:31.995601 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:31.998720 27841 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.999208 29945 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.003578 29945 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:32.004566 29945 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:31.995872 29875 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.001353 27150 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:32.001473 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.002008 27154 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:31.945864 30064 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.010545 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2102) took 2766 ms. Trace:
I20260709 13:11:31.963035 30154 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:32.012178 27156 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:32.010951 27298 rpcz_store.cc:276] 0709 13:11:29.244253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.244394 (+   141us) service_pool.cc:224] Handling call
0709 13:11:29.253544 (+  9150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.254001 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.254040 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.262320 (+  8280us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.259025 (+996705us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b180032e7e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:30.824350 (+565325us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.914069 (+ 89719us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.940633 (+ 26564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.940742 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.599106 (+658364us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b180032e7e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a55c0b58f 00007f9a4ec4a571 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd
0709 13:11:32.001817 (+402711us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b180032e7e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:32.010141 (+  8324us) raft_consensus.cc:1685] finished
0709 13:11:32.010163 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.010325 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8422,"prepare.queue_time_us":74098,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":81155,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":16430,"spinlock_wait_cycles":35452416,"thread_start_us":495387,"threads_started":1,"wal-append.queue_time_us":1676314}
I20260709 13:11:31.999892 30194 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:32.014400 30194 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.016611 30194 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.018873 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:32.002789 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:32.022435 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.030441 27841 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:31.958415 30245 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.034802 27271 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:32.037159 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.034370 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.040117 27154 raft_consensus.cc:2410] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:32.044338 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:32.045075 27298 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.041795 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:32.053606 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:32.055447 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.020558 30157 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.048066 27837 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:32.052043 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:32.061551 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.062862 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.041035 30029 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.033121 29889 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:32.081809 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.071182 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:32.086990 29945 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:32.043777 30064 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:32.130388 27123 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.535s (SENT)
W20260709 13:11:32.131851 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61321.8us
I20260709 13:11:32.137241 27149 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:32.138721 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.139948 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:32.083609 30042 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:32.090659 30081 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.089162 30029 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:32.089075 30152 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.154680 30281 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:32.092857 29875 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.166464 30161 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:32.137630 30064 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:32.184413 30281 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.083179 30269 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:11:32.145282 30042 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.179740 27298 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:32.147090 30081 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.180763 30029 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:32.207252 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 127376us
I20260709 13:11:32.207901 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.212597 27839 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:32.180995 30152 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:32.210398 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 80025.7us
I20260709 13:11:32.142722 30057 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:32.190640 30064 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:32.216238 27123 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.010s (SENT)
I20260709 13:11:32.225911 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:32.208880 30042 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:32.190164 30053 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.190836 30161 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.212637 30081 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.212139 30041 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:32.238983 27123 leader_election.cc:336] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.633s (SENT)
I20260709 13:11:32.209975 30253 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:32.234676 29889 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.222282 30152 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.250667 30253 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:32.253556 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.254108 27155 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.255657 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.256278 27155 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:32.256335 27151 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:32.259704 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.260389 27148 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:32.265599 30147 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:32.268090 27123 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.692s (SENT)
I20260709 13:11:32.268599 27123 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:32.269685 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:32.270534 27841 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
W20260709 13:11:32.270860 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.274257 27152 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:32.272012 30253 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.251672 29889 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:32.280814 29889 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:32.282027 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.274340 30194 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:32.283672 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.284024 30194 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:32.285997 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.284063 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.287884 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.289621 30194 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.290275 30292 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:32.290741 30292 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.291086 30292 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.291278 30161 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.293063 30053 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:32.293774 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.295991 30253 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:32.297950 30152 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.300173 30152 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:32.303205 27123 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.706s (SENT)
I20260709 13:11:32.303797 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:32.306612 30053 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.289932 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:32.310150 27152 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.331851 27154 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:32.335953 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.336364 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:32.353484 30185 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:32.354769 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.354991 30185 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:32.355712 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:32.357244 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.357817 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.358481 27227 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.359792 30146 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:32.360152 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.361040 30146 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:32.358491 30258 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.362581 29995 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.363215 29995 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:32.364101 29995 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.364566 27230 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:32.365387 29995 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:32.353618 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 448627us
I20260709 13:11:32.367036 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:32.368531 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:32.369016 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.370716 30166 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:32.368541 30245 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:32.353714 30021 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.384508 30021 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.386188 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:32.337724 30294 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:11:32.378841 30281 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:32.409636 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.412179 30021 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.414613 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.415550 27230 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:32.416635 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.417933 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.423493 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.425696 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:32.429185 27226 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:32.431211 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.354769 30222 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.433322 27230 raft_consensus.cc:2368] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:32.433725 27152 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:32.430639 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:32.440559 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.442512 27153 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:32.440572 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:32.444464 27123 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.220s (SENT)
I20260709 13:11:32.444996 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:32.447666 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.449272 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.448696 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:32.450150 27226 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:32.452708 27229 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:32.451992 30194 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:32.458846 27123 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.741s (SENT)
I20260709 13:11:32.456270 30057 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.465001 27224 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:32.445937 30258 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:32.470872 27227 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:32.474690 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.432904 30247 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:32.483269 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2677) took 1174 ms. Trace:
I20260709 13:11:32.488101 27223 rpcz_store.cc:276] 0709 13:11:31.302237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.302418 (+   181us) service_pool.cc:224] Handling call
0709 13:11:31.302714 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.302979 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:31.646463 (+343484us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.949958 (+303495us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18004307e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a
0709 13:11:32.358888 (+408930us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.475837 (+116949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.475895 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:32.475944 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.476011 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.476133 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":416967,"prepare.queue_time_us":378033,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":415084,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":31532032,"thread_start_us":510591,"threads_started":3,"wal-append.queue_time_us":166339}
I20260709 13:11:32.478425 29889 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.496488 27123 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.751s (SENT)
I20260709 13:11:32.472254 30270 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.472595 30258 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.452793 30281 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:11:32.506268 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.508596 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.504721 29889 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:32.511943 30298 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:32.513540 29889 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.514333 27230 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:32.532119 27151 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:32.535426 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.506918 30258 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.505061 30194 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.483472 30222 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:32.656023 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 179608us
I20260709 13:11:32.660560 27230 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.660914 27269 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.661142 27230 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:32.640643 30233 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.646652 30295 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.671172 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 179000us
I20260709 13:11:32.674803 27227 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:32.681947 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.670491 27230 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.660933 30152 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.649334 30064 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.696465 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.697230 27224 raft_consensus.cc:2376] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:32.697899 29945 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.698565 29945 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.699626 30212 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.702428 27230 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.702713 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.703347 27151 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:32.704591 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:32.705608 30161 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:32.706007 30161 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.706231 27223 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:32.706418 30161 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:32.654230 30194 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.717360 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.682174 30233 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:32.727152 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.729475 27300 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
W20260709 13:11:32.727397 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 121535us
I20260709 13:11:32.725320 30021 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:32.735374 30021 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:32.728693 30281 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:11:32.745124 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:32.751881 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.716316 30212 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:32.764570 27230 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:11:32.765009 27230 pending_rounds.cc:85] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:32.765239 27230 pending_rounds.cc:107] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:32.765468 27230 raft_consensus.cc:2889] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.765766 27230 pending_rounds.cc:107] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:32.766003 27230 raft_consensus.cc:2889] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:32.769227 30300 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:11:32.759416 30081 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 13:11:32.690575 30295 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.723671 30053 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:32.777531 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.728302 30152 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.800935 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:32.785080 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.807548 30042 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260709 13:11:32.780726 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:32.756160 30057 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:11:32.822569 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.829593 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73743us
I20260709 13:11:32.832559 27230 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:32.842772 27152 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:11:32.809535 30064 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.863811 27228 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:32.778782 30311 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:11:32.850535 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.877345 27224 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:32.800479 30247 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:32.777675 30021 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.875736 27298 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:32.778990 30081 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:32.882926 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49408.6us
I20260709 13:11:32.886466 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.889472 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.890380 27230 raft_consensus.cc:2376] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4. Re-sending same reply.
I20260709 13:11:32.830312 30042 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.902694 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:32.894043 30157 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.000s
W20260709 13:11:32.910142 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 73015.4us
I20260709 13:11:32.913300 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:32.913650 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.888229 30222 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.920308 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.921646 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.925177 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.922513 27223 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:11:32.926656 30309 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:32.837769 30233 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.929520 29945 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:32.930089 29945 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.930601 29945 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.933390 27231 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:32.938673 30302 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 13:11:32.939419 30042 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:32.939563 30307 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:32.940070 30307 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:32.940933 30307 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.945530 27306 raft_consensus.cc:2368] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
W20260709 13:11:32.951869 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.957974 27224 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:32.957192 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:32.959357 27228 raft_consensus.cc:2368] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:32.944656 30258 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:32.964128 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.964752 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:32.965270 30320 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.967088 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.971143 27232 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:32.971475 27150 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:32.977243 27224 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:32.977737 27224 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:32.954283 30307 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:32.978530 27224 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:32.986572 27224 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.989648 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:32.990514 27151 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:32.994947 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 280197us
W20260709 13:11:32.982542 30029 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.000s
I20260709 13:11:32.979292 30320 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.001523 30320 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.006289 30152 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:32.897823 30212 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:33.015802 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 124221us
I20260709 13:11:32.985055 30194 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.018910 27224 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:11:33.019649 27224 pending_rounds.cc:85] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 6
I20260709 13:11:33.020018 27224 pending_rounds.cc:107] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:11:33.020961 27224 raft_consensus.cc:2889] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.024886 30295 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.026408 30081 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.016961 30029 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.031615 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.032619 30281 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.033131 30281 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.034482 30316 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.035055 30316 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.035411 30281 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.036017 30281 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.036389 30281 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.036722 30281 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.037375 30316 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:33.041923 30303 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
W20260709 13:11:33.043859 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.043841 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:33.049110 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 4.126s (SENT)
I20260709 13:11:33.049755 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.042721 30249 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:33.053532 30042 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:33.084957 27838 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:33.070573 30152 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:33.080778 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 215907us
I20260709 13:11:33.105510 30281 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:33.083902 29995 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.004s
I20260709 13:11:33.079784 30042 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.080030 30029 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.109556 30021 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:33.131596 30021 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.132697 30258 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.117573 30042 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.112663 30239 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:11:33.142777 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 229559us
I20260709 13:11:33.141495 30021 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:33.152853 30250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.018s	sys 0.021s
I20260709 13:11:33.164129 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.175978 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.183431 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.184214 27833 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
W20260709 13:11:33.185163 30250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.018s	sys 0.022s
I20260709 13:11:33.195459 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.196130 27833 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.208384 27841 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:33.194903 27807 leader_election.cc:336] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 4.961s (SENT)
I20260709 13:11:33.210170 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.212373 30152 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.215811 27837 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.218325 30281 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.219161 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.219882 27840 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:33.226760 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.227485 27837 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.242455 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.244272 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:33.262810 30161 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.006s
I20260709 13:11:33.263725 27833 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:33.263823 30161 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.265416 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:33.266549 30292 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.006s
I20260709 13:11:33.248974 30281 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:33.251053 30273 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.292011 27839 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:33.280866 30316 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:33.277179 30021 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.282528 30281 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.287230 30273 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.306228 27837 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:33.281802 30292 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.339043 27836 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:33.333292 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.352120 30238 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:33.353041 30238 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.354144 30238 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:33.355233 30328 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:11:33.341081 30320 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.301795 30281 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.373777 27838 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:33.300640 30316 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.365106 27271 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.306277 30273 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:33.354673 30333 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:33.300261 30021 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.342020 30152 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.376813 30292 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.382383 30253 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:33.390537 30021 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.386535 30152 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.391992 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:33.392746 27157 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:33.395623 30161 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.397606 30253 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.398805 30253 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.383073 30247 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:33.404657 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:33.405062 30247 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:33.405550 30247 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.406453 30247 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.406966 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:33.407734 30247 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.408401 30146 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:33.408834 30146 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.409185 30146 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.410530 30316 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.411564 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.412353 27839 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 3: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:33.412778 27050 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 379) took 4878 ms. Trace:
I20260709 13:11:33.415477 29995 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:33.415885 29995 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.413151 27050 rpcz_store.cc:276] 0709 13:11:28.534660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.577640 (+ 42980us) service_pool.cc:224] Handling call
0709 13:11:33.412689 (+4835049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:31.611472 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:31.752904 (+141432us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:31.760590 (+  7686us) write_op.cc:435] Acquired schema lock
0709 13:11:31.765926 (+  5336us) tablet.cc:662] Decoding operations
0709 13:11:31.878623 (+112697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:31.878744 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:31.878778 (+    34us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:31.879495 (+   717us) tablet.cc:701] Row locks acquired
0709 13:11:31.879546 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:11:31.879758 (+   212us) write_op.cc:270] Start()
0709 13:11:31.879940 (+   182us) write_op.cc:276] Timestamp: P: 1783602691879683 usec, L: 0
0709 13:11:31.879981 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:11:31.880713 (+   732us) log.cc:844] Serialized 2491 byte log entry
0709 13:11:32.244416 (+363703us) op_driver.cc:464] REPLICATION: finished
0709 13:11:32.428070 (+183654us) write_op.cc:301] APPLY: starting
0709 13:11:32.441511 (+ 13441us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:32.473897 (+ 32386us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:32.503167 (+ 29270us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:32.740886 (+237719us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:32.741315 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:11:32.741400 (+    85us) write_op.cc:312] APPLY: finished
0709 13:11:32.741831 (+   431us) log.cc:844] Serialized 53 byte log entry
0709 13:11:32.742089 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.742247 (+   158us) write_op.cc:454] Released schema lock
0709 13:11:32.762293 (+ 20046us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:32.852132 (+ 89839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:32.859192 (+  7060us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":177598,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":99379,"apply.run_cpu_time_us":5260,"apply.run_wall_time_us":413872,"num_ops":6,"prepare.queue_time_us":371697,"prepare.run_cpu_time_us":10469,"prepare.run_wall_time_us":279439,"raft.queue_time_us":213521,"raft.run_cpu_time_us":10221,"raft.run_wall_time_us":120381,"replication_time_us":354313,"thread_start_us":382434,"threads_started":4,"wal-append.queue_time_us":95662}]]}
I20260709 13:11:33.416234 29995 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.397357 30042 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:33.431143 30293 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.170s	user 0.008s	sys 0.012s
I20260709 13:11:33.438369 27839 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:11:33.437996 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.440308 30042 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.441969 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.441993 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.442848 27833 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.443725 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.446323 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:33.447700 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.446486 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.451607 27833 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:33.453022 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.453329 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:33.421392 30320 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.455637 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.456130 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.457744 30259 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.460500 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.462098 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.462947 27837 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:33.465328 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.466576 27228 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:33.445500 30146 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.475545 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:33.468942 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.545s (SENT) [suppressed 43 similar messages]
I20260709 13:11:33.476349 27227 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:33.480080 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.460268 30259 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:33.481405 30259 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.492563 27231 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:33.474570 30253 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.494840 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.495530 27834 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:33.499382 27834 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:33.500519 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.485067 30320 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:11:33.503304 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.509373 27834 raft_consensus.cc:2410] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:33.501271 27839 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:33.492584 30042 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:33.519901 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.526152 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47771.5us
I20260709 13:11:33.526991 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:33.529140 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2680) took 1959 ms. Trace:
I20260709 13:11:33.533221 30147 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:33.533478 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.533706 30147 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.534163 30147 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.535554 27227 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:33.536585 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.540606 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.515075 30222 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.509251 30253 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.542436 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.517601 30157 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:33.547995 27232 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:33.549132 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.553805 30316 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:33.554661 30316 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:33.558930 30316 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.522722 30041 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:33.541986 30312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.003s
I20260709 13:11:33.529469 27225 rpcz_store.cc:276] 0709 13:11:31.569243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.571289 (+  2046us) service_pool.cc:224] Handling call
0709 13:11:31.571673 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:31.683267 (+111594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.683313 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:31.683964 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:11:31.761247 (+ 77283us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:31.789265 (+ 28018us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.018490 (+229225us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800430720. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:32.258588 (+240098us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b1800430720. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:11:32.258813 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.366452 (+107639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.396358 (+1029906us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b4800190158. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:11:33.528922 (+132564us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54001da6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:33.528963 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.528992 (+    29us) raft_consensus.cc:1685] finished
0709 13:11:33.528999 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.529095 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":900614,"prepare.queue_time_us":501251,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":111469,"raft.run_cpu_time_us":7066,"raft.run_wall_time_us":1044898,"spinlock_wait_cycles":212612224,"thread_start_us":73840,"threads_started":1,"wal-append.queue_time_us":180428,"wal-append.run_cpu_time_us":3662,"wal-append.run_wall_time_us":1393540}
I20260709 13:11:33.560142 30329 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:33.569939 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.571346 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.576547 30316 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.596786 27231 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:33.580691 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.582121 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.598145 27223 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:33.582274 30157 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.583499 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.584200 29995 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.544494 30292 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:33.605226 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.606422 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.607060 27225 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.609052 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:33.596046 30041 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.610659 30329 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.612421 30041 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:33.612619 30334 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:11:33.612851 30329 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.621105 30152 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.622478 30253 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.600638 27227 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:33.602442 27228 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:33.560086 29889 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:11:33.596140 30312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.021s	sys 0.003s
I20260709 13:11:33.627661 29945 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.599433 30346 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.629140 30346 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:33.603637 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.633889 27225 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:33.634439 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:33.635695 27154 raft_consensus.cc:2410] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:11:33.638706 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 98222.6us
W20260709 13:11:33.601190 30302 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:11:33.601469 30298 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:11:33.567083 30344 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:11:33.597342 30154 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.645280 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.646036 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.642915 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.652767 27153 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.652976 27224 raft_consensus.cc:2368] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5.
I20260709 13:11:33.654002 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.654588 27224 raft_consensus.cc:2376] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5. Re-sending same reply.
I20260709 13:11:33.647572 30281 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.539039 30042 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:33.651036 27232 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:33.560745 30222 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.649158 30316 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:33.658850 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.659529 27224 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:33.662267 29875 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.671958 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.672690 27224 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:11:33.673326 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.673743 27224 raft_consensus.cc:2376] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7. Re-sending same reply.
I20260709 13:11:33.646941 30273 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.680090 30273 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.680621 30042 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.683832 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.684345 27224 raft_consensus.cc:2376] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7. Re-sending same reply.
I20260709 13:11:33.685719 29995 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.686903 30154 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:33.687209 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.687379 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.687880 27224 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:33.688035 27154 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:33.686355 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46331.3us
I20260709 13:11:33.692857 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.694741 30222 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.695569 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:33.695873 30346 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.697031 27806 leader_election.cc:400] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:33.697883 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.699137 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.699661 27232 raft_consensus.cc:2376] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5. Re-sending same reply.
I20260709 13:11:33.699990 30147 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.700309 27224 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:33.700491 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.706305 30233 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:33.714044 27232 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:33.714633 30147 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.709973 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.716265 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.716827 27231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.717283 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.718385 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.719087 27225 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:33.719782 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.720373 27225 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:33.710276 29875 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:33.715157 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.716120 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.722970 27154 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:33.711148 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:33.708777 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:33.723941 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45732.6us
I20260709 13:11:33.716305 27153 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:33.723570 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 706858us
I20260709 13:11:33.723783 27224 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:33.730702 30041 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.730997 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:33.731491 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.731624 30041 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:33.731699 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:33.731943 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:33.732056 27838 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.732306 27232 raft_consensus.cc:2376] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
I20260709 13:11:33.723361 30053 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:33.733412 30154 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.733233 30053 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.732052 30041 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:33.734316 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.735056 30041 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.735805 27807 leader_election.cc:400] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8.
I20260709 13:11:33.736248 30041 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:33.736711 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:33.737341 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 484272us
I20260709 13:11:33.738678 30053 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:33.738835 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.739305 30312 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.739435 27230 raft_consensus.cc:2376] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:33.733263 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:33.743623 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.744295 27123 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.841s (SENT)
I20260709 13:11:33.747103 27227 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:33.747485 27838 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:33.749764 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.742849 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.751938 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:33.753398 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.754317 30308 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.754854 30308 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.756055 30253 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:33.756623 30253 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.757095 30308 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.758690 30253 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.759378 30281 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.759963 30281 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.760494 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.760398 30281 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:33.761355 27306 raft_consensus.cc:2410] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:11:33.761767 30343 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:33.659843 30259 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:33.762239 30343 raft_consensus.cc:1068] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Unable to promote non-voter f4afe81810944d70bc2cc31754392f3d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:33.762444 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:33.763651 30259 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.761359 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:33.765946 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.766644 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.768100 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.770052 27299 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.770255 30307 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:33.770785 30307 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:33.771685 30307 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:33.772840 30146 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:33.774230 30233 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:33.775095 30316 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.775590 30316 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:33.776154 27228 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:33.777467 27228 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:33.777652 30316 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:33.777866 30292 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:33.779246 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.779198 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.781220 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.781860 27224 raft_consensus.cc:2376] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6. Re-sending same reply.
I20260709 13:11:33.783011 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:33.783295 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.783311 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.784410 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:33.805816 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63070.9us
I20260709 13:11:33.806942 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.785799 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:33.807624 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.807832 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.808148 27227 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:33.808396 27153 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.806392 27228 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:11:33.783962 27157 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.813540 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:33.814133 27833 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:33.814569 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:33.815174 27836 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 2.
I20260709 13:11:33.816071 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.809600 27228 pending_rounds.cc:85] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
W20260709 13:11:33.785382 30315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.015s	sys 0.013s
W20260709 13:11:33.824733 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.826323 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.826797 27306 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:33.779922 30222 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:33.817555 27228 pending_rounds.cc:107] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:11:33.848270 27833 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:33.819908 30315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.015s	sys 0.013s
I20260709 13:11:33.780078 30346 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:33.963153 27300 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:34.138042 27150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:11:34.140956 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.141038 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:33.814435 30312 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:34.148222 27157 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:34.156386 27150 raft_consensus.cc:606] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:34.156961 27150 raft_consensus.cc:614] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:34.149471 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.157558 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:33.865962 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.158761 27838 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:34.152032 27149 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:33.813892 30194 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:33.997715 27841 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:11:34.154616 27298 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.963939 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.150113 27228 raft_consensus.cc:2917] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:11:34.173935 27228 raft_consensus.cc:2889] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.162669 27157 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.959707 27153 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:33.841430 27122 connection.cc:256] RPC call timeout handler was delayed by -1.3533038980001493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:11:34.175072 27122 connection.cc:256] RPC call timeout handler was delayed by -1.2255598150002243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
I20260709 13:11:34.176708 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:34.178927 30310 raft_consensus.cc:2764] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:11:34.158022 27834 raft_consensus.cc:2368] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:34.168105 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.182026 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.182682 27148 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:11:34.015969 30348 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:34.160341 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:34.185312 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:34.189836 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.199466 30314 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:11:34.246717 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:33.979660 30281 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:34.247476 27300 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:33.867007 30343 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.248476 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.248198 30343 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.249094 27300 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:34.210636 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.250906 27153 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:33.857314 30311 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:34.252782 30311 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:34.255041 30311 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:34.256306 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.257682 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.255164 27834 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:34.259930 27157 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:11:33.995556 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.271353 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.249948 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.266507 27841 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:34.267140 27839 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:34.277036 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.278195 30253 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:34.278970 30057 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:34.279659 30057 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:34.282454 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.284075 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.284555 27832 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:34.285460 27298 raft_consensus.cc:1217] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-5.7]   Dedup: 3.6->[5.7-5.7]
I20260709 13:11:34.285676 30308 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.277875 27302 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:34.311838 27298 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:11:33.942615 30222 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:34.289673 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.287549 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.316710 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.288810 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.315057 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:34.318085 27300 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.299679 27301 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:34.324093 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.332460 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.333359 27151 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:34.168527 30212 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.336479 27302 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:34.277899 27150 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:34.341553 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.342669 27839 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:34.344208 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.345055 27297 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:34.344854 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.351629 27149 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:34.199363 30346 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:34.358453 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.365603 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:34.366396 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.266800 30314 raft_consensus.cc:2764] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:34.293102 30292 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:34.298533 30157 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:34.391152 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:34.395973 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.400607 27300 raft_consensus.cc:2410] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:34.319994 30253 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:34.404489 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.424571 27302 raft_consensus.cc:2368] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
W20260709 13:11:34.426002 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 50600.3us
I20260709 13:11:34.427492 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:34.323676 30249 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:34.436090 27151 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:34.435973 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.345996 30146 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.327014 27835 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:34.438217 27153 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:11:34.342607 30021 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:34.349052 30212 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:34.456377 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:34.422781 30149 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.330559 30308 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:34.463049 30149 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.464226 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.464956 30308 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:34.465149 30149 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:34.466147 30249 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.466432 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.412797 30292 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.493800 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.486397 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:34.496153 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:34.489806 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 304524us
I20260709 13:11:34.493693 27149 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:34.499464 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.413137 30057 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:34.508074 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.508713 27228 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:34.509214 27224 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:11:34.514542 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.515232 27151 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:34.469794 30212 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.531219 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:34.538379 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:34.559018 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.563653 27148 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:34.571142 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.508394 30157 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:34.560086 27302 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:34.537287 29993 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:34.493165 30021 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.479486 30146 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.514348 30149 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:11:34.597559 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.599006 27154 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:34.600690 27302 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:11:34.587641 30157 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:34.572808 30312 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:34.631577 27226 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:34.631529 30312 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.663568 30053 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:34.664233 30053 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:34.664701 30053 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.675189 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.586786 30343 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:34.542666 30222 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:34.696249 27305 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:34.706355 27306 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:34.707065 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 272697us
I20260709 13:11:34.700765 27229 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:34.581092 30346 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.606760 30316 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:11:34.667681 30322 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:34.712040 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:34.729833 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2718) took 1123 ms. Trace:
I20260709 13:11:34.736424 30147 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:34.690680 30350 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:11:34.740127 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.612093 30253 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.732740 27232 rpcz_store.cc:276] 0709 13:11:33.606792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.784183 (+177391us) service_pool.cc:224] Handling call
0709 13:11:33.784569 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:33.817600 (+ 33031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.817634 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:33.828725 (+ 11091us) log.cc:844] Serialized 52 byte log entry
0709 13:11:34.318332 (+489607us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:34.386426 (+ 68094us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.386754 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.386862 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.729528 (+342666us) raft_consensus.cc:1685] finished
0709 13:11:34.729558 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.729756 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67839,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":25112,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":13692,"thread_start_us":317506,"threads_started":1,"wal-append.queue_time_us":636040}
I20260709 13:11:34.724239 30249 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:34.753767 27306 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:34.739439 30147 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.770968 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.771950 27232 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:34.735195 30322 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:34.775519 30322 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.777127 30147 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:34.782512 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:34.752086 30369 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.739905 30350 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:34.798450 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.829108 27228 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:34.803211 30310 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:34.809329 30281 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:34.811185 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:34.813187 30146 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:34.813419 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.844231 27157 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:34.769853 29993 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:34.787187 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:34.850665 27306 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:11:34.848992 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:34.855974 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:34.856902 27299 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.824654 30157 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.826094 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:34.822175 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:34.815012 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:34.875756 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53721us
I20260709 13:11:34.876744 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:34.869941 30308 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:34.872778 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2726) took 1051 ms. Trace:
I20260709 13:11:34.877636 27153 rpcz_store.cc:276] 0709 13:11:33.821139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.258586 (+437447us) service_pool.cc:224] Handling call
0709 13:11:34.331276 (+ 72690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.442041 (+110765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.872448 (+430407us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540013a454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:34.872698 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245242752}
W20260709 13:11:34.868288 30354 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 13:11:34.874468 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:34.834697 30281 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:34.845124 30021 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:34.861389 30041 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.125s	user 0.015s	sys 0.000s
I20260709 13:11:34.887190 30147 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:34.859200 30273 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:34.902369 30281 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:34.880486 30157 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.827160 30315 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:11:34.910379 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:34.911350 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:34.918953 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 380623us
I20260709 13:11:34.920516 27302 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:11:34.820638 27123 connection.cc:256] RPC call timeout handler was delayed by -1.0025106599998708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 13:11:34.921873 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:34.893960 30358 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:11:34.936684 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.938014 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:34.936695 27123 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.739s (SENT)
I20260709 13:11:34.938203 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.879040 30308 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:34.943568 27151 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:34.944341 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:34.945591 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 449477us
I20260709 13:11:34.937915 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:34.944968 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:34.949724 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.950770 27153 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:34.890673 30365 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:34.919287 30147 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.953816 30147 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.934082 30273 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.961031 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:34.966123 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:34.967787 27148 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:34.968149 27148 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:34.946719 30308 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.833528 30369 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.956666 30360 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:34.979157 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.954869 30365 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:34.979548 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:34.960058 30273 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.969307 27148 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.984169 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1213) took 1257 ms. Trace:
I20260709 13:11:34.961730 30314 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:34.984596 27837 rpcz_store.cc:276] 0709 13:11:33.726824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.726930 (+   106us) service_pool.cc:224] Handling call
0709 13:11:33.727217 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.750621 (+ 23404us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:33.750662 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.767217 (+ 16555us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.141415 (+374198us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:34.141465 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.141544 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.867576 (+726032us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:34.979374 (+111798us) raft_consensus.cc:1685] finished
0709 13:11:34.979399 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.984099 (+  4700us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23373,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"spinlock_wait_cycles":19151744,"thread_start_us":292556,"threads_started":1,"wal-append.queue_time_us":619657}
I20260709 13:11:34.985590 27299 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:34.981887 27232 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:34.997476 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:34.920879 30212 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:34.989663 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:34.990276 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.011641 27229 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 3: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:35.012194 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.990341 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:35.013893 27224 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:35.008524 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:35.015571 27231 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:35.018925 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:34.980084 30021 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:35.021912 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:35.022730 27227 raft_consensus.cc:2376] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4. Re-sending same reply.
I20260709 13:11:35.023250 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:35.024102 27228 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:34.982743 30365 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.048506 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:35.050557 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:34.957636 30350 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:34.992491 30314 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:34.977638 30310 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:34.974805 30370 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:11:35.059121 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:35.025189 30315 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:35.075449 27224 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:35.057700 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:35.068789 27225 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.084695 27223 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:35.057022 30307 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:35.093439 27156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.000s	sys 0.023s
I20260709 13:11:35.068579 30314 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.094890 27225 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:35.029846 30360 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:11:35.102429 27156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.023s
W20260709 13:11:35.104341 27152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.025s	sys 0.053s
W20260709 13:11:35.105160 27152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.025s	sys 0.053s
I20260709 13:11:35.095726 30310 consensus_queue.cc:1243] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:35.099745 30057 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:35.134725 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 403920us
W20260709 13:11:35.137639 30312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.015s	sys 0.041s
W20260709 13:11:35.149101 27807 leader_election.cc:336] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.676s (SENT)
I20260709 13:11:35.162199 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:35.180094 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.127686 30041 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:11:35.152616 30312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.016s	sys 0.041s
I20260709 13:11:35.146770 30310 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:35.179903 30157 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:35.218354 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:35.219340 27149 raft_consensus.cc:2410] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:35.181452 30057 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:35.141183 30374 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:11:35.205806 30310 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:35.217393 30371 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:11:35.270057 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 314633us
I20260709 13:11:35.262457 30249 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.281023 27123 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.019s (SENT)
I20260709 13:11:35.283198 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:35.284885 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 313225us
W20260709 13:11:35.291944 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 415211us
I20260709 13:11:35.316061 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:35.310670 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 338223us
I20260709 13:11:35.272519 30374 consensus_queue.cc:1243] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:11:35.321822 27123 leader_election.cc:336] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.023s (SENT)
I20260709 13:11:35.322412 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:35.288326 30194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.005s	sys 0.016s
I20260709 13:11:35.270529 30147 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:35.328258 30194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.005s	sys 0.017s
I20260709 13:11:35.305277 30369 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:35.325814 30212 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:35.395836 30376 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.115s	user 0.006s	sys 0.001s
W20260709 13:11:35.447844 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 397495us
W20260709 13:11:35.447844 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.448763 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 127025us
I20260709 13:11:35.325378 30363 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:35.449882 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 396624us
I20260709 13:11:35.637560 27301 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:35.639901 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.640307 30350 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:35.639762 30384 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:35.640790 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.305876 30249 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.605367 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:35.370951 30194 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:35.602712 27297 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:35.508126 27157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.044s
I20260709 13:11:35.600977 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2725) took 1785 ms. Trace:
W20260709 13:11:35.647701 27157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.051s
W20260709 13:11:35.614490 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 284056us
I20260709 13:11:35.615063 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:35.454887 30374 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:35.606144 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.649179 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.651443 27148 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.620507 27305 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:35.311460 30310 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:35.658169 27152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.013s
W20260709 13:11:35.660924 27152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.014s
I20260709 13:11:35.331275 30259 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 13:11:35.658640 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 346002us
I20260709 13:11:35.675964 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:35.621048 27123 leader_election.cc:336] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.658s (SENT)
I20260709 13:11:35.678192 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.623085 27304 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:35.610649 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.474792 30315 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:35.614235 30375 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.300s	user 0.017s	sys 0.006s
I20260709 13:11:35.601748 27122 leader_election.cc:400] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:35.644307 27837 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.551378 30311 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:35.621464 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 472465us
I20260709 13:11:35.686852 27122 leader_election.cc:403] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:35.693565 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 91977.4us
I20260709 13:11:35.694370 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:35.695669 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:35.450379 30057 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:35.690727 27807 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.729s (SENT)
I20260709 13:11:35.709036 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2724) took 1923 ms. Trace:
I20260709 13:11:35.717052 27837 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:35.649991 30384 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:35.692535 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71678.6us
I20260709 13:11:35.649315 27156 rpcz_store.cc:276] 0709 13:11:33.815922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.816623 (+   701us) service_pool.cc:224] Handling call
0709 13:11:33.816906 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.817088 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:34.503765 (+686677us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.474188 (+970423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.600664 (+126476us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:35.600715 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.600783 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.600909 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156217,"prepare.queue_time_us":756526,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":102885,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":1440824,"threads_started":3,"wal-append.queue_time_us":769541}
I20260709 13:11:35.710676 30374 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:35.707945 30371 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:35.710158 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:35.710315 30373 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.686594 30391 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.743520 27123 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.690s (SENT)
W20260709 13:11:35.779219 27123 leader_election.cc:336] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.801s (SENT)
W20260709 13:11:35.780241 27123 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.015s (SENT)
I20260709 13:11:35.780722 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:35.743376 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:35.696031 30394 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.783330 30394 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.709888 30312 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:35.710430 30393 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.708611 27807 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.728361 27152 rpcz_store.cc:276] 0709 13:11:33.785509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.785704 (+   195us) service_pool.cc:224] Handling call
0709 13:11:33.815356 (+ 29652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.815547 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:34.338545 (+522998us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.661383 (+1322838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.661436 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:35.661496 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.707573 (+ 46077us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.708422 (+   849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57091,"prepare.queue_time_us":658359,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":102527,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":64,"thread_start_us":1692223,"threads_started":3,"wal-append.queue_time_us":950496}
I20260709 13:11:35.688052 30343 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:35.710528 30363 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:35.755398 30369 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.711007 30346 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:35.783967 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 73833.9us
I20260709 13:11:35.825459 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:35.788794 30292 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.254s	user 0.015s	sys 0.007s
W20260709 13:11:35.791913 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 178880us
W20260709 13:11:35.792480 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 84700.7us
I20260709 13:11:35.827731 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:35.807058 30367 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 13:11:35.706883 30146 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:35.750262 30212 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.785919 30396 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:35.819762 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 129066us
I20260709 13:11:35.736333 30389 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:35.711374 30311 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.756515 30310 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:35.795071 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 144466us
I20260709 13:11:35.834071 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:35.840682 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 225705us
I20260709 13:11:35.821529 30147 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:35.754881 30384 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.821394 30374 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:35.896044 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 65577.8us
W20260709 13:11:35.818367 27123 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.055s (SENT)
I20260709 13:11:35.908232 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:35.841977 30146 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:35.837985 30370 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:35.871867 30383 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:11:35.842548 30400 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:35.904135 30365 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.003s
W20260709 13:11:35.911921 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 168555us
I20260709 13:11:35.905141 27269 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.832209 30292 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.825058 30343 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:35.927922 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 109607us
W20260709 13:11:35.988983 27123 leader_election.cc:336] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.155s (SENT)
W20260709 13:11:35.989892 27123 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.216s (SENT)
W20260709 13:11:35.991516 27123 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.939s (SENT)
W20260709 13:11:35.992527 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.993407 30412 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.994071 30412 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.841487 30212 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.998714 30212 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.000672 30422 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.001363 30422 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.004055 30422 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.004640 30422 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:35.835395 30405 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:11:35.944157 30370 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:35.945273 30400 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:35.936583 30053 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.271s	user 0.016s	sys 0.008s
I20260709 13:11:35.946307 30427 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:35.947342 30401 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:11:35.948411 30426 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:36.051605 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.948902 30399 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:36.052994 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 147918us
I20260709 13:11:35.825515 30393 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:35.803519 30391 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.079452 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.894285 30396 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:35.936650 30424 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:35.964485 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1229) took 1103 ms. Trace:
I20260709 13:11:36.016325 30400 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:35.831442 30346 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:35.824635 30194 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:36.058703 30408 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:35.829345 30369 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.005155 30422 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:35.872102 30402 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:11:36.040620 27839 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:35.804992 30373 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:35.980784 30389 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.108403 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.872500 30363 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:11:35.987952 30374 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:35.996603 30412 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.046829 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2745) took 1079 ms. Trace:
I20260709 13:11:36.039626 30403 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:35.824890 30315 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:36.067834 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 241171us
I20260709 13:11:36.170467 30423 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:35.954249 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45171.7us
I20260709 13:11:35.866947 30312 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:36.089089 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 663) took 1174 ms. Trace:
I20260709 13:11:36.088539 27832 rpcz_store.cc:276] 0709 13:11:34.860717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.860875 (+   158us) service_pool.cc:224] Handling call
0709 13:11:34.863094 (+  2219us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:34.863597 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.863624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:34.864423 (+   799us) log.cc:844] Serialized 78 byte log entry
0709 13:11:35.204957 (+340534us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:35.673793 (+468836us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.931939 (+258146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.932057 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.936442 (+  4385us) raft_consensus.cc:1685] finished
0709 13:11:35.936454 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.964389 (+ 27935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90448,"prepare.queue_time_us":745048,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":222473,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":19599,"thread_start_us":995530,"threads_started":3,"wal-append.queue_time_us":458626}
I20260709 13:11:36.042493 30249 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:36.087764 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 253848us
I20260709 13:11:36.178829 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:35.912462 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.051548 30426 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:36.111596 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:35.982543 30365 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:36.116519 27807 leader_election.cc:336] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 3.152s (SENT)
I20260709 13:11:36.117841 30146 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.118361 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 685) took 1094 ms. Trace:
I20260709 13:11:36.118566 30369 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.119398 30422 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.075261 30053 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.120249 30346 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.121325 30384 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.120945 30396 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.122283 30311 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.124662 30394 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.099368 30419 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.222994 30419 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.224223 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2211) took 1326 ms. Trace:
I20260709 13:11:36.225312 30419 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.127377 30435 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:36.224612 27157 rpcz_store.cc:276] 0709 13:11:34.898260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.898487 (+   227us) service_pool.cc:224] Handling call
0709 13:11:34.898927 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.899362 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.899414 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.900026 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.648184 (+748158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.648232 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.648304 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.223983 (+575679us) raft_consensus.cc:1685] finished
0709 13:11:36.224005 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.224155 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1465,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":116,"thread_start_us":747616,"threads_started":1,"wal-append.queue_time_us":1313653}
I20260709 13:11:36.226308 30311 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.226768 27155 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:36.226840 30311 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.227653 30053 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.226323 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 688) took 1201 ms. Trace:
I20260709 13:11:36.127694 30427 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:36.104948 30042 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:11:36.142711 30363 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:36.105683 30406 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:36.129752 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 687) took 1105 ms. Trace:
I20260709 13:11:36.131542 30373 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.132473 30391 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.127374 30374 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:11:36.133996 30421 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:36.134390 30390 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.276314 30390 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:36.134647 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.134727 30322 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.359s	user 0.016s	sys 0.000s
I20260709 13:11:36.104450 30368 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.136018 30393 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.137178 30292 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.052037 30418 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
W20260709 13:11:36.142692 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.286257 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.255874 30363 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.256295 30406 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:36.150890 30308 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.170s	user 0.008s	sys 0.005s
I20260709 13:11:36.086447 30370 consensus_queue.cc:1243] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:36.158643 27148 rpcz_store.cc:276] 0709 13:11:34.967187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.967398 (+   211us) service_pool.cc:224] Handling call
0709 13:11:34.967670 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.651221 (+683551us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b580045fbd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51c930aa 00007f9a51d15447 00007f9a51d2dfe7 00007f9a51d2f7de 00007f9a51d39b49 00007f9a51d3a416 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4
0709 13:11:36.046390 (+395169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.046425 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.046472 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:36.046515 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.046589 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.046759 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199042,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"spinlock_wait_cycles":616586496,"thread_start_us":298938,"threads_started":1}
W20260709 13:11:36.162207 30314 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.004s
I20260709 13:11:36.101852 30324 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.280839 30391 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.300999 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.305234 27229 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:36.175727 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 127193us
W20260709 13:11:36.186179 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 274094us
I20260709 13:11:36.306639 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.187287 27841 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:36.306908 27148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d425a845db244636a6b92ed85545087c"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "897d8be8580141d1ad3bb17946d3da89"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:11:36.307523 27148 raft_consensus.cc:606] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Received request to transfer leadership to TS 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:36.207713 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 96185.7us
I20260709 13:11:36.307884 27148 raft_consensus.cc:614] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:36.308310 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:36.208145 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 91693.7us
I20260709 13:11:36.176883 27300 rpcz_store.cc:276] 0709 13:11:34.903523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.906418 (+  2895us) service_pool.cc:224] Handling call
0709 13:11:34.906817 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.907310 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.907349 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.908032 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.276054 (+368022us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.651420 (+375366us) log.cc:844] Serialized 14 byte log entry
0709 13:11:36.043771 (+392351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.050024 (+  6253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.068747 (+ 18723us) raft_consensus.cc:1685] finished
0709 13:11:36.068776 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.077470 (+  8694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28660,"prepare.queue_time_us":398361,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":187389,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":16590,"thread_start_us":1071549,"threads_started":3,"wal-append.queue_time_us":409746}
I20260709 13:11:36.208986 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:36.187327 27227 rpcz_store.cc:276] 0709 13:11:35.023640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.025442 (+  1802us) service_pool.cc:224] Handling call
0709 13:11:35.025742 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:35.026661 (+   919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.026689 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:35.061573 (+ 34884us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.458417 (+396844us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.782154 (+323737us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.928806 (+146652us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.929291 (+   485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.929606 (+   315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.118128 (+188522us) raft_consensus.cc:1685] finished
0709 13:11:36.118149 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.118299 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174079,"prepare.queue_time_us":514944,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":145601,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":38063,"thread_start_us":609564,"threads_started":3,"wal-append.queue_time_us":645495}
I20260709 13:11:36.213651 27832 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:36.215992 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.311856 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.313278 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.314165 27838 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:36.214473 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.217463 27305 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:36.215546 27840 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.220703 30343 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.228796 27228 rpcz_store.cc:276] 0709 13:11:35.024583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.050432 (+ 25849us) service_pool.cc:224] Handling call
0709 13:11:35.050764 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:35.447907 (+397143us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:35.764198 (+316291us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.954251 (+190053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.954814 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.954961 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.954994 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.955067 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.226088 (+271021us) raft_consensus.cc:1685] finished
0709 13:11:36.226113 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.226257 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60096,"prepare.queue_time_us":499190,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":23049,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":28778,"thread_start_us":640323,"threads_started":3,"wal-append.queue_time_us":457461}
I20260709 13:11:36.234860 27306 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.235435 27834 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.171952 30403 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.191754 30413 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:11:36.256448 27230 rpcz_store.cc:276] 0709 13:11:35.024281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.024410 (+   129us) service_pool.cc:224] Handling call
0709 13:11:35.024727 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:35.026317 (+  1590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.026369 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.061188 (+ 34819us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.446163 (+384975us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.755255 (+309092us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.911587 (+156332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.911693 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.129507 (+217814us) raft_consensus.cc:1685] finished
0709 13:11:36.129533 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.129682 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1211,"prepare.queue_time_us":500659,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":61864,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":33240,"thread_start_us":750686,"threads_started":3,"wal-append.queue_time_us":731608}
I20260709 13:11:36.191234 30426 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.183409 30389 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:36.217995 30057 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.310174 30314 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.185117 30412 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.191526 30222 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.279301 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 684) took 1256 ms. Trace:
I20260709 13:11:36.252096 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:36.145151 30281 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.210s	user 0.013s	sys 0.002s
W20260709 13:11:36.146462 30273 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.136s	user 0.009s	sys 0.004s
I20260709 13:11:36.339396 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.339720 27149 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:36.337796 27232 rpcz_store.cc:276] 0709 13:11:35.023192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.023341 (+   149us) service_pool.cc:224] Handling call
0709 13:11:35.049726 (+ 26385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:35.327683 (+277957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.327719 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.452325 (+124606us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.864076 (+411751us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.935465 (+ 71389us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.936224 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.936319 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.279060 (+342741us) raft_consensus.cc:1685] finished
0709 13:11:36.279087 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.279235 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83461,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":45578,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":32029,"thread_start_us":554991,"threads_started":3,"wal-append.queue_time_us":461072}
W20260709 13:11:36.295560 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 131050us
I20260709 13:11:36.272912 30405 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.341118 30273 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.343122 30405 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.345165 30273 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.260708 30053 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:11:36.346484 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1225) took 1619 ms. Trace:
I20260709 13:11:36.313725 30433 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.345903 27298 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:11:36.350477 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.278882 30390 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.281766 30194 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.189385 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.310501 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:36.272684 30310 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:11:36.285707 30374 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:36.311849 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.315322 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:36.318902 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:36.324014 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:36.378212 27841 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:11:36.378507 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 63239.1us
I20260709 13:11:36.319419 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:36.319422 30423 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.328891 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.327759 30441 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.383090 27840 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:36.328347 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:36.304890 30308 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:36.336117 30412 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.336666 30316 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:36.329466 30389 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.346886 27839 rpcz_store.cc:276] 0709 13:11:34.727428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.727582 (+   154us) service_pool.cc:224] Handling call
0709 13:11:34.738953 (+ 11371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.108261 (+1369308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.346227 (+237966us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54004a7254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:36.346410 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2992914176}
I20260709 13:11:36.329015 30324 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.352203 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.352454 30433 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.353911 27838 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.355638 27050 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:36.356724 30437 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:36.360204 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.360415 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.362246 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 661) took 1477 ms. Trace:
I20260709 13:11:36.362136 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.363319 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2212) took 1287 ms. Trace:
I20260709 13:11:36.363649 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.364359 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2118) took 2533 ms. Trace:
I20260709 13:11:36.365154 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.319388 30370 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.367640 30311 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.318576 30403 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:36.293345 30410 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:36.379298 27157 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:36.334316 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 125403us
I20260709 13:11:36.472612 27299 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.473434 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.379420 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.348850 30053 consensus_queue.cc:1243] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:36.286727 30322 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:36.378593 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54657.5us
W20260709 13:11:36.385684 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 75279.7us
I20260709 13:11:36.460216 27303 rpcz_store.cc:276] 0709 13:11:33.830485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.931939 (+101454us) service_pool.cc:224] Handling call
0709 13:11:34.329079 (+397140us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:34.329269 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.466257 (+136988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.466292 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.466817 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.771685 (+304868us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:35.288741 (+517056us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.305416 (+ 16675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.327813 (+1022397us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b18003cb740. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419
0709 13:11:36.364027 (+ 36214us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000bb154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:36.364083 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:36.364134 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:36.364150 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.364298 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":803478,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":10295,"raft.queue_time_us":61764,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":31445,"spinlock_wait_cycles":665303424,"thread_start_us":798303,"threads_started":2,"wal-append.queue_time_us":504434}
W20260709 13:11:36.479252 27807 leader_election.cc:336] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.545s (SENT)
I20260709 13:11:36.386828 30422 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.479705 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:36.382771 30394 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:36.318277 30393 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:11:36.458346 30146 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.338114 27835 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:36.388804 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.486613 30146 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.317427 30391 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.489552 30146 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.394025 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.456553 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.462034 27232 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.462286 27155 rpcz_store.cc:276] 0709 13:11:35.076426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.076603 (+   177us) service_pool.cc:224] Handling call
0709 13:11:35.076952 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.227318 (+1150366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.363061 (+135743us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540012cfd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:36.363254 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643808640}
W20260709 13:11:36.463186 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74097.6us
I20260709 13:11:36.461226 27151 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:36.338376 30281 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.501430 27153 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:36.462517 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:36.468513 27050 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.506925 27050 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:36.508275 27050 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.469149 27841 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:36.379956 30418 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.460726 27306 rpcz_store.cc:276] 0709 13:11:34.887403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.913249 (+ 25846us) service_pool.cc:224] Handling call
0709 13:11:34.942369 (+ 29120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.318147 (+1375778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.361991 (+ 43844us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003a8c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:36.362177 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2958286208}
I20260709 13:11:36.469957 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.513082 27839 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:36.382881 30441 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.515187 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:36.483795 30439 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:11:36.519666 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:36.520735 30445 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.135s
I20260709 13:11:36.388185 30374 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.484342 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:36.489797 30391 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.523636 30374 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.525007 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.526633 30441 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.521588 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.525879 27155 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:36.391335 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.532368 27304 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:36.490216 30292 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.533095 30402 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:36.390726 30384 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.456565 30147 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.496029 30434 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.535028 30384 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.535539 30427 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:36.535619 30434 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.496694 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.495245 30442 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:11:36.395318 30413 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:36.504698 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 125364us
I20260709 13:11:36.500442 27298 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:36.509922 27050 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 6, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.510979 30422 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.511768 30369 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.557193 30384 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.382226 30194 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.557816 30384 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.558461 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1778) took 1101 ms. Trace:
I20260709 13:11:36.558382 30384 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.559073 27299 rpcz_store.cc:276] 0709 13:11:35.457262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.457392 (+   130us) service_pool.cc:224] Handling call
0709 13:11:35.609625 (+152233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.473008 (+863383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.558184 (+ 85176us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54000e8b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:36.558380 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984191360}
I20260709 13:11:36.390190 30423 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.560118 30374 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:36.561599 30423 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.531311 27302 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:36.562071 30194 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.562825 30389 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.563129 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:36.563782 30412 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.560541 30374 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.565724 30322 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.512526 30410 consensus_queue.cc:1243] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:36.566543 30422 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.566852 30369 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:36.549494 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.567515 30369 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.568811 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:36.568943 30395 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:36.569087 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:36.569444 30395 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.569729 30369 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.498039 30314 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.537762 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:36.521365 30443 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:11:36.474222 30316 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:36.586126 30316 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.548183 27305 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:36.548041 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65720.9us
I20260709 13:11:36.591277 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:36.463654 30437 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.480000 30315 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.536543 30427 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:36.548786 30413 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:36.559518 30310 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:36.570358 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.571030 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.566578 30374 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.572916 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.617221 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.617532 27304 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:11:36.534580 30400 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.574599 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:36.484355 30436 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.517874 27157 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:36.518391 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:36.579218 27151 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:36.622747 27841 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:36.553162 27232 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:36.503878 30365 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:36.583734 30441 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:36.583982 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:36.625304 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:36.591763 30346 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:36.595145 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:36.638885 27298 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:36.595755 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:36.598767 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.601820 30431 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:36.602613 30041 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:36.652840 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55333.5us
I20260709 13:11:36.653908 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:36.603467 30315 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.592607 30423 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:36.598354 30427 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.608251 30433 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.609076 30308 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.612607 27223 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:36.707305 27223 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:36.613222 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.708366 27226 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.582005 30146 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:36.615877 27154 raft_consensus.cc:2368] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
W20260709 13:11:36.618003 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47712.1us
I20260709 13:11:36.716902 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.618297 27300 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.552102 27050 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 6 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:36.535508 30147 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.646648 27834 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:36.618654 30413 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.653100 30041 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:36.667719 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.711684 27302 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:36.665699 27230 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:36.729374 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:36.638474 30395 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.663308 30212 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:36.755501 27197 leader_election.cc:400] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:36.663029 30423 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.665046 30374 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.671300 30445 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:36.674122 30391 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:36.659988 30346 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:36.785817 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 268078us
I20260709 13:11:36.757699 27197 leader_election.cc:403] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:36.757071 27050 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:36.639035 30436 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.821487 30436 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.785737 30445 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:36.822301 30445 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:36.716216 30314 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:11:36.793010 30346 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.782902 29995 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:36.826931 30314 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:36.827401 30314 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:36.828429 30314 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:36.746949 30370 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:36.790868 27050 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.796353 27840 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:36.752466 27223 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.831008 27223 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.833702 27050 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 4, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 4 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.797487 30369 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5.
I20260709 13:11:36.798666 30430 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.798532 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.786166 30391 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:36.757985 30384 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.781556 30423 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:36.664567 30431 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.816154 30315 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:36.674320 30194 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:11:36.818351 30147 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.797204 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:36.750949 30041 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:36.857227 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 58794us
I20260709 13:11:36.861569 27298 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:36.876591 30370 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.865618 27300 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:36.876262 27226 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:36.925026 27227 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:36.925341 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.869647 27050 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 6 to 7, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 7 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:36.882464 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.813155 30363 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.853826 30314 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.855537 30441 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.877029 30391 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:36.920974 27225 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:36.808866 30427 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.921169 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.922013 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.941596 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:36.942616 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.943681 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.934424 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.939306 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.936363 27050 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 5, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130), now has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:36.945761 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.945573 27226 raft_consensus.cc:2376] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6. Re-sending same reply.
W20260709 13:11:36.946399 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.910146 30212 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:36.948081 27229 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:11:36.948143 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.948382 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.944191 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.948908 27224 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:36.941659 27228 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:36.924835 30400 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:36.955823 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.955909 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.956068 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:36.949301 27225 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:36.964146 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.964354 27225 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:36.966176 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.969308 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.953133 27050 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 4, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130), now has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 4 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:36.974299 27228 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:36.979213 27229 raft_consensus.cc:2368] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:36.987811 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.988541 27226 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
W20260709 13:11:36.944811 30057 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:11:36.993099 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:36.948520 30363 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:36.935444 30315 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:36.960963 30427 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.994884 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.008296 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.009683 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:36.940675 30441 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.013899 27305 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:36.989691 27050 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 5, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.018414 27050 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 6, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.023051 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.027465 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.028923 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.029625 27050 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 4, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 4 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:37.036280 30426 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.005s
I20260709 13:11:37.036755 30426 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:36.978325 30406 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.039213 30406 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.038934 30212 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.040901 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:37.041554 30403 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 13:11:37.041770 27299 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:11:37.042743 27152 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:37.043821 27154 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:37.044085 30434 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:37.053725 30456 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 13:11:37.054337 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.999763 30057 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.015296 30308 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.010407 30369 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:37.010413 30393 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.042001 30403 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:37.068234 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.138679 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.139292 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.076887 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.078393 27223 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:11:37.139940 27227 raft_consensus.cc:2376] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:37.140300 27223 pending_rounds.cc:85] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 7
I20260709 13:11:37.113441 27154 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:37.140666 27223 pending_rounds.cc:107] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:37.119002 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.140998 27223 raft_consensus.cc:2889] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.141618 27299 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:37.119944 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.142426 27301 raft_consensus.cc:2376] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5. Re-sending same reply.
I20260709 13:11:37.129402 30431 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.132835 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.134199 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.139385 27306 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.142879 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:37.071285 27050 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.145577 30402 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:37.146277 30402 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:37.146718 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.148139 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.149080 27303 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:37.150574 27304 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:37.138018 30343 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.151904 30343 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.154754 30441 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.155215 30281 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:37.157814 30343 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.162758 30413 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.163300 30395 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.166811 30433 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:37.167204 30433 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:37.168074 30433 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.176332 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.177338 27302 raft_consensus.cc:2410] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:37.177561 27050 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.178462 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.179193 27223 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.181528 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.182200 27227 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:37.184538 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.185925 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.188014 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.188789 27227 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.192797 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.193946 30041 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.196280 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.196799 27304 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.203583 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.206940 27223 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:37.213491 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.215993 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.176673 30402 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.218360 30445 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.220645 30445 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.221199 30445 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.223265 30423 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.225137 30312 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:37.225617 30312 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:37.226409 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.226790 30426 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.226441 30312 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.228559 30403 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:37.232127 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.232770 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:37.190160 30429 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:11:37.233404 27229 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:37.119490 30308 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.233893 27231 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:37.238624 27300 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:37.183375 30413 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:37.265034 27301 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:37.273626 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.256623 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.275023 27228 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:37.275610 27226 raft_consensus.cc:2376] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7. Re-sending same reply.
I20260709 13:11:37.276100 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.256284 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.234568 27223 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:37.256230 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.278263 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.278991 27232 raft_consensus.cc:2376] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7. Re-sending same reply.
I20260709 13:11:37.232327 27050 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:37.277247 27230 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:11:37.282529 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 404833us
I20260709 13:11:37.283020 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.285141 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.281494 27050 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:37.289917 27050 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:37.291697 27050 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130), now has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:37.294028 27050 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:37.295082 27227 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:37.295603 27050 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.297163 27050 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 1 to 3, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 3 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:37.299113 27804 leader_election.cc:400] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:37.299504 27804 leader_election.cc:403] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.298905 27050 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:37.300963 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.301313 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.302089 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.281446 30314 raft_consensus.cc:1064] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:37.258119 30312 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.305527 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.313231 27232 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:37.324471 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:37.325371 27841 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Advancing to term 6
W20260709 13:11:37.334244 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.345475 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.247748 30445 consensus_queue.cc:1243] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:37.227990 30391 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.367751 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.366302 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.373123 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:37.385963 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.374223 27303 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:37.298578 30403 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.314832 30389 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:37.397739 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.398643 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.399235 30041 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.426617 27228 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:37.399418 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:37.400848 30463 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:11:37.314119 29995 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:37.403865 30314 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.442987 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.303143 30413 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:37.393347 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:37.446038 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52789.3us
I20260709 13:11:37.446794 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.447233 27841 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.447621 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:37.428511 27223 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:37.449896 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.436692 27303 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:37.367805 30419 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.432816 30470 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.368533 30423 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:37.453887 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.456790 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.461640 27841 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.464514 27303 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:37.465998 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.467305 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:37.467872 27841 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:37.461639 30466 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:11:37.471984 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.472580 27838 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.473409 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:37.476006 27841 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:37.476931 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:37.477715 27841 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:37.482125 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.482683 30391 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.483089 30433 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.483498 27841 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:37.483947 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:37.484871 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:37.485785 30308 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:37.486375 30346 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:37.486892 30146 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:37.487334 30346 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:37.487360 30146 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.487810 30346 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.488101 30146 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.488240 30346 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:37.460292 30436 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:37.491827 30370 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:37.460120 30412 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.492220 30370 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:37.492621 30412 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.493064 30412 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.493156 30370 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.494701 27836 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:37.462414 30419 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.495307 27833 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:37.499600 30419 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:37.460388 30400 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.500257 27833 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:37.500422 30400 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.500839 30400 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.495724 27150 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.502799 27838 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:37.504446 27838 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:37.446007 30363 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:37.507328 30363 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.446169 30389 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:37.508224 30437 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.508741 30389 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.509789 30437 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:37.489646 30310 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.511557 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1240) took 1035 ms. Trace:
I20260709 13:11:37.460965 30470 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.512598 30470 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.496753 30370 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.432482 30403 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.519840 30403 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:37.497308 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:37.523744 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.505754 27838 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.510772 30360 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:37.510799 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.536741 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 152665us
W20260709 13:11:37.506142 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.496634 30469 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.231s	user 0.007s	sys 0.000s
I20260709 13:11:37.511969 27832 rpcz_store.cc:276] 0709 13:11:36.475988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.519425 (+ 43437us) service_pool.cc:224] Handling call
0709 13:11:36.519760 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.549340 (+ 29580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.549374 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.549419 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:36.549461 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.511325 (+961864us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5400477cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:37.511376 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.511500 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67532544}
W20260709 13:11:37.537299 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.552063 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.537739 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.553112 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.525112 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:37.542799 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.559787 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.563529 27832 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:37.563267 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.564810 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:37.566510 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:37.570187 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.571120 27838 raft_consensus.cc:2410] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:37.570420 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.573632 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.574177 27223 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:37.583384 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58326.7us
I20260709 13:11:37.584548 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.584939 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:37.586591 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:37.588825 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65150.3us
I20260709 13:11:37.535594 30436 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:37.589228 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:37.589712 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.597111 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.537046 30360 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:37.607455 27152 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:37.592355 27149 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:37.538538 30425 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.558336 30430 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.599951 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.576610 30147 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:11:37.602524 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.610970 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:37.654122 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54236.9us
I20260709 13:11:37.612154 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:37.613109 27841 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.613404 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.615657 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:37.616379 30369 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:37.617087 30364 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:37.618042 30368 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:37.623823 27836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 947) took 1435 ms (client timeout 1829 ms). Trace:
I20260709 13:11:37.593675 30403 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:37.677944 27836 rpcz_store.cc:269] 0709 13:11:36.188297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.188891 (+   594us) service_pool.cc:224] Handling call
0709 13:11:37.623529 (+1434638us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540059fe54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:37.623698 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703143168}
I20260709 13:11:37.550477 30259 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:11:37.636617 30427 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:37.593571 30363 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:37.576746 30406 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.646284 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:37.576887 30451 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:37.657051 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 43741.8us
I20260709 13:11:37.702423 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.580817 30395 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:11:37.686698 27841 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:37.610318 30413 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:37.609853 30445 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:37.642621 30281 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:37.694438 27149 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:37.703495 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:37.704777 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:37.686483 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:37.706300 27123 leader_election.cc:400] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6.
I20260709 13:11:37.676702 30426 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:37.659168 30374 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.721350 27223 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
W20260709 13:11:37.722963 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 67210.5us
I20260709 13:11:37.723078 27157 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:37.721820 27122 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.724058 30314 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:37.724655 30307 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:37.728971 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:37.712682 30406 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.764886 30314 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.772733 30314 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:37.772634 30406 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.731532 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.775629 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:37.643168 30430 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.733119 27149 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:37.782816 27149 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:37.693553 30363 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:37.725621 30396 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:11:37.735930 27152 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:11:37.794401 27152 pending_rounds.cc:85] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 2
I20260709 13:11:37.794747 27152 pending_rounds.cc:107] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:11:37.795043 27152 raft_consensus.cc:2889] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.708108 30389 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:37.708703 30470 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.743135 30281 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:37.745258 30436 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.718658 30413 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.747280 30477 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.594313 30346 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.689746 30259 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:37.752242 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.756914 27224 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:37.761593 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.763140 27301 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:37.642392 30311 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.712785 30451 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:37.841442 27302 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:37.780902 30417 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.841598 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.777910 27157 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:37.771013 30369 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:37.770700 30445 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:37.776912 30426 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:37.653009 30425 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.793648 30363 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:37.793411 30431 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:37.791194 30430 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.812834 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:37.786720 30391 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:37.815223 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 53708.9us
I20260709 13:11:37.816498 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:37.818604 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 66455.8us
I20260709 13:11:37.873265 27841 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:37.873646 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.824572 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.825556 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.826578 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.827497 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:37.815631 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 243995us
W20260709 13:11:37.850198 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 261084us
W20260709 13:11:37.855727 30312 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 13:11:37.811306 30413 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.792470 30467 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:11:37.850677 30417 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.809581 30389 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:37.871605 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.854526 27228 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:37.803814 30400 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.840251 30405 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:37.872156 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:37.853744 30416 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:11:37.841255 30451 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:37.850423 30374 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:37.842420 30427 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.890516 30053 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:37.907477 30395 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.851776 30477 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:37.907758 27154 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:37.908165 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.909039 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.883119 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.858300 30042 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:37.850829 30369 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:37.867336 30484 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:11:37.913102 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.914007 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:37.916604 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:37.917974 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:37.920771 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48742.7us
W20260709 13:11:37.890132 30444 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.541s	user 0.009s	sys 0.016s
I20260709 13:11:37.901715 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.929211 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:37.934943 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 122203us
I20260709 13:11:37.797868 30253 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:37.939726 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:37.951858 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.853960 30308 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:37.915086 30417 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:37.978396 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:37.970474 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88437.2us
I20260709 13:11:37.982158 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:37.989076 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:37.920042 30429 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:37.878465 30146 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:37.987804 27302 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:37.921312 30311 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:37.993157 27157 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:11:37.965909 30471 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:11:37.964715 30483 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:11:37.891968 30391 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:37.997244 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:37.928623 30374 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:37.984742 30445 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:38.027168 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:37.912040 30273 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:11:38.030303 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:37.940862 30403 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:38.029299 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 149713us
I20260709 13:11:37.936471 30053 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:38.031698 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.033710 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:38.037343 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 55283.5us
I20260709 13:11:38.048120 27149 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:37.990808 30405 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:37.961865 30487 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.979202 30477 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:37.989183 30459 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:37.983229 30406 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:38.021904 30437 consensus_meta.cc:287] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.001s
I20260709 13:11:37.984035 30212 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:37.935817 30427 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.057847 30422 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:38.060042 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 187237us
I20260709 13:11:38.080758 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 945) took 1893 ms. Trace:
I20260709 13:11:38.081182 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.060479 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:38.061668 27151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2750) took 1538 ms (client timeout 1566 ms). Trace:
I20260709 13:11:38.063016 30374 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:38.083113 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 91924.1us
I20260709 13:11:38.083892 27153 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:37.965220 30312 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:11:38.070428 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.071204 30491 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:38.041200 30431 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:37.963090 30490 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:11:38.058398 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:37.968799 30281 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:38.082149 27151 rpcz_store.cc:269] 0709 13:11:36.518425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.521233 (+  2808us) service_pool.cc:224] Handling call
0709 13:11:38.056596 (+1535363us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540013a454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:38.056776 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110825216}
I20260709 13:11:38.081254 27837 rpcz_store.cc:276] 0709 13:11:36.187708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.187874 (+   166us) service_pool.cc:224] Handling call
0709 13:11:36.188285 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.188562 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.188597 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.207748 (+ 19151us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.260597 (+ 52849us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:36.273248 (+ 12651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.273363 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.799903 (+1526540us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:38.080467 (+280564us) raft_consensus.cc:1685] finished
0709 13:11:38.080491 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.080698 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19036032,"thread_start_us":32589,"threads_started":1,"wal-append.queue_time_us":65182}
I20260709 13:11:38.084993 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.097827 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:38.087581 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.073949 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:38.078387 30474 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.813s	user 0.009s	sys 0.000s
I20260709 13:11:38.068336 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.071197 30405 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.039534 30429 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:38.050860 30311 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.082360 30427 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.128499 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.108346 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.130340 27155 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:38.111400 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:38.131067 27157 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:38.113915 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.120664 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.094913 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.087200 30470 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.091511 30491 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.137036 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:38.123129 27837 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:38.137905 27229 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.137844 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.138867 27151 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:38.137092 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:38.123032 27227 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:38.073254 30496 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:11:38.125173 27832 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:11:38.140352 27832 pending_rounds.cc:85] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 7
I20260709 13:11:38.140638 27832 pending_rounds.cc:107] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:38.125522 27838 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:38.125326 30499 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:11:38.126130 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:38.126240 30447 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.424s	user 0.007s	sys 0.004s
I20260709 13:11:38.126327 27223 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:38.126865 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:38.096112 30490 consensus_queue.cc:1243] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:38.140880 27832 raft_consensus.cc:2889] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:38.140964 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:38.149112 27226 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:38.058529 30426 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.112613 30346 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.135035 30445 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.153839 30429 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.073269 30369 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.157341 27227 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.157773 27155 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:38.123829 30405 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.058933 30389 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.125342 30147 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:38.196251 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.147053 30406 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.170933 30502 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:38.172303 30498 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:38.172679 30510 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.062083 30451 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.181100 27229 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:38.184454 27155 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:38.188618 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:38.231420 27836 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:38.150620 30370 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.002s
I20260709 13:11:38.147740 30491 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.236826 30310 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.236940 27231 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:38.237478 30310 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.239758 30310 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:38.241024 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.241789 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:38.164583 30425 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.205775 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:38.185230 30400 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.248624 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1888) took 1321 ms. Trace:
I20260709 13:11:38.249059 27225 rpcz_store.cc:276] 0709 13:11:36.927422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.965057 (+ 37635us) service_pool.cc:224] Handling call
0709 13:11:36.965369 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:36.986833 (+ 21464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.986913 (+    80us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:37.004835 (+ 17922us) log.cc:844] Serialized 52 byte log entry
0709 13:11:37.205149 (+200314us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:37.297998 (+ 92849us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.310189 (+ 12191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.310310 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.926278 (+615968us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:38.248336 (+322058us) raft_consensus.cc:1685] finished
0709 13:11:38.248436 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.248565 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91992,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1484,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":21273,"spinlock_wait_cycles":11009792,"thread_start_us":209487,"threads_started":2,"wal-append.queue_time_us":206881}
W20260709 13:11:38.226042 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 107672us
I20260709 13:11:38.206928 30429 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:38.206568 30147 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:38.212900 30433 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.001s
I20260709 13:11:38.251041 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.107297 30053 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.256834 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.262787 27226 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:38.264801 27836 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:38.264863 27157 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:38.156512 30403 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.198645 30312 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.269757 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 740) took 1952 ms. Trace:
I20260709 13:11:38.248446 30393 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:38.272629 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.272986 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:38.251811 30147 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.276889 27148 rpcz_store.cc:276] 0709 13:11:36.317726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.317859 (+   133us) service_pool.cc:224] Handling call
0709 13:11:36.318233 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.328125 (+  9892us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:36.328162 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.328717 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.548081 (+219364us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:36.548136 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.548208 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.928093 (+1379885us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:38.257075 (+328982us) raft_consensus.cc:1685] finished
0709 13:11:38.257098 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.269665 (+ 12567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23010,"raft.queue_time_us":875,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8185,"spinlock_wait_cycles":7104256,"thread_start_us":218942,"threads_started":1,"wal-append.queue_time_us":322117}
I20260709 13:11:38.255888 30425 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:38.292500 30489 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:11:38.255932 30502 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.293625 30502 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:38.296222 30502 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:38.273254 30485 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:11:38.265542 30498 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:38.298626 30498 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:38.213188 30406 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.284670 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.242415 30510 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:38.269009 30451 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:38.122706 30477 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.277202 30506 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:38.286799 27148 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:38.288278 30494 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.288386 30491 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.291049 30370 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:38.292104 30493 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:11:38.292390 30314 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 13:11:38.308799 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:38.279647 30429 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:11:38.268052 30146 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:38.351743 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 204989us
I20260709 13:11:38.352680 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:38.355487 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:38.366281 27148 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:38.223546 30431 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:38.376142 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67455.1us
I20260709 13:11:38.393957 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:38.406754 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:38.408041 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:38.409643 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:38.382661 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.383997 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:38.374658 30511 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:38.385362 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 951) took 1084 ms. Trace:
I20260709 13:11:38.385454 30509 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:38.386226 30514 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.301477 30498 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.388732 30520 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:11:38.380115 30412 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.887s	user 0.005s	sys 0.009s
I20260709 13:11:38.394383 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:38.457556 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63252.1us
I20260709 13:11:38.396031 30525 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:38.386922 30510 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.283847 30312 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:38.415417 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60054.5us
I20260709 13:11:38.415663 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:38.430639 27148 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.377399 30425 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:38.403398 30477 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.439790 30311 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:38.462325 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.463323 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:38.465910 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:38.490260 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:38.398756 30491 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:38.470399 27304 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:38.431939 30370 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:38.433058 30400 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:38.432843 30490 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:38.418207 30470 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:38.476457 27833 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:38.483650 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 68105.6us
I20260709 13:11:38.478878 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:38.384706 30314 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.339084 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.485939 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:38.488512 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 220798us
I20260709 13:11:38.491124 30515 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:38.431663 30042 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:11:38.468690 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.536582 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.373138 30494 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.495455 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:38.501245 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.483906 30511 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:38.538684 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.474610 30146 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:11:38.485708 30436 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:38.475363 30412 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.514818 27156 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
W20260709 13:11:38.516647 27122 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.738s (SENT) [suppressed 25 similar messages]
I20260709 13:11:38.538200 27304 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.501547 30370 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.564604 27225 pending_rounds.cc:85] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:38.615284 27225 pending_rounds.cc:107] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:38.615566 27225 raft_consensus.cc:2889] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:38.565331 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:38.509513 30510 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:11:38.568477 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:38.568737 27149 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:38.435218 27835 rpcz_store.cc:276] 0709 13:11:37.300646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.314702 (+ 14056us) service_pool.cc:224] Handling call
0709 13:11:37.399941 (+ 85239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.400418 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:37.400862 (+   444us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.293101 (+892239us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b180031fa80. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:11:38.372160 (+ 79059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.374620 (+  2460us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:38.376933 (+  2313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.385111 (+  8178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.385283 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7921,"prepare.queue_time_us":194,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":73741,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12602,"spinlock_wait_cycles":38152448,"thread_start_us":250934,"threads_started":2,"wal-append.queue_time_us":347187}
I20260709 13:11:38.571848 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.572388 27228 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:38.574602 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:38.541831 30368 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.004s
I20260709 13:11:38.499775 30521 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:38.578333 30531 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:38.513732 30513 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:11:38.579396 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.520566 30429 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:38.520403 30491 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:38.580075 30522 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:38.580670 30042 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:38.635336 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:38.578987 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88803.5us
I20260709 13:11:38.585206 30507 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:38.565769 30511 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:38.377238 30499 consensus_queue.cc:1175] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4afe81810944d70bc2cc31754392f3d" responder_term: 6 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:38.447690 30509 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.590631 30147 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.594944 30314 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:38.478358 30520 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:38.499365 30311 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:38.459014 30514 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:38.610605 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 93985us
W20260709 13:11:38.656996 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.609763 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.658469 27156 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
W20260709 13:11:38.659646 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.613106 30417 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.560s	user 0.005s	sys 0.006s
I20260709 13:11:38.617035 27227 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.539144 30490 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:11:38.621965 27224 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:38.584981 30515 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:38.626611 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:38.644405 30491 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:38.620266 30370 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:38.634657 30042 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:38.649828 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:38.681151 27228 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:38.650101 30470 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.628655 30506 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.633627 30406 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.660564 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:38.641942 30507 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.685281 30507 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.685520 30515 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.693894 30509 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:38.696617 30491 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.699004 30146 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:38.699477 30146 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:38.699841 30146 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:38.702391 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.689181 30374 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
I20260709 13:11:38.707839 27148 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:38.674665 27835 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:38.641070 27304 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:38.644601 30429 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:38.657680 30363 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.001s
W20260709 13:11:38.647631 30488 consensus_queue.cc:1175] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "897d8be8580141d1ad3bb17946d3da89" responder_term: 6 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:38.680751 30312 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.771989 27303 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:38.713048 27298 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:38.670792 27227 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
W20260709 13:11:38.724804 27305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1788) took 2322 ms (client timeout 1738 ms). Trace:
I20260709 13:11:38.769940 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:38.725646 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 80924.6us
I20260709 13:11:38.676678 30314 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:11:38.675072 30417 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:38.727649 27306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1794) took 2140 ms (client timeout 1984 ms). Trace:
W20260709 13:11:38.730021 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.738508 30517 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:11:38.732367 30042 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:38.752033 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.752728 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2766) took 1145 ms. Trace:
I20260709 13:11:38.690187 30470 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.690043 30506 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.777978 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:38.773636 27305 rpcz_store.cc:269] 0709 13:11:36.387628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.388351 (+   723us) service_pool.cc:224] Handling call
0709 13:11:38.709566 (+2321215us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b54000bb154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:38.709681 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96486272}
I20260709 13:11:38.777822 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:38.835773 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:38.780772 27297 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:38.769434 30430 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.002s
I20260709 13:11:38.782887 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:38.897234 27299 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:38.782485 27839 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:11:38.820504 27306 rpcz_store.cc:269] 0709 13:11:36.572127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.575407 (+  3280us) service_pool.cc:224] Handling call
0709 13:11:38.712546 (+2137139us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54003aa054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:38.712677 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183584000}
I20260709 13:11:38.824890 27153 rpcz_store.cc:276] 0709 13:11:37.606982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.607484 (+   502us) service_pool.cc:224] Handling call
0709 13:11:37.634450 (+ 26966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.084892 (+450442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.741000 (+656108us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400358754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:38.752646 (+ 11646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027182336}
I20260709 13:11:38.828929 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.713405 30374 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.714111 30405 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:38.932888 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:38.957430 27305 raft_consensus.cc:2376] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
I20260709 13:11:38.783196 30508 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:38.778203 30363 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:38.967011 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 430497us
I20260709 13:11:38.974100 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:38.869763 30426 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.978875 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:38.980042 27153 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:38.986258 27151 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:38.938540 30042 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.001260 27835 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:38.985049 30413 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.060s	user 0.012s	sys 0.001s
I20260709 13:11:39.007222 27152 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:39.015970 27839 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:38.932788 30314 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:11:39.020090 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:38.986014 30508 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:39.031674 27839 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:39.033185 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:39.002274 30147 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.006269 30403 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:39.036190 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:38.930323 30430 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.012138 30511 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:38.983938 30389 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:39.021332 30391 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:39.047757 30546 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:11:39.048461 30540 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 13:11:39.041142 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 213070us
W20260709 13:11:39.046849 30538 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:11:38.991233 30426 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.026196 30514 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.039849 30403 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.021122 30413 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:39.056815 30537 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:11:39.068766 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:39.013255 30429 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:39.064891 30427 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.916s	user 0.004s	sys 0.010s
I20260709 13:11:39.097445 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.114568 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:39.097944 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.088408 30403 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:39.102824 30506 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.103946 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.118507 27840 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:39.120826 30496 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.113090 30391 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:39.121834 30496 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.117311 27302 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:39.107442 30435 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:39.127470 30435 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:39.122203 30470 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.130136 30496 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.068632 30520 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:39.131939 27839 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:39.132637 27297 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:39.131994 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.133215 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:39.133762 27148 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:39.134671 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:39.135329 27839 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.137684 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:39.139335 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:11:39.119674 30548 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:39.109306 30374 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:39.131072 30541 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:11:39.148861 27120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.032s	sys 0.041s
W20260709 13:11:39.150821 27120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.032s	sys 0.041s
I20260709 13:11:39.151278 30512 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.151885 30549 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:11:39.122753 30391 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.155061 27305 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:39.096222 30508 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.157557 30253 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:39.151849 30512 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.159327 27839 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:39.160820 30512 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.148005 30520 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:11:39.123915 30427 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.167343 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:39.179327 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 756) took 1195 ms. Trace:
I20260709 13:11:39.147733 30498 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:39.205107 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.208384 27155 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:39.148589 30496 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:39.192037 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:39.189184 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.192281 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:39.185441 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 960) took 1877 ms. Trace:
I20260709 13:11:39.183719 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1257) took 1028 ms. Trace:
W20260709 13:11:39.213644 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46441.6us
I20260709 13:11:39.176486 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:39.192991 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 748) took 1275 ms. Trace:
I20260709 13:11:39.184758 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2138) took 1796 ms. Trace:
I20260709 13:11:39.214884 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.220901 27148 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.220703 27149 rpcz_store.cc:276] 0709 13:11:37.917800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.073677 (+155877us) service_pool.cc:224] Handling call
0709 13:11:39.192770 (+1119093us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400171454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:39.192926 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068019584}
I20260709 13:11:39.221900 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:39.222054 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.182981 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:39.149811 30542 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:39.213178 27151 rpcz_store.cc:276] 0709 13:11:37.984184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.166547 (+182363us) service_pool.cc:224] Handling call
0709 13:11:38.166874 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.986731 (+819857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.179011 (+192280us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54000677d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:39.179246 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883903744}
I20260709 13:11:39.223708 27834 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
I20260709 13:11:39.219480 27833 rpcz_store.cc:276] 0709 13:11:37.307668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.501023 (+193355us) service_pool.cc:224] Handling call
0709 13:11:37.501311 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.513941 (+1012630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.185199 (+671258us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b5400336b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:39.185379 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242051328}
I20260709 13:11:39.220326 27835 rpcz_store.cc:276] 0709 13:11:38.154883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.769058 (+614175us) service_pool.cc:224] Handling call
0709 13:11:38.769390 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.001862 (+232472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.183491 (+181629us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540057f3d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:39.183661 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508303232}
I20260709 13:11:39.154413 30417 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.225376 27806 leader_election.cc:400] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
W20260709 13:11:39.291350 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.313814 27806 leader_election.cc:403] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:39.205843 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 745) took 1290 ms. Trace:
I20260709 13:11:39.310762 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.221092 27298 rpcz_store.cc:276] 0709 13:11:37.388553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.389054 (+   501us) service_pool.cc:224] Handling call
0709 13:11:38.712684 (+1323630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.773444 (+ 60760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.184576 (+411132us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54003aa050. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:39.184700 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994802048}
I20260709 13:11:39.314960 27300 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:39.169693 30430 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.315784 27156 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:39.316356 30512 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.314695 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:39.316947 30512 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.317786 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:39.319085 30519 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.965s	user 0.007s	sys 0.000s
I20260709 13:11:39.319427 27835 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:39.319886 30512 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.321569 30554 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.322643 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2762) took 1731 ms. Trace:
I20260709 13:11:39.194365 30259 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:39.291474 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.311915 27834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 950) took 2011 ms (client timeout 1685 ms). Trace:
I20260709 13:11:39.167076 30405 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.224754 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.323717 27835 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:39.199111 30369 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.314455 27152 rpcz_store.cc:276] 0709 13:11:37.915056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.915233 (+   177us) service_pool.cc:224] Handling call
0709 13:11:37.915592 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.013896 (+1098304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.205515 (+191619us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400067cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:39.205766 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499053952}
W20260709 13:11:39.325079 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99799.8us
W20260709 13:11:39.182809 30533 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:39.311196 30436 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:39.360513 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:39.183427 30413 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.195272 30435 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:39.328066 27834 rpcz_store.cc:269] 0709 13:11:37.300302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.300581 (+   279us) service_pool.cc:224] Handling call
0709 13:11:39.182806 (+1882225us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:39.311802 (+128996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16415616}
I20260709 13:11:39.327507 30514 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5.
I20260709 13:11:39.335878 27122 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:39.191697 30431 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:39.325482 30541 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:39.340168 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1904) took 1223 ms. Trace:
I20260709 13:11:39.390187 27223 rpcz_store.cc:276] 0709 13:11:38.117086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.148494 (+ 31408us) service_pool.cc:224] Handling call
0709 13:11:38.185964 (+ 37470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.211705 (+ 25741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.211749 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.212307 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.354450 (+142143us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:38.354490 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.354585 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.318366 (+963781us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:39.326330 (+  7964us) raft_consensus.cc:1685] finished
0709 13:11:39.326364 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.340078 (+ 13714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25192,"raft.queue_time_us":25343,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":30295808,"thread_start_us":141767,"threads_started":1,"wal-append.queue_time_us":141602}
I20260709 13:11:39.222956 30510 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:39.339242 30509 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.323086 27154 rpcz_store.cc:276] 0709 13:11:37.590921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.591189 (+   268us) service_pool.cc:224] Handling call
0709 13:11:37.594876 (+  3687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.966530 (+371654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.322380 (+1355850us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54000686d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:39.322573 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718682496}
I20260709 13:11:39.163828 30391 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.192931 30308 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:11:39.197234 30249 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 13:11:39.353793 27148 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:39.354766 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.355410 27149 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:39.227443 30324 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:39.227095 30389 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:39.193179 30281 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
W20260709 13:11:39.363903 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 138421us
I20260709 13:11:39.227975 30498 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:39.398021 30370 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.005s
I20260709 13:11:39.327812 30259 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:39.322320 30554 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.223742 30496 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.313205 30465 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:39.367839 30549 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.412822 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:39.410444 30520 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.413589 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.369922 30405 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:39.168023 30513 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.343252 30417 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:11:39.416007 30426 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:39.419703 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44633.6us
I20260709 13:11:39.389056 30147 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:11:39.395388 30413 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:11:39.419771 30146 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.000s
I20260709 13:11:39.460107 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.449227 30496 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.446511 30510 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:39.422534 30557 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:39.474778 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:39.477021 27154 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.422808 30324 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:39.457098 29995 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:39.456101 30259 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.480418 30259 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.466506 30146 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.405441 30431 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:39.417088 30253 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:11:39.415568 30509 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.420778 30370 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.461263 30520 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.503851 27154 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:39.466042 30560 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:11:39.459992 30549 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.468628 30513 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.522943 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.524250 30513 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.493322 29995 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:39.531065 29995 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.531431 30499 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.514865 30427 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.507519 30146 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:39.540066 27123 leader_election.cc:336] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.829s (SENT)
I20260709 13:11:39.493700 30498 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.524263 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:39.539350 30499 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.539110 30554 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.551041 30436 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:39.559262 30451 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.211s	user 0.009s	sys 0.006s
I20260709 13:11:39.551463 30436 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:39.562201 27154 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.536206 30510 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.560015 30360 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.539743 30324 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.573230 30370 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:39.578354 30524 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.225s	user 0.006s	sys 0.005s
I20260709 13:11:39.575739 30391 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.582175 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:39.585696 27838 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:39.569877 30507 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.004s
I20260709 13:11:39.589947 27151 raft_consensus.cc:2393] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:39.560815 30491 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.595523 30507 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.601811 30391 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.605010 27838 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:39.608311 27838 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:39.611140 27838 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:39.596275 30549 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.615437 27838 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:39.625751 27154 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:39.630245 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.598771 30491 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.612848 30499 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.643039 30509 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.607066 30436 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.644472 30436 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.619024 30450 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.617455 30374 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:39.630113 30281 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:39.658955 30281 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:39.659427 30281 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:39.632169 30431 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:39.665760 30507 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:39.669157 30477 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.176s	user 0.012s	sys 0.002s
I20260709 13:11:39.669914 27230 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:39.670351 30499 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.670985 30499 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:39.676414 30403 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.006s
I20260709 13:11:39.676894 30389 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:39.676954 30403 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.657454 30374 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:39.680423 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.682575 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:39.686647 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:39.677474 30389 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:39.660480 30281 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.698118 30281 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.708057 30417 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:39.708554 30417 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:39.709504 30417 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.710752 30417 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:39.711885 30491 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.712178 27839 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:39.714361 27839 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:39.715667 27839 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:39.716979 27839 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:11:39.718317 27839 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:39.719481 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:39.722074 30530 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.112s	user 0.003s	sys 0.006s
I20260709 13:11:39.723551 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1254) took 1586 ms. Trace:
I20260709 13:11:39.723980 27836 rpcz_store.cc:276] 0709 13:11:38.137361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.345099 (+207738us) service_pool.cc:224] Handling call
0709 13:11:38.377235 (+ 32136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.377519 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.377547 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.401757 (+ 24210us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.490172 (+ 88415us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:38.490212 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.490291 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.718133 (+1227842us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:39.723167 (+  5034us) raft_consensus.cc:1685] finished
0709 13:11:39.723198 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.723476 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12712192,"thread_start_us":15944,"threads_started":1,"wal-append.queue_time_us":82759}
I20260709 13:11:39.726356 27154 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:39.692085 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.646667 30450 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.734972 30057 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:39.736891 27838 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:39.735289 30389 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:39.757313 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 70824.7us
I20260709 13:11:39.758688 27232 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:39.758824 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:39.760929 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 78450.5us
I20260709 13:11:39.766184 27227 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:11:39.746897 30412 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:39.829077 27223 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:39.761955 30311 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:39.835738 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:39.836289 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.836781 30311 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:39.837216 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:39.837996 30311 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:39.838459 30311 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:39.838877 30311 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.839083 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2775) took 1676 ms. Trace:
I20260709 13:11:39.839347 30435 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.839923 27231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1897) took 1726 ms (client timeout 1829 ms). Trace:
I20260709 13:11:39.840049 30435 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:39.840523 27231 rpcz_store.cc:269] 0709 13:11:38.113547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.113672 (+   125us) service_pool.cc:224] Handling call
0709 13:11:39.839719 (+1726047us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540037b754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:39.839828 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240494848}
I20260709 13:11:39.843111 27834 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 6 LEARNER]: Advancing to term 7
I20260709 13:11:39.839560 27157 rpcz_store.cc:276] 0709 13:11:38.162357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.266420 (+104063us) service_pool.cc:224] Handling call
0709 13:11:38.266870 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.267483 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.268273 (+   790us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.268858 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.418265 (+1149407us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b1800309220. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:11:39.452071 (+ 33806us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:39.453046 (+   975us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.838686 (+385640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.838765 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.838820 (+    55us) raft_consensus.cc:1685] finished
0709 13:11:39.838895 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.839026 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17635,"prepare.queue_time_us":2035,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":50277,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":21193,"spinlock_wait_cycles":9438080,"thread_start_us":413161,"threads_started":2,"wal-append.queue_time_us":1266906}
I20260709 13:11:39.773751 30146 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:39.849324 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.847028 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:39.851783 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:39.868453 30496 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:39.869787 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.744841 30431 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:11:39.772133 30393 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:39.876215 27834 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:39.887037 27227 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:39.772256 30369 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.746452 30559 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:39.764786 30310 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:39.790653 30507 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.792371 30430 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:39.792553 30370 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.881804 30389 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:39.898242 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.899572 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.882081 30146 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.902621 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.888155 30491 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:39.903350 30491 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.903743 30491 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:39.903753 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.904307 30146 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.838932 30569 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:11:39.883457 30477 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.911999 30431 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:39.931012 30431 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:39.930631 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.933626 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.934407 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.935006 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:39.931870 30431 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.938748 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.935173 27300 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:39.933426 30311 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.865657 27154 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:39.943089 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.944904 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.946614 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.947702 27304 raft_consensus.cc:2410] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:39.948937 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.949313 27299 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:11:39.949792 27299 pending_rounds.cc:85] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 10
I20260709 13:11:39.950126 27299 pending_rounds.cc:107] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:11:39.950223 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.950493 27299 raft_consensus.cc:2889] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.912228 30249 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.945472 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:39.928822 30435 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:39.792834 30395 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:39.928833 30363 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:39.952086 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:39.958041 27227 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:39.901309 30370 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.940361 30431 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:39.980171 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.982849 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:39.901678 30430 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.953835 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.977237 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:39.977499 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:39.906423 30507 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.990558 27303 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:39.921044 30477 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.893071 30429 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.976413 30146 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:39.974702 30436 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.958124 30393 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:39.976257 30403 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.002118 27301 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:40.003129 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 682) took 2166 ms. Trace:
I20260709 13:11:40.003516 27301 rpcz_store.cc:276] 0709 13:11:37.836758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.967772 (+131014us) service_pool.cc:224] Handling call
0709 13:11:37.968255 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.001814 (+2033559us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5400498520. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:11:40.002718 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.003051 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71232768}
I20260709 13:11:39.999030 30368 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:39.976058 30249 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:39.976068 30369 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.015420 30311 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.015556 30370 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.016108 30146 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:40.035430 30146 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.008033 30436 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.041966 30436 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.000005 30435 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:11:40.009230 30281 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:40.018216 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:40.043298 27301 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.044288 30393 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.005772 30057 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:40.019985 27837 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:40.031440 30249 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.032117 27306 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:40.033861 30369 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.046496 30057 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.048341 30057 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.049690 30057 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:40.052568 27301 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:40.054140 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:40.055104 30311 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:40.055667 30311 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:40.056623 30311 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:39.987427 30395 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.066824 27305 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:40.063741 30281 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.069399 27303 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:40.002565 30429 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.097358 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:40.103329 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.023s
W20260709 13:11:40.103859 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.024s
W20260709 13:11:40.104211 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 532253us
W20260709 13:11:40.105530 27832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.023s
W20260709 13:11:40.105928 27832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.005s	sys 0.023s
I20260709 13:11:40.082167 30369 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.083222 30445 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:40.099699 30496 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.113374 30525 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:40.142872 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.143721 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.125025 30249 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:40.122517 30488 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.146013 30488 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.122237 30563 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.155160 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:40.140544 30496 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.158509 30397 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:40.161288 30496 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.123600 30369 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.162523 30506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.004s	sys 0.030s
I20260709 13:11:40.153410 30525 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:40.149269 30370 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.150975 30395 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.147804 30508 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.154388 30450 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.165464 30430 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:40.178432 30506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.005s	sys 0.030s
I20260709 13:11:40.137465 30281 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.190320 30511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.008s	sys 0.019s
I20260709 13:11:40.182025 30429 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:40.214092 30510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.016s
I20260709 13:11:40.177778 30491 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.211714 30477 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:40.221254 30492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.022s
I20260709 13:11:40.160717 30563 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.222201 30511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.009s	sys 0.019s
I20260709 13:11:40.189777 30508 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.230211 30492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.010s	sys 0.022s
I20260709 13:11:40.264189 30508 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:40.313349 30570 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:11:40.323307 30577 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:40.327282 30563 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.337710 30559 consensus_queue.cc:1243] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:40.374883 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:40.380403 27148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.023s	sys 0.009s
W20260709 13:11:40.381243 27148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.023s	sys 0.009s
W20260709 13:11:40.381713 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.383245 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 768) took 1027 ms. Trace:
W20260709 13:11:40.383745 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.386435 27149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.004s	sys 0.014s
W20260709 13:11:40.386996 27149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.014s
I20260709 13:11:40.388440 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 771) took 1032 ms. Trace:
W20260709 13:11:40.390825 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.383838 27148 rpcz_store.cc:276] 0709 13:11:39.355209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.410233 (+ 55024us) service_pool.cc:224] Handling call
0709 13:11:39.410609 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.519541 (+108932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.519574 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.536536 (+ 16962us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.382187 (+845651us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:40.382352 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.382537 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.382628 (+    91us) raft_consensus.cc:1685] finished
0709 13:11:40.382675 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.383079 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37339,"raft.queue_time_us":78434,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":14800,"thread_start_us":884718,"threads_started":2,"wal-append.queue_time_us":761746}
I20260709 13:11:40.394768 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:40.388888 27149 rpcz_store.cc:276] 0709 13:11:39.356137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.411583 (+ 55446us) service_pool.cc:224] Handling call
0709 13:11:39.411876 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:39.622388 (+210512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.622436 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:39.631751 (+  9315us) log.cc:844] Serialized 52 byte log entry
0709 13:11:40.387795 (+756044us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:40.387912 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.388037 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.388090 (+    53us) raft_consensus.cc:1685] finished
0709 13:11:40.388106 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.388378 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39930,"raft.queue_time_us":83072,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5036,"thread_start_us":813701,"threads_started":2,"wal-append.queue_time_us":574784}
I20260709 13:11:40.397228 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:40.397287 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:40.402798 27149 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:40.409101 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:40.412835 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 254825us
I20260709 13:11:40.419040 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:40.420682 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:40.423039 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:40.431739 27836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.003s	sys 0.021s
W20260709 13:11:40.432322 27836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.003s	sys 0.021s
W20260709 13:11:40.482296 27839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.015s	sys 0.008s
W20260709 13:11:40.483107 27839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.016s	sys 0.008s
I20260709 13:11:40.265611 30525 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.490278 30426 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.491648 30426 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.494184 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2786) took 1070 ms. Trace:
I20260709 13:11:40.494822 27154 rpcz_store.cc:276] 0709 13:11:39.419027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.959454 (+540427us) service_pool.cc:224] Handling call
0709 13:11:39.959848 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.083710 (+123862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.084165 (+   455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.084239 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:40.084301 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.489468 (+405167us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:40.489557 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.489918 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284139776}
I20260709 13:11:40.496434 30369 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.496909 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:40.497658 27148 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:40.500686 27226 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:11:40.503827 27838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.000s	sys 0.021s
W20260709 13:11:40.504424 27838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.000s	sys 0.021s
W20260709 13:11:40.506263 30324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.015s
W20260709 13:11:40.506881 30324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.007s	sys 0.015s
I20260709 13:11:40.506724 30389 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.508419 30310 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.508329 30389 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.509274 30310 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:40.226881 30510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.013s	sys 0.016s
I20260709 13:11:40.521857 30389 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.523907 30559 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:40.524652 30559 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.525286 30559 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.526504 30497 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.527673 27152 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.527783 30497 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.528949 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2790) took 1077 ms. Trace:
I20260709 13:11:40.530864 30477 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.531339 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2774) took 2369 ms. Trace:
I20260709 13:11:40.531966 27155 rpcz_store.cc:276] 0709 13:11:38.162029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.231633 (+ 69604us) service_pool.cc:224] Handling call
0709 13:11:39.208051 (+976418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.217278 (+  9227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.530726 (+1313448us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400171450. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:40.531083 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199091456}
I20260709 13:11:40.532941 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1814) took 1465 ms. Trace:
I20260709 13:11:40.533486 27297 rpcz_store.cc:276] 0709 13:11:39.067594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.068273 (+   679us) service_pool.cc:224] Handling call
0709 13:11:40.532503 (+1464230us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54002dc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:40.532709 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38366592}
W20260709 13:11:40.535786 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 106147us
I20260709 13:11:40.535682 30498 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.542490 30395 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.543516 30395 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.544037 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:40.543517 30498 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.547827 30397 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:40.548946 30397 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:40.550362 30450 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.551196 30450 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.552066 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1253) took 2418 ms. Trace:
I20260709 13:11:40.552201 30498 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.529454 27152 rpcz_store.cc:276] 0709 13:11:39.452003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.526152 (+1074149us) service_pool.cc:224] Handling call
0709 13:11:40.527011 (+   859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.528575 (+  1564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.528850 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:40.552524 27840 rpcz_store.cc:276] 0709 13:11:38.133148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.298958 (+165810us) service_pool.cc:224] Handling call
0709 13:11:38.299329 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.119055 (+819726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.551483 (+1432428us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54006c02d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:40.551855 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883268864}
I20260709 13:11:40.547504 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2241) took 1075 ms. Trace:
I20260709 13:11:40.556577 27152 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.557085 27841 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:40.554541 27155 rpcz_store.cc:276] 0709 13:11:39.472222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.533494 (+1061272us) service_pool.cc:224] Handling call
0709 13:11:40.546464 (+ 12970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.546984 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.547022 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.547117 (+    95us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:40.547180 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.547246 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.547382 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:40.175601 29995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.032s	sys 0.033s
W20260709 13:11:40.518405 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 98281.9us
I20260709 13:11:40.562106 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:40.549753 30397 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:40.474457 30368 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.531461 30477 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.186568 30370 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.553956 30450 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:40.549760 30041 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:40.572520 30491 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.574597 30397 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.581250 30477 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.622010 27152 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:40.589406 30041 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.625211 27839 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:40.635880 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.643330 27151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.012s	sys 0.011s
W20260709 13:11:40.646715 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.648317 30389 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.649147 30389 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.650161 27225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.007s	sys 0.023s
W20260709 13:11:40.650573 27225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.007s	sys 0.023s
I20260709 13:11:40.652426 30389 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:40.654423 27841 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.656426 30041 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.658932 30397 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.661052 30397 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.662443 30496 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:40.664359 27832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.023s
W20260709 13:11:40.664481 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.664783 27832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.001s	sys 0.023s
I20260709 13:11:40.666864 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 976) took 1640 ms. Trace:
I20260709 13:11:40.667361 27832 rpcz_store.cc:276] 0709 13:11:39.025956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.592893 (+566937us) service_pool.cc:224] Handling call
0709 13:11:39.593252 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.593529 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:40.106426 (+512897us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.665852 (+559426us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.666129 (+   277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.666210 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:40.666341 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.666475 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.666745 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637856,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":4995,"raft.queue_time_us":202,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":222,"thread_start_us":1066888,"threads_started":2}
W20260709 13:11:40.670181 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.017s	sys 0.014s
W20260709 13:11:40.670650 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.017s	sys 0.014s
I20260709 13:11:40.670380 30324 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:40.671183 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 686180us
W20260709 13:11:40.646848 30146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.000s	sys 0.021s
I20260709 13:11:40.662478 27840 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:40.670179 27198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.017s	sys 0.006s
W20260709 13:11:40.680127 27151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.013s	sys 0.011s
W20260709 13:11:40.669906 27157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.013s	sys 0.036s
W20260709 13:11:40.683642 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.673187 27304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.013s	sys 0.020s
W20260709 13:11:40.681316 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 113337us
W20260709 13:11:40.677430 29995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.033s	sys 0.033s
W20260709 13:11:40.682921 27198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.018s	sys 0.006s
I20260709 13:11:40.641171 30395 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.679512 30324 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:40.690841 27304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.014s	sys 0.021s
I20260709 13:11:40.696223 30374 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.696573 30370 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:40.698693 30389 raft_consensus.cc:670] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } [suppressed 4 similar messages]
W20260709 13:11:40.689388 27157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.014s	sys 0.036s
I20260709 13:11:40.711683 27224 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.712226 30041 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:40.717563 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:40.713933 30431 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.016s
I20260709 13:11:40.725046 30494 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.733109 30370 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.734323 27227 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.734380 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:40.736418 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2780) took 1318 ms. Trace:
I20260709 13:11:40.736748 30598 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.637728 30368 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.721232 27149 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:40.719537 27839 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:40.758931 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2788) took 1311 ms. Trace:
I20260709 13:11:40.759316 27149 rpcz_store.cc:276] 0709 13:11:39.447587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.572767 (+1125180us) service_pool.cc:224] Handling call
0709 13:11:40.639593 (+ 66826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.758621 (+119028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.758844 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:40.740370 27833 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:40.692761 30324 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.761010 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2784) took 1342 ms. Trace:
I20260709 13:11:40.740586 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 720) took 2177 ms. Trace:
I20260709 13:11:40.743644 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:40.750496 30559 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:40.763309 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.013s	sys 0.015s
I20260709 13:11:40.767611 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:40.768088 30598 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.762740 27229 rpcz_store.cc:276] 0709 13:11:38.563273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.563420 (+   147us) service_pool.cc:224] Handling call
0709 13:11:38.566470 (+  3050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.738589 (+2172119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.738634 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.738684 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:40.738719 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.740099 (+  1380us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400391cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:40.740146 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.740335 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4994214272}
W20260709 13:11:40.761478 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 980) took 1618 ms (client timeout 2041 ms). Trace:
I20260709 13:11:40.768889 27228 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:40.771289 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.014s	sys 0.015s
W20260709 13:11:40.770363 27833 rpcz_store.cc:269] 0709 13:11:39.143424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.312685 (+169261us) service_pool.cc:224] Handling call
0709 13:11:40.543608 (+1230923us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:40.761197 (+217589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5059840}
I20260709 13:11:40.773675 27841 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:40.773993 30575 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.771414 27228 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:40.742545 30417 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:40.775336 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:40.744817 30497 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.774901 30575 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.743867 30520 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.738029 30499 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.761475 27151 rpcz_store.cc:276] 0709 13:11:39.418685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.940438 (+521753us) service_pool.cc:224] Handling call
0709 13:11:39.989138 (+ 48700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.989400 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:40.718599 (+729199us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.760495 (+ 41896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.760589 (+    94us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:40.760682 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.760803 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.760950 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":238,"thread_start_us":695087,"threads_started":2}
I20260709 13:11:40.776368 27228 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.777647 27122 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:40.755338 27157 rpcz_store.cc:276] 0709 13:11:39.417692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.847668 (+429976us) service_pool.cc:224] Handling call
0709 13:11:39.847974 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.848402 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.848428 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.868634 (+ 20206us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.735883 (+867249us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:40.735990 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.736086 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.736159 (+    73us) raft_consensus.cc:1685] finished
0709 13:11:40.736172 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.736352 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673,"raft.queue_time_us":103,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11987,"spinlock_wait_cycles":1731456,"thread_start_us":831367,"threads_started":1,"wal-append.queue_time_us":831096}
I20260709 13:11:40.822081 30431 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:40.824270 27223 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:40.823992 30431 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.827080 30431 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:40.830813 27232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1901) took 2715 ms (client timeout 2147 ms). Trace:
W20260709 13:11:40.831264 27232 rpcz_store.cc:269] 0709 13:11:38.115579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.115683 (+   104us) service_pool.cc:224] Handling call
0709 13:11:40.830343 (+2714660us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001261d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:40.830552 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3676195584}
W20260709 13:11:40.818399 27196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.018s	sys 0.042s
W20260709 13:11:40.853411 27196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.019s	sys 0.043s
I20260709 13:11:40.835508 27297 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:40.761998 30324 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.859745 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.870925 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 115012us
W20260709 13:11:40.869783 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 92661.7us
I20260709 13:11:40.861873 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:40.906558 27231 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:40.862380 30499 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.923317 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 146708us
I20260709 13:11:40.923712 27228 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.906395 30520 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:40.864645 30370 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.909940 29995 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.906096 30575 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.939445 30598 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:40.942265 30393 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:40.943188 30393 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:40.948139 30368 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:40.948673 30494 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:40.945266 27303 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:40.949448 30494 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.945405 30499 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.945232 30497 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:40.952719 30499 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.945322 30425 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.931197 30520 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:40.958549 30494 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:40.962750 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:40.965512 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1261) took 1773 ms. Trace:
I20260709 13:11:40.932528 30559 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:40.935755 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:40.973778 27299 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:40.976147 30364 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:40.977969 30597 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:40.978729 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2783) took 1215 ms. Trace:
I20260709 13:11:40.978889 30597 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.979219 27224 rpcz_store.cc:276] 0709 13:11:39.763727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.766393 (+  2666us) service_pool.cc:224] Handling call
0709 13:11:39.826994 (+ 60601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.712336 (+885342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.977914 (+265578us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001b9c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:40.978585 (+   671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033280896}
I20260709 13:11:40.981695 30597 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:40.976716 30364 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:40.968319 30520 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:40.983340 27840 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:40.953971 30053 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:40.956085 30057 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:40.993484 30364 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:40.990269 29995 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:40.998715 30588 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.263s	user 0.005s	sys 0.000s
I20260709 13:11:41.000164 29995 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.003661 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2235) took 2639 ms. Trace:
I20260709 13:11:41.004222 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2780) took 1241 ms. Trace:
I20260709 13:11:40.980077 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:41.004101 27156 rpcz_store.cc:276] 0709 13:11:38.364059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.660199 (+296140us) service_pool.cc:224] Handling call
0709 13:11:38.660501 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.316241 (+655740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.003040 (+1686799us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003e0b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:41.003455 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503364352}
I20260709 13:11:40.970909 30499 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:41.004760 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2779) took 1587 ms. Trace:
W20260709 13:11:41.010701 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45104.2us
I20260709 13:11:40.966023 27838 rpcz_store.cc:276] 0709 13:11:39.191737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.626382 (+434645us) service_pool.cc:224] Handling call
0709 13:11:39.626728 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.736743 (+110015us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:39.791058 (+ 54315us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.505982 (+714924us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.565165 (+ 59183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.572252 (+  7087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:40.579933 (+  7681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.965180 (+385247us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400646254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:40.965240 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.965445 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":341,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":7694,"spinlock_wait_cycles":252425984,"thread_start_us":713468,"threads_started":1,"wal-append.queue_time_us":485291}
I20260709 13:11:40.954378 30425 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.016640 30281 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.016387 30417 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:41.019536 30417 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.019963 30417 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.021200 30417 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.014844 30497 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.025050 30497 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.026583 30557 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:41.027493 30497 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.029158 30608 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:41.028793 30477 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.017442 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.004745 27225 rpcz_store.cc:276] 0709 13:11:39.762662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.764378 (+  1716us) service_pool.cc:224] Handling call
0709 13:11:39.764738 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.765128 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:39.848520 (+ 83392us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.651177 (+802657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.651923 (+   746us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.652107 (+   184us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:40.652140 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.652261 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.997355 (+345094us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:41.002474 (+  5119us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18004319e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:11:41.003994 (+  1520us) raft_consensus.cc:1685] finished
0709 13:11:41.004020 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.004152 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103196,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":37385,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":46580,"spinlock_wait_cycles":106122624,"thread_start_us":757914,"threads_started":1,"wal-append.queue_time_us":804504}
I20260709 13:11:41.033833 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:41.034927 30499 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:41.035665 27230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1900) took 2921 ms (client timeout 1670 ms). Trace:
I20260709 13:11:41.039170 30425 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:41.039413 30609 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:11:41.036165 27230 rpcz_store.cc:269] 0709 13:11:38.114567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.115272 (+   705us) service_pool.cc:224] Handling call
0709 13:11:41.035283 (+2920011us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000956d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:41.035456 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3543359744}
I20260709 13:11:41.016752 30393 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:41.014151 30368 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:11:41.044075 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1818) took 1113 ms. Trace:
I20260709 13:11:41.011237 27153 rpcz_store.cc:276] 0709 13:11:39.417513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.835303 (+417790us) service_pool.cc:224] Handling call
0709 13:11:39.835682 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.895561 (+ 59879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.895593 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.896166 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.386190 (+490024us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:40.386336 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.004132 (+617796us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54000de654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:41.004183 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.004267 (+    84us) raft_consensus.cc:1685] finished
0709 13:11:41.004277 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.004554 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1350,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5402,"spinlock_wait_cycles":136665344,"thread_start_us":489242,"threads_started":1,"wal-append.queue_time_us":442220}
I20260709 13:11:41.044104 30042 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:41.045989 27298 rpcz_store.cc:276] 0709 13:11:39.929624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.929931 (+   307us) service_pool.cc:224] Handling call
0709 13:11:39.931448 (+  1517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.931798 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.931830 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.536806 (+604976us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:40.537727 (+   921us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.681361 (+143634us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:40.686815 (+  5454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.692664 (+  5849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.038370 (+345706us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:41.042351 (+  3981us) raft_consensus.cc:1685] finished
0709 13:11:41.042377 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.042543 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45112,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10500,"spinlock_wait_cycles":30566016,"thread_start_us":117163,"threads_started":1,"wal-append.queue_time_us":233742}
I20260709 13:11:41.049451 30042 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.049345 30397 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:11:41.050922 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.064131 30397 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.050172 30557 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:41.064610 30397 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.065001 30557 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:41.065636 30557 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:41.066092 30488 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.065940 30397 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.067674 30397 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.053423 30042 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:41.055133 30310 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.001s
I20260709 13:11:41.070951 30042 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.070899 30310 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.072459 30507 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.057413 30619 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:41.062835 30370 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.074747 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1826) took 1087 ms. Trace:
I20260709 13:11:41.075559 30417 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.075207 27304 rpcz_store.cc:276] 0709 13:11:39.987501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.989470 (+  1969us) service_pool.cc:224] Handling call
0709 13:11:39.990397 (+   927us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:40.717262 (+726865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.717329 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:40.827671 (+110342us) log.cc:844] Serialized 598 byte log entry
0709 13:11:40.862666 (+ 34995us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.862728 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.867655 (+  4927us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.074428 (+206773us) raft_consensus.cc:1685] finished
0709 13:11:41.074449 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.074680 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34780,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8983,"thread_start_us":736201,"threads_started":2,"wal-append.queue_time_us":160300}
I20260709 13:11:41.078552 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.087975 30426 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:41.088843 30611 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:11:41.091564 30370 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:41.092207 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 133372us
I20260709 13:11:41.094329 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:41.095422 30488 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.096779 30365 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:11:41.097777 30605 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.264s	user 0.004s	sys 0.000s
W20260709 13:11:41.099660 30613 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:11:41.093021 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.102875 30512 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.103261 30512 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:41.104333 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.104408 30512 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.105265 27148 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.105782 30512 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.106526 27157 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:41.105367 27156 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:41.110529 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.107184 27151 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:41.111119 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1270) took 1342 ms. Trace:
I20260709 13:11:41.111912 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.111481 27834 rpcz_store.cc:276] 0709 13:11:39.768894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.885848 (+116954us) service_pool.cc:224] Handling call
0709 13:11:39.897639 (+ 11791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.008385 (+110746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.008436 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.008502 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.008553 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.110672 (+1102119us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400477cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:41.110749 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.110925 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253982080}
I20260709 13:11:41.100826 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a6d314618684d688b91fe535777e47b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46398
I20260709 13:11:41.109408 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.114275 27230 raft_consensus.cc:606] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:11:41.114581 27153 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:41.114861 27230 raft_consensus.cc:614] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:41.119818 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.120812 27304 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:11:41.128089 27837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 975) took 2102 ms (client timeout 1864 ms). Trace:
I20260709 13:11:41.129235 27305 pending_rounds.cc:85] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 7
I20260709 13:11:41.129645 27305 pending_rounds.cc:107] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:41.129681 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 769) took 2106 ms. Trace:
I20260709 13:11:41.130020 27305 raft_consensus.cc:2889] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.130167 27835 rpcz_store.cc:276] 0709 13:11:39.023237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.337847 (+314610us) service_pool.cc:224] Handling call
0709 13:11:41.127885 (+1790038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.128253 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.128279 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.128317 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:41.128360 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.128435 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.129355 (+   920us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400661a50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:41.129485 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4115495296}
I20260709 13:11:41.131104 30360 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.131187 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:41.132663 27103 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9bc1278c649846e998b312b374274d08 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:41.132848 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:41.133152 27103 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:11:41.132998 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.133709 27151 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:41.133733 27149 raft_consensus.cc:2410] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:41.134617 30477 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.135068 27103 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:11:41.137758 30477 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:41.138371 30431 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.139683 27298 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:11:41.128623 27837 rpcz_store.cc:269] 0709 13:11:39.025681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.035953 (+ 10272us) service_pool.cc:224] Handling call
0709 13:11:41.127612 (+2091659us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400661a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:41.127827 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255878016}
I20260709 13:11:41.142938 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.147190 27153 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:41.149005 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.149706 30465 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.150195 30465 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.151012 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:41.151631 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.151724 27156 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:41.154299 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.154567 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.155187 27148 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:41.157325 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.157588 30425 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:41.158458 30425 consensus_queue.cc:1243] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:41.160151 30425 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:41.163997 27149 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:41.165661 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.167618 30412 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:41.168207 30412 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.159241 30591 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:41.168629 30437 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.174772 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1819) took 1241 ms. Trace:
I20260709 13:11:41.151358 30465 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.182353 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.176002 30431 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.161988 30425 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:41.045181 30324 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.201313 27149 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:41.180305 27228 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:11:41.201238 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 103794us
I20260709 13:11:41.196250 30477 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:41.197013 30488 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.170917 27269 connection.cc:256] RPC call timeout handler was delayed by -1.0987697329999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
W20260709 13:11:41.158519 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60880.7us
I20260709 13:11:41.202134 27228 pending_rounds.cc:85] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:41.209386 27228 pending_rounds.cc:107] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:41.209734 27228 raft_consensus.cc:2889] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.210076 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:41.208714 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:41.181752 27302 rpcz_store.cc:276] 0709 13:11:39.933516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.935493 (+  1977us) service_pool.cc:224] Handling call
0709 13:11:39.935982 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.936380 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.936406 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.832566 (+896160us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:40.834086 (+  1520us) log.cc:844] Serialized 572 byte log entry
0709 13:11:40.924998 (+ 90912us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:40.928366 (+  3368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.936253 (+  7887us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.170395 (+234142us) raft_consensus.cc:1685] finished
0709 13:11:41.170416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.174583 (+  4167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12862208,"thread_start_us":85853,"threads_started":1,"wal-append.queue_time_us":327894}
I20260709 13:11:41.220237 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.176679 30450 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.161784 30520 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:41.229090 27148 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.201192 30425 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:41.237561 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:41.225389 30465 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.248030 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:41.237280 27123 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.670s (SENT)
I20260709 13:11:41.205969 30393 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:41.255223 30590 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:41.259850 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.245532 30575 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.260610 30433 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:41.261191 30597 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.277791 30433 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.278297 30433 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.264598 30490 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.279578 30490 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.252818 29995 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:41.276091 30590 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:41.282217 30412 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:41.282320 29995 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:41.282645 30590 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.282917 29995 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.248226 30437 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.258478 30416 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:41.285460 30416 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:41.285825 30416 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.286019 30490 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.268191 30600 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:11:41.240211 30281 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:41.268826 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.269069 30542 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.257103 27272 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:41.258600 30312 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:41.296042 30542 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.298331 30249 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:41.298818 30249 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:41.299212 30249 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:41.301576 30599 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.475s	user 0.002s	sys 0.001s
I20260709 13:11:41.270104 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.272446 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2785) took 1505 ms. Trace:
I20260709 13:11:41.273046 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1280) took 1103 ms. Trace:
I20260709 13:11:41.303910 27227 rpcz_store.cc:276] 0709 13:11:39.766911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.985811 (+218900us) service_pool.cc:224] Handling call
0709 13:11:39.995152 (+  9341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.767567 (+772415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.272115 (+504548us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002288d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:41.272362 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698508672}
I20260709 13:11:41.304775 27150 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:41.305764 30499 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.306362 30499 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:41.303728 27832 rpcz_store.cc:276] 0709 13:11:40.169530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.669725 (+500195us) service_pool.cc:224] Handling call
0709 13:11:40.716605 (+ 46880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.832400 (+115795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.832439 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.932602 (+100163us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.178021 (+245419us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.178086 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.178152 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.272822 (+ 94670us) raft_consensus.cc:1685] finished
0709 13:11:41.272847 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.272990 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284,"raft.queue_time_us":10187,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"thread_start_us":207324,"threads_started":1,"wal-append.queue_time_us":274628}
I20260709 13:11:41.307801 30499 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.309499 30499 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:41.302780 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.273159 30497 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:41.227031 30477 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.274796 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.291702 27154 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:41.232313 30450 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:41.330600 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.313617 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:41.318581 30253 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:41.336587 30310 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:41.319434 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.337365 30575 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.338801 27299 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:41.340584 30520 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:41.319689 27157 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:41.240049 30488 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.344992 30488 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.321961 30042 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:11:41.346095 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 113199us
I20260709 13:11:41.324261 30365 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.333750 27302 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:41.243654 30507 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:11:41.331858 27839 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:41.346285 30042 raft_consensus.cc:1068] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Unable to promote non-voter f4afe81810944d70bc2cc31754392f3d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:41.341746 30542 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.364436 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 134641us
W20260709 13:11:41.363394 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 86851.1us
I20260709 13:11:41.360087 30365 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.380999 27297 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:41.381263 30365 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.351686 30488 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:41.380584 30249 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.388649 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2248) took 1276 ms. Trace:
I20260709 13:11:41.389319 27154 rpcz_store.cc:276] 0709 13:11:40.112044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.496379 (+384335us) service_pool.cc:224] Handling call
0709 13:11:41.384206 (+887827us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400138b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:41.388548 (+  4342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817103104}
I20260709 13:11:41.394541 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.394935 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.395309 27835 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:41.396011 30249 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:41.397316 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:41.402777 30397 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:41.403245 30397 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.403635 30397 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.420969 27225 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.421090 30426 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:41.421075 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.422943 27230 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.423805 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.424022 29995 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.425161 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.426018 27152 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:41.432767 27230 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:41.433256 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.426313 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.434584 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.426688 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.436219 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.423805 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.434895 27156 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.409430 30425 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:41.440578 30624 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:11:41.441340 30604 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.607s	user 0.002s	sys 0.000s
W20260709 13:11:41.442694 27150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2767) took 3831 ms (client timeout 2705 ms). Trace:
I20260709 13:11:41.446493 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1832) took 1020 ms. Trace:
I20260709 13:11:41.427271 27225 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.436405 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.446924 27301 rpcz_store.cc:276] 0709 13:11:40.426348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.426903 (+   555us) service_pool.cc:224] Handling call
0709 13:11:40.427617 (+   714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.428677 (+  1060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.428739 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.429956 (+  1217us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.674285 (+244329us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:40.674355 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.674457 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.440658 (+766201us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:41.446200 (+  5542us) raft_consensus.cc:1685] finished
0709 13:11:41.446223 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.446434 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97658,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":66289,"spinlock_wait_cycles":170963712,"thread_start_us":243561,"threads_started":1,"wal-append.queue_time_us":403741}
I20260709 13:11:41.448150 27154 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:41.448635 30312 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.449088 30312 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:41.443104 27150 rpcz_store.cc:269] 0709 13:11:37.611258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.611919 (+   661us) service_pool.cc:224] Handling call
0709 13:11:41.442425 (+3830506us) spinlock_profiling.cc:243] Waited 3.65 s on lock 0x7b5400357854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:41.442583 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8389878144}
I20260709 13:11:41.450536 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.451336 27150 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.440524 30425 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.456224 30543 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:41.456369 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:41.468116 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.466411 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:41.470391 27155 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:41.473896 27156 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:41.477600 27155 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.408542 30520 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:41.387065 30497 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:11:41.494980 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.496765 30426 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:41.498354 27302 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:41.500928 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.482483 30393 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.503319 30426 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:41.510577 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 102576us
I20260709 13:11:41.511955 30426 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:41.512813 27230 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:11:41.514230 30360 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.514817 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.515848 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.516583 27305 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.517068 27230 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:41.519264 27224 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:41.519892 27306 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:41.483093 30520 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:41.488356 27299 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:41.513979 30310 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:41.521986 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.499668 30557 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.503631 30542 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:41.523497 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.523916 30542 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:41.514762 30360 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.524951 30542 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.486536 27148 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:41.531829 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.533604 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.543503 27297 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:41.531769 30364 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.521780 30575 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.507505 30370 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.550485 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.530686 30488 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:11:41.555698 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.479423 30416 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.562742 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.565227 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.575266 27224 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.534725 29995 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.577226 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.582408 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.583297 27302 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:41.583715 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:41.584200 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.584887 27223 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.583843 30360 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.582410 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:41.586120 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.586325 30370 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.588708 30370 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.590297 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:41.582520 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:41.590998 30575 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.591320 27151 raft_consensus.cc:2410] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:41.591590 30575 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:41.594893 30417 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.004s
I20260709 13:11:41.601282 27150 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:41.602002 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.574363 30477 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.603559 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:41.549922 30543 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:41.609478 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:41.615798 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:41.616694 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.614177 27297 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:41.546845 30397 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.608105 30437 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.654388 30437 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:41.655200 30437 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.618981 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.622841 30312 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.627393 30417 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:41.658901 30557 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.627702 30433 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.660113 30450 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:41.661052 30512 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.007s
I20260709 13:11:41.657874 30437 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.661696 30433 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:41.630177 30497 raft_consensus.cc:2764] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:11:41.630381 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.630635 27835 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:41.630931 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.678768 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.676983 27305 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:41.676182 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.602710 30416 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.638540 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.641136 27223 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:41.628978 30249 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:41.662400 27837 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:41.664552 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.664784 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.665118 30417 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.666280 30543 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.660243 30312 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.593950 30575 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:41.662937 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46767.4us
I20260709 13:11:41.521833 30520 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.699357 30590 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.704282 30520 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:41.668100 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 58713.5us
I20260709 13:11:41.666487 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:41.707363 27153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.037s	sys 0.052s
W20260709 13:11:41.707808 27153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.037s	sys 0.052s
W20260709 13:11:41.682068 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 43588.6us
I20260709 13:11:41.680755 27839 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:41.699795 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:41.698396 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.700852 30465 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:41.701227 30249 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:41.681998 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:41.726121 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:41.723289 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.709774 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:41.726358 27838 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.728295 30416 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.730693 30575 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.732272 30253 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:41.732637 30253 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.733671 30253 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.735596 30253 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.736114 27224 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:41.738240 30416 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:41.742941 27148 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:41.751103 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.756392 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:41.720074 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44620.4us
W20260709 13:11:41.767012 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.777645 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.810725 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.811321 27838 raft_consensus.cc:2410] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:41.681734 30499 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:41.682261 30525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.030s	sys 0.075s
I20260709 13:11:41.817327 27840 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:41.821372 27150 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:11:41.821801 27150 pending_rounds.cc:85] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 5
W20260709 13:11:41.822456 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.821234 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.821148 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.822782 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.827867 27841 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:41.725226 30312 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:41.724998 30465 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.724457 30249 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:41.829515 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:41.828734 27123 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.147s (SENT)
I20260709 13:11:41.834641 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:41.821240 30525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.032s	sys 0.082s
I20260709 13:11:41.838030 27839 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:41.834550 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:41.827172 27122 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:41.776731 30590 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.839598 27224 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 6. Ops: [4.3-4.3]
I20260709 13:11:41.828989 30499 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:41.837704 30465 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.841998 30499 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.828325 30417 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.845631 30417 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.833559 30312 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.846388 30312 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:41.851539 30543 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.852155 30465 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:41.853197 27227 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:41.854280 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.854887 27227 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:41.854918 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.855813 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.856535 27156 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:41.857237 30433 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:41.857996 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.856423 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.858776 27833 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:11:41.859329 27227 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:41.859611 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:41.863714 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.868844 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:41.869714 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.870317 27226 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.870692 30249 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.872298 30249 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:41.874177 30512 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.874840 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.868903 27841 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:41.875526 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.876319 27231 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:41.876549 30370 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:41.877038 30370 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:41.878340 30437 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:41.878873 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 112027us
I20260709 13:11:41.879848 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.878885 30437 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:41.881283 30437 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:41.882328 30450 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:41.878371 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:41.883111 30450 consensus_queue.cc:1243] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:41.883714 30450 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:41.884071 30525 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:41.885182 30450 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:41.885571 30450 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:41.887036 30370 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:41.888259 30370 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.875581 27229 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:41.888639 27838 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:11:41.890709 30574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.011s	sys 0.025s
W20260709 13:11:41.891274 30574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.011s	sys 0.026s
I20260709 13:11:41.892381 30450 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:41.894318 30450 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:41.895895 30465 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:41.822041 27150 pending_rounds.cc:107] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:11:41.898428 27150 raft_consensus.cc:2917] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:11:41.899044 27150 raft_consensus.cc:2889] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.875044 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:41.934337 27836 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:41.929622 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:41.935448 27231 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:41.938033 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 116074us
I20260709 13:11:41.833657 30397 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:41.939630 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:41.957348 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.965972 27157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.027s	sys 0.025s
I20260709 13:11:41.966821 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:41.968364 27223 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:41.970173 27157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.027s	sys 0.026s
W20260709 13:11:41.979523 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 253542us
I20260709 13:11:41.982226 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:41.984978 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.002578 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.001849 30397 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:42.004834 30436 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:11:42.005275 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:42.005622 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:42.006028 27837 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:42.006278 27304 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.010339 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:42.010974 27148 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:42.011284 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:42.011775 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:42.013983 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:42.015074 30575 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:42.015311 30425 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.561s	user 0.014s	sys 0.001s
I20260709 13:11:42.015691 30575 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:42.021517 27231 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:41.965751 30433 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:42.015084 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81312.1us
I20260709 13:11:41.973064 30590 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:42.028126 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46938us
W20260709 13:11:42.032559 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 50525.1us
W20260709 13:11:42.033365 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.028730 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 89114.2us
I20260709 13:11:42.033483 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:42.034160 27835 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.043722 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:42.032322 30364 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:11:42.045658 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.022771 30053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.009s	sys 0.013s
I20260709 13:11:42.052929 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:42.056253 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:42.049528 27148 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:42.027839 30433 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.066767 27228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.022s	sys 0.024s
W20260709 13:11:42.076843 27228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.022s	sys 0.024s
W20260709 13:11:42.070729 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.073904 27231 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:42.048576 30397 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:42.060146 30053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.013s
I20260709 13:11:42.034503 30575 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:11:42.093741 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.096554 30417 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:42.058867 30590 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:42.075311 30525 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.086091 27223 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:42.086221 27304 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:42.101735 27835 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:42.068612 30574 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:42.068990 30433 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:42.107636 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.109403 30477 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:42.072914 30259 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:42.067793 30281 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:42.124346 30417 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.141942 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.157941 27226 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:42.115785 30310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.018s	sys 0.007s
W20260709 13:11:42.161295 27149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.017s	sys 0.022s
W20260709 13:11:42.161681 27149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.017s	sys 0.022s
W20260709 13:11:42.171159 27230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.015s
W20260709 13:11:42.176177 27230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.015s
W20260709 13:11:42.175292 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.177584 27225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.031s
W20260709 13:11:42.178804 27225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.002s	sys 0.031s
I20260709 13:11:42.123983 30253 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:11:42.166750 30360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.008s	sys 0.020s
W20260709 13:11:42.187811 30360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.020s
I20260709 13:11:42.192122 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:42.162793 30310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.019s	sys 0.007s
I20260709 13:11:42.192848 27229 raft_consensus.cc:2376] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7. Re-sending same reply.
I20260709 13:11:42.199103 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.199967 27231 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:42.162539 30417 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:42.204185 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.173584 30535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.009s	sys 0.019s
I20260709 13:11:42.198426 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.208436 27224 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:42.213797 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.215502 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.216455 27224 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:42.221661 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.226655 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.227401 27229 raft_consensus.cc:2376] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4. Re-sending same reply.
I20260709 13:11:42.196708 30253 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:42.243269 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.244119 27224 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.249006 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.250373 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.251233 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.256129 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.256779 27223 raft_consensus.cc:2376] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5. Re-sending same reply.
I20260709 13:11:42.257714 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.244040 30312 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:42.264463 30312 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:42.265204 27226 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:42.278192 30426 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.280262 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:42.283840 27301 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:42.280263 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.162216 30477 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:42.282835 27298 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:42.210153 30535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.019s
I20260709 13:11:42.293861 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.317210 30615 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.317847 30615 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:42.319554 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.332238 27229 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:42.363932 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:42.246748 30281 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.376031 27050 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 336) took 8908 ms. Trace:
I20260709 13:11:42.372251 30557 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:11:42.382896 30557 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:42.383314 30557 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:42.292747 30426 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:42.383371 27229 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:42.388612 27301 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:11:42.390552 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.376909 27050 rpcz_store.cc:276] 0709 13:11:33.457055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.457288 (+   233us) service_pool.cc:224] Handling call
0709 13:11:42.329841 (+8872553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:39.366856 (+     0us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b540031aa28. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a580f39e1 00007f9a580f264c 00007f9a55781adc 00007f9a5576d0a6 00007f9a5576cd58 00007f9a557719f1 00007f9a557719a9 00007f9a55771939 00007f9a55771901 00007f9a55770b2d 000000000038f354
0709 13:11:39.389780 (+ 22924us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:39.486033 (+ 96253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:39.486096 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:11:39.486113 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:39.507473 (+ 21360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:39.507549 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:39.507582 (+    33us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:11:39.544432 (+ 36850us) tablet.cc:701] Row locks acquired
0709 13:11:39.547733 (+  3301us) write_op.cc:260] PREPARE: finished
0709 13:11:39.564632 (+ 16899us) write_op.cc:270] Start()
0709 13:11:39.584750 (+ 20118us) write_op.cc:276] Timestamp: P: 1783602699553480 usec, L: 0
0709 13:11:39.589078 (+  4328us) op_driver.cc:348] REPLICATION: starting
0709 13:11:39.683739 (+ 94661us) log.cc:844] Serialized 10808 byte log entry
0709 13:11:40.335592 (+651853us) op_driver.cc:464] REPLICATION: finished
0709 13:11:40.670529 (+334937us) write_op.cc:301] APPLY: starting
0709 13:11:40.670713 (+   184us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:40.671453 (+   740us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:40.671507 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:40.757395 (+ 85888us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:40.827558 (+ 70163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:11:40.827631 (+    73us) write_op.cc:312] APPLY: finished
0709 13:11:40.828349 (+   718us) log.cc:844] Serialized 170 byte log entry
0709 13:11:40.828641 (+   292us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:40.829222 (+   581us) write_op.cc:454] Released schema lock
0709 13:11:40.829317 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:40.829970 (+   653us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:40.830037 (+    67us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12458,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":294757,"apply.run_cpu_time_us":9086,"apply.run_wall_time_us":159516,"num_ops":25,"prepare.queue_time_us":241962,"prepare.run_cpu_time_us":54391,"prepare.run_wall_time_us":2269073,"raft.queue_time_us":14648,"raft.run_cpu_time_us":2648,"raft.run_wall_time_us":10984,"replication_time_us":743831,"spinlock_wait_cycles":87693056,"thread_start_us":725805,"threads_started":4,"wal-append.queue_time_us":619731,"wal-append.run_cpu_time_us":8357,"wal-append.run_wall_time_us":1663399}]]}
W20260709 13:11:42.397418 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.406459 30615 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:42.408634 30615 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.374691 30281 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:42.420662 30281 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:42.422704 30590 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:42.211009 30397 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:42.426692 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.427547 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.429739 30370 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.011s
I20260709 13:11:42.437069 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.437353 30426 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:42.438838 27224 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:42.439688 27229 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:11:42.437983 27227 raft_consensus.cc:2410] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:11:42.368768 30542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.023s	sys 0.016s
I20260709 13:11:42.440038 30426 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:42.462174 30499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.012s	sys 0.036s
I20260709 13:11:42.492359 27227 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:11:42.496224 27834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.017s	sys 0.032s
W20260709 13:11:42.497069 27834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.017s	sys 0.032s
W20260709 13:11:42.462008 30542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.024s	sys 0.016s
I20260709 13:11:42.430510 30557 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:42.500115 27297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.009s	sys 0.031s
W20260709 13:11:42.500876 27297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.010s	sys 0.031s
W20260709 13:11:42.463380 30543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.018s
W20260709 13:11:42.501837 30543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.018s
W20260709 13:11:42.502367 27839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.032s
W20260709 13:11:42.502686 27839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.007s	sys 0.032s
I20260709 13:11:42.516860 27833 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:11:42.497927 30499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.013s	sys 0.037s
I20260709 13:11:42.488758 30281 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.525033 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1287) took 1213 ms. Trace:
I20260709 13:11:42.537812 27832 rpcz_store.cc:276] 0709 13:11:41.311851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.320181 (+  8330us) service_pool.cc:224] Handling call
0709 13:11:41.320551 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.374601 (+ 54050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.374652 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.410173 (+ 35521us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.947735 (+537562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:41.947799 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.515939 (+568140us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b5400753d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:42.516004 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.516066 (+    62us) raft_consensus.cc:1685] finished
0709 13:11:42.516085 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.524937 (+  8852us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3572,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9308,"spinlock_wait_cycles":108566912,"thread_start_us":487345,"threads_started":1,"wal-append.queue_time_us":754190}
I20260709 13:11:42.533841 27227 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:42.548641 27807 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.007s	sys 0.043s
W20260709 13:11:42.549156 27807 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.007s	sys 0.044s
W20260709 13:11:42.549415 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 897183us
I20260709 13:11:42.563259 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:42.570111 27152 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:11:42.576627 27299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.018s
W20260709 13:11:42.577132 27299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.018s
W20260709 13:11:42.583783 27306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.033s	sys 0.055s
W20260709 13:11:42.584242 27306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.033s	sys 0.055s
W20260709 13:11:42.560560 30437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.012s	sys 0.012s
W20260709 13:11:42.564785 30436 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.030s	sys 0.046s
I20260709 13:11:42.587411 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:42.588374 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.591579 30436 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.030s	sys 0.046s
W20260709 13:11:42.592136 27305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.008s
W20260709 13:11:42.592558 27305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.010s	sys 0.008s
I20260709 13:11:42.592362 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.598836 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.611238 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.632392 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.598539 30437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.012s
I20260709 13:11:42.587499 30368 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.635943 27155 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:42.642969 27804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.033s
I20260709 13:11:42.643255 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:42.643621 27804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.007s	sys 0.034s
I20260709 13:11:42.644047 27227 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
W20260709 13:11:42.644170 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 599124us
I20260709 13:11:42.598834 30557 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:42.647704 27223 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:42.599401 30590 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:42.648627 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:42.656438 27232 raft_consensus.cc:2410] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:11:42.643929 30365 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.004s	sys 0.020s
W20260709 13:11:42.669191 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.670437 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2799) took 1245 ms. Trace:
I20260709 13:11:42.671104 27225 rpcz_store.cc:276] 0709 13:11:41.472704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.477674 (+  4970us) service_pool.cc:224] Handling call
0709 13:11:41.491881 (+ 14207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.502667 (+ 10786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.502711 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.530920 (+ 28209us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.179429 (+648509us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:42.179493 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.179595 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.670110 (+490515us) raft_consensus.cc:1685] finished
0709 13:11:42.670145 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.670353 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15548,"raft.queue_time_us":12633,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":16536,"thread_start_us":613104,"threads_started":1,"wal-append.queue_time_us":976996}
I20260709 13:11:42.655798 30590 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.661700 30450 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.004s
W20260709 13:11:42.660342 30365 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.004s	sys 0.021s
W20260709 13:11:42.665129 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.011s	sys 0.004s
W20260709 13:11:42.676610 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.012s	sys 0.004s
W20260709 13:11:42.677426 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 621212us
I20260709 13:11:42.679814 30590 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:42.686776 30507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.003s	sys 0.025s
W20260709 13:11:42.715124 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.679422 30417 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:42.713686 30507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.003s	sys 0.026s
W20260709 13:11:42.742110 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.753755 30639 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:11:42.754760 30648 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:11:42.771452 30647 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:11:42.782549 30635 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:11:42.872869 30433 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.007s
W20260709 13:11:42.714007 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.022s
I20260709 13:11:42.672013 30574 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:42.862316 27271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.012s	sys 0.005s
W20260709 13:11:42.956547 27271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.013s	sys 0.005s
W20260709 13:11:42.956887 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 895870us
I20260709 13:11:42.914791 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1914) took 1396 ms. Trace:
W20260709 13:11:42.923907 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.922379 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 243977us
W20260709 13:11:42.914189 30643 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.248s	user 0.004s	sys 0.016s
W20260709 13:11:42.915603 30525 consensus_meta.cc:287] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.787s	user 0.014s	sys 0.011s
W20260709 13:11:42.939230 30615 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.007s
I20260709 13:11:42.941498 30417 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:42.942345 30669 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:42.945446 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2810) took 1096 ms. Trace:
I20260709 13:11:42.936976 27054 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), no longer has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 5 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.954640 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2276) took 1079 ms. Trace:
I20260709 13:11:42.974393 27155 rpcz_store.cc:276] 0709 13:11:41.875116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.880887 (+  5771us) service_pool.cc:224] Handling call
0709 13:11:41.881196 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.642671 (+761475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.954341 (+311670us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002e77d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:42.954570 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735126272}
W20260709 13:11:42.955433 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.018s	sys 0.025s
W20260709 13:11:42.962765 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 290107us
W20260709 13:11:42.976423 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.964206 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 312598us
I20260709 13:11:42.959038 27230 rpcz_store.cc:276] 0709 13:11:41.518114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.533102 (+ 14988us) service_pool.cc:224] Handling call
0709 13:11:41.550744 (+ 17642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.576170 (+ 25426us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:42.176553 (+600383us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.861136 (+684583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.914350 (+ 53214us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:42.914419 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.914515 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.914716 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":815252,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":177857,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10930,"thread_start_us":1008783,"threads_started":2,"wal-append.queue_time_us":727022}
I20260709 13:11:42.967586 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:42.970338 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:42.977453 27841 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:42.972518 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.953008 30629 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.553s	user 0.011s	sys 0.006s
I20260709 13:11:42.973848 27231 rpcz_store.cc:276] 0709 13:11:41.848763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.428521 (+579758us) service_pool.cc:224] Handling call
0709 13:11:42.428890 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.429328 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.429366 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.429888 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.732215 (+302327us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.732285 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.732397 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.945178 (+212781us) raft_consensus.cc:1685] finished
0709 13:11:42.945209 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.945372 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1436,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":277654,"threads_started":1,"wal-append.queue_time_us":513674}
W20260709 13:11:42.975795 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 940903us
I20260709 13:11:42.985908 27833 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:11:42.986351 27833 pending_rounds.cc:85] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 5
I20260709 13:11:42.986608 27833 pending_rounds.cc:107] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:11:42.986888 27833 raft_consensus.cc:2889] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:42.989274 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:42.969170 30397 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.991017 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:42.993351 27272 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:42.968709 30525 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:43.001276 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:43.001329 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 720) took 1018 ms. Trace:
I20260709 13:11:43.003062 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2813) took 1149 ms. Trace:
I20260709 13:11:43.005188 27156 rpcz_store.cc:276] 0709 13:11:41.854110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.857330 (+  3220us) service_pool.cc:224] Handling call
0709 13:11:41.857651 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.858040 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.860672 (+  2632us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.890662 (+ 29990us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.283638 (+392976us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:42.283698 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.283800 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.002833 (+719033us) raft_consensus.cc:1685] finished
0709 13:11:43.002855 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.002999 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2116,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":21665,"thread_start_us":392340,"threads_started":1,"wal-append.queue_time_us":698728}
I20260709 13:11:42.960069 30433 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.003190 27306 rpcz_store.cc:276] 0709 13:11:41.982874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.982998 (+   124us) service_pool.cc:224] Handling call
0709 13:11:42.015440 (+ 32442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.015802 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.015835 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.016327 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.584684 (+568357us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:42.584736 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.584807 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.000995 (+416188us) raft_consensus.cc:1685] finished
0709 13:11:43.001021 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.001259 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2409,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":567960,"threads_started":1,"wal-append.queue_time_us":981010}
W20260709 13:11:43.003755 30645 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:11:42.994015 30657 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.015980 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:43.010375 27054 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.015458 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 986) took 1447 ms. Trace:
I20260709 13:11:43.002279 30417 raft_consensus.cc:2764] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:43.019657 27054 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), no longer has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.983323 30669 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.019176 27834 rpcz_store.cc:276] 0709 13:11:41.568099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.568231 (+   132us) service_pool.cc:224] Handling call
0709 13:11:41.579654 (+ 11423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.580182 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.580213 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.581376 (+  1163us) log.cc:844] Serialized 572 byte log entry
0709 13:11:42.497978 (+916602us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.498040 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.508929 (+ 10889us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.015175 (+506246us) raft_consensus.cc:1685] finished
0709 13:11:43.015210 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.015382 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":916094,"threads_started":1,"wal-append.queue_time_us":1079267}
W20260709 13:11:43.026630 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.042527 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.017902 30646 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
W20260709 13:11:43.048620 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.004709 30397 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.049739 27054 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 5, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.028378 30324 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:43.027227 30525 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:43.055976 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.059827 30677 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:43.015012 30574 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.061137 30397 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:43.061254 30667 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:43.062301 30477 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.062541 30281 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.003s
I20260709 13:11:43.069918 27054 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.071285 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 716) took 1445 ms. Trace:
I20260709 13:11:43.077270 27841 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:43.071527 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2269) took 1726 ms. Trace:
W20260709 13:11:43.073240 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57387.4us
W20260709 13:11:43.078243 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 84448.1us
I20260709 13:11:43.079068 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:43.078277 27157 rpcz_store.cc:276] 0709 13:11:41.345405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.355592 (+ 10187us) service_pool.cc:224] Handling call
0709 13:11:41.368304 (+ 12712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.453186 (+ 84882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.453218 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.453785 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.971405 (+517620us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.971446 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.971512 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.952348 (+980836us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:43.066201 (+113853us) raft_consensus.cc:1685] finished
0709 13:11:43.066230 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.071433 (+  5203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84512,"raft.queue_time_us":85820,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":5449600,"thread_start_us":517245,"threads_started":1,"wal-append.queue_time_us":774639}
I20260709 13:11:43.014307 30654 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:43.066591 30499 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.052115 30365 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:43.048142 30655 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:43.098723 30365 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:43.099952 30365 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.075810 29995 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:43.085258 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 103544us
W20260709 13:11:43.087921 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86714.5us
I20260709 13:11:43.074358 30658 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:43.076051 30673 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:43.076804 30324 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:43.028149 30657 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.077570 27297 rpcz_store.cc:276] 0709 13:11:41.626321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.662178 (+ 35857us) service_pool.cc:224] Handling call
0709 13:11:41.662584 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.663153 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.663185 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.666222 (+  3037us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.501757 (+835535us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:42.501836 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.501943 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.979755 (+477812us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:43.066279 (+ 86524us) raft_consensus.cc:1685] finished
0709 13:11:43.066299 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.071211 (+  4912us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":64364928,"thread_start_us":834605,"threads_started":1,"wal-append.queue_time_us":1002466}
I20260709 13:11:43.104570 27054 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.116487 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:43.106436 30677 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:43.125487 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1005) took 1271 ms. Trace:
W20260709 13:11:43.125583 27197 connection.cc:256] RPC call timeout handler was delayed by -1.4861197990001074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2818s for a response
I20260709 13:11:43.108134 30658 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:43.125944 27839 rpcz_store.cc:276] 0709 13:11:41.854252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.854409 (+   157us) service_pool.cc:224] Handling call
0709 13:11:41.855017 (+   608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:41.855592 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.855622 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:41.870518 (+ 14896us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b2c00012928. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:41.871444 (+   926us) log.cc:844] Serialized 598 byte log entry
0709 13:11:42.503034 (+631590us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.503088 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.503187 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.122697 (+619510us) raft_consensus.cc:1685] finished
0709 13:11:43.122738 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.125417 (+  2679us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1409,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"spinlock_wait_cycles":11677056,"thread_start_us":631191,"threads_started":1,"wal-append.queue_time_us":1081027}
I20260709 13:11:43.132359 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:43.134814 27231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:43.135495 30433 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:43.112111 29995 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.137457 30417 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:43.135839 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:43.135499 27231 raft_consensus.cc:606] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:43.138015 29995 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.109778 30499 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.147027 27054 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.125074 30677 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:43.205701 30324 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.210896 30669 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:43.211871 30657 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.212082 30627 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.966s	user 0.000s	sys 0.004s
I20260709 13:11:43.119240 30673 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.213972 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2265) took 2042 ms. Trace:
I20260709 13:11:43.214389 27153 rpcz_store.cc:276] 0709 13:11:41.172014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.172269 (+   255us) service_pool.cc:224] Handling call
0709 13:11:41.174976 (+  2707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.175450 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.175493 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.176138 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.708255 (+532117us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.708319 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.708413 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.138816 (+1430403us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:43.213614 (+ 74798us) raft_consensus.cc:1685] finished
0709 13:11:43.213637 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.213902 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1658,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":46701,"spinlock_wait_cycles":15664512,"thread_start_us":531676,"threads_started":1,"wal-append.queue_time_us":963433}
I20260709 13:11:43.173620 30677 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.207259 30575 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.218385 30575 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:43.219116 30660 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:11:43.221391 30575 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.223968 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1911) took 1711 ms. Trace:
I20260709 13:11:43.224462 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1939) took 1070 ms. Trace:
I20260709 13:11:43.224900 27223 rpcz_store.cc:276] 0709 13:11:42.154117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.257429 (+103312us) service_pool.cc:224] Handling call
0709 13:11:43.224258 (+966829us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003d0ed4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:43.224381 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345616768}
I20260709 13:11:43.215471 30673 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:43.226359 30678 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:43.226898 30678 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:43.224370 27228 rpcz_store.cc:276] 0709 13:11:41.512240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.512442 (+   202us) service_pool.cc:224] Handling call
0709 13:11:41.513058 (+   616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.513552 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:42.118046 (+604494us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.658746 (+540700us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.667796 (+  9050us) log.cc:844] Serialized 572 byte log entry
0709 13:11:42.667949 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:42.667980 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.668049 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.218388 (+550339us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:43.223629 (+  5241us) raft_consensus.cc:1685] finished
0709 13:11:43.223753 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.223890 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2090,"prepare.queue_time_us":897114,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":11183,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9294,"spinlock_wait_cycles":83008384,"thread_start_us":1091516,"threads_started":2,"wal-append.queue_time_us":846699}
I20260709 13:11:43.227840 30678 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.229616 30678 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:43.232628 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.144236 30525 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:43.234851 30525 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:43.239121 30525 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.241372 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2266) took 1955 ms. Trace:
I20260709 13:11:43.241807 27149 rpcz_store.cc:276] 0709 13:11:41.285796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.313206 (+ 27410us) service_pool.cc:224] Handling call
0709 13:11:41.353655 (+ 40449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.413140 (+ 59485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.413194 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.475117 (+ 61923us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.163246 (+688129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:42.163290 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.163374 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.240456 (+1077082us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b2400164228. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ead09c4 00007f9a4eaceacb 00007f9a4ec89dc9 00007f9a4ec89a55 00007f9a4ec88fb0 00007f9a518ff488 00007f9a518ffbe8 00007f9a518d7398 00007f9a518d276a 00007f9a518d1bb6
0709 13:11:43.241018 (+   562us) raft_consensus.cc:1685] finished
0709 13:11:43.241048 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.241302 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65673,"raft.queue_time_us":47544,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":12854,"spinlock_wait_cycles":3199360,"thread_start_us":642405,"threads_started":1,"wal-append.queue_time_us":1055454}
I20260709 13:11:43.243265 30368 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:43.243813 30368 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.248461 27299 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:11:43.257884 30674 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:11:43.259444 30499 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.260349 30590 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.006s
I20260709 13:11:43.260802 30590 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:43.262398 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.263396 30590 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.266008 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.268049 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:43.269284 27123 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.864s (SENT)
W20260709 13:11:43.315850 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.332331 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 121885us
I20260709 13:11:43.334228 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.334936 27223 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.337565 27226 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:43.339845 27226 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:43.331771 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66404.2us
W20260709 13:11:43.343010 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73745.2us
W20260709 13:11:43.323778 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 174198us
W20260709 13:11:43.343830 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.347522 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:43.348932 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:43.351577 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.352174 27231 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.353787 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.374378 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.375782 27225 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:43.376842 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.379715 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.380332 27227 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.381817 27232 raft_consensus.cc:2368] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:43.382803 27229 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:43.384295 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:43.385048 27149 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.344676 30535 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:43.391425 27226 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:43.387490 27054 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 5 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:43.394780 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45980.7us
I20260709 13:11:43.397398 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.399365 27223 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:43.403661 27230 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:43.406625 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.408715 27225 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:11:43.413736 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.415277 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.416112 27229 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:43.417326 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.418144 27225 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:43.409744 27054 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 6, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.391234 30312 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.427568 27223 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:43.404112 30535 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:43.392560 30557 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:43.429739 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.429909 27230 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:43.431720 27054 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:11:43.412021 30436 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:43.434119 27225 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:43.396720 30677 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:43.434123 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 288549us
I20260709 13:11:43.435931 27229 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:43.438575 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.441669 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.443517 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.440623 27232 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:43.382818 30658 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.442404 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:43.449501 27223 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:43.452248 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.453039 27230 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.437413 30433 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.448748 27054 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 4 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:43.456789 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.464568 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.467589 27231 raft_consensus.cc:2410] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:43.469257 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.471717 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.474635 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.472437 27232 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:43.433750 30312 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.477596 27054 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 6 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.485096 27231 raft_consensus.cc:2376] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:43.504093 27297 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:43.457224 30663 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:43.455051 30436 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:43.507848 27054 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.438679 30557 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.450641 30574 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:11:43.521759 27054 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.523399 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.524217 27225 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 3.
I20260709 13:11:43.473384 30433 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.531913 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.533463 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.535513 27225 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:43.546697 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.548507 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.548537 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.550596 27223 raft_consensus.cc:2368] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:43.551818 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.552119 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.553203 27224 raft_consensus.cc:2410] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:43.520748 30312 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.516759 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.457473 30253 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:11:43.516055 30426 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:43.520694 30557 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.521436 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.527601 30465 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.547763 30615 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.555483 27197 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 2.818s (SENT) [suppressed 42 similar messages]
I20260709 13:11:43.556320 27054 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.527737 30679 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:43.559855 27231 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:43.547412 30672 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:43.564282 27226 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:43.546000 30416 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.572292 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.547152 30663 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:43.574999 27054 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 3 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:43.575906 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 304755us
I20260709 13:11:43.446621 30417 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:43.569051 27230 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:43.582258 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:43.582751 27302 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:43.585100 27122 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.623s (SENT)
I20260709 13:11:43.562674 30657 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:43.586992 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.589692 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.522687 30535 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.598929 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.599602 27839 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:43.600281 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.601110 27304 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:43.597314 27054 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.606902 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:43.609620 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:43.611815 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.585599 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:43.604321 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:43.622188 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.624297 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.626562 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.630400 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:43.631399 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58023.9us
I20260709 13:11:43.613411 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.615105 27299 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:43.665693 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.594456 30557 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.669591 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.570611 30426 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.672432 27305 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:43.567049 30691 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:43.674450 27841 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:43.689209 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.675944 27839 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:43.677575 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.692022 27840 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:43.572242 30465 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.613830 30686 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.702636 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.575366 30615 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.577797 30416 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.687611 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.697363 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.577553 30672 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.703464 27841 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:43.704183 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 148814us
I20260709 13:11:43.686374 27054 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 1 to 4, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.600234 30450 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:11:43.709435 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 124375us
I20260709 13:11:43.710474 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:43.582953 30679 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:43.754542 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 67263.7us
I20260709 13:11:43.605139 30657 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.687685 30557 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.581848 30436 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.706385 30368 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.756477 27834 raft_consensus.cc:2376] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4. Re-sending same reply.
I20260709 13:11:43.760270 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.916047 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.901790 27054 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:43.758206 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:43.929715 27839 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:43.888374 27836 raft_consensus.cc:2410] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:43.888654 30657 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.889655 27122 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.864s (SENT)
W20260709 13:11:43.696174 30684 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:11:43.681529 30693 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.938796 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:43.939399 27226 raft_consensus.cc:2376] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7. Re-sending same reply.
I20260709 13:11:43.890697 30672 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:43.941555 30685 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:43.941255 30693 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.942322 30433 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:43.892520 30679 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.892599 30557 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.725222 27149 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:43.792707 30663 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:43.791317 30687 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:11:43.710788 30686 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:43.792326 30507 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:11:43.896232 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:43.710666 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.898754 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.985869 27231 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 3.
I20260709 13:11:43.899963 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.986898 27224 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:43.927110 30368 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:43.700368 30397 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.906493 30417 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:43.923161 27833 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:43.923396 30312 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:43.924059 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.908936 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:43.988124 27840 raft_consensus.cc:2410] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:43.924798 27305 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:43.925625 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.886737 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:43.687286 30655 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.213s
I20260709 13:11:43.927556 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:43.928404 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:43.790930 30682 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:11:43.934257 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:43.942361 30465 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:43.935545 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.936825 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:43.945683 27227 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 13:11:44.015880 27232 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:11:43.947664 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 266576us
I20260709 13:11:44.003252 27230 raft_consensus.cc:2410] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:44.002631 27229 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:44.005498 27841 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:44.022364 27227 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:44.002121 30507 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:44.026253 30701 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:44.026892 30701 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:44.031222 30695 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:11:44.031956 30426 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:44.033972 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.043920 27839 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:44.002713 30499 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:44.048141 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.055860 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 166228us
I20260709 13:11:44.056228 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:44.080987 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.081889 27839 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 3.
I20260709 13:11:44.092089 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.105585 27306 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:44.106145 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50013.1us
I20260709 13:11:44.105964 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.107005 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:44.021308 30397 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.110237 30535 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.123593 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:44.103255 30682 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:11:44.103260 30644 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:44.141780 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.141968 27833 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:44.168038 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.171504 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64592.7us
I20260709 13:11:44.103238 30312 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:44.173467 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:44.177031 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.205207 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.206475 27305 raft_consensus.cc:2368] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8.
I20260709 13:11:44.187490 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:44.141081 30713 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.218804 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.061033 30499 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.186806 30721 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.235445 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.171346 30416 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:44.125097 30557 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:11:44.247007 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.248508 27839 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:44.240906 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.251812 27833 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:44.254194 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 363454us
I20260709 13:11:44.255560 30689 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.270331 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:44.259389 30697 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
I20260709 13:11:44.186509 30718 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:44.208940 30426 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:11:44.234367 30708 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.263s
I20260709 13:11:44.266161 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:44.245043 30703 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.255586 30702 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:11:44.271397 27839 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.240016 30312 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.225800 30615 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.267346 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.314862 27305 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:44.303790 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.315924 27302 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:44.308375 27304 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:44.282806 30689 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.315819 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.326835 27833 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:44.329885 30681 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:11:44.330415 30681 raft_consensus.cc:1068] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Unable to promote non-voter f4afe81810944d70bc2cc31754392f3d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:44.333978 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:44.337538 30696 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.776s	user 0.002s	sys 0.010s
I20260709 13:11:44.339453 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1860) took 1094 ms. Trace:
I20260709 13:11:44.339841 27297 rpcz_store.cc:276] 0709 13:11:43.245149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.245896 (+   747us) service_pool.cc:224] Handling call
0709 13:11:43.246259 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.504807 (+258548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.339194 (+834387us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54000bb154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:44.339391 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592279296}
W20260709 13:11:44.342918 30720 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:11:44.321446 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 86084.3us
I20260709 13:11:44.321480 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.359468 27306 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:44.360633 27839 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:44.362950 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.367039 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.367779 27839 raft_consensus.cc:2368] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:44.234858 30713 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.370560 27232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e37f81c47354aae99c01542f682acef"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:44.373199 27232 raft_consensus.cc:606] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.373543 27232 raft_consensus.cc:614] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:44.358997 30697 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:44.377617 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.378396 27301 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:44.380004 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.414348 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:44.415546 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:44.250921 30721 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.358129 30693 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.361990 30477 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.421931 30715 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.423983 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:44.444891 27840 raft_consensus.cc:2410] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:44.427783 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.428421 27305 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:44.428541 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 241142us
I20260709 13:11:44.429040 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:44.445880 27304 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.315198 30703 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:44.427778 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:44.430531 29995 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.432080 27303 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:11:44.432973 30678 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.092s	user 0.012s	sys 0.001s
I20260709 13:11:44.433398 30397 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.435201 30713 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.376261 30686 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.440606 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.447732 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.429239 27302 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:44.448578 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.474762 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.475613 27152 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:44.449003 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.456496 27297 raft_consensus.cc:2368] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10.
I20260709 13:11:44.456813 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:44.429109 30727 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.463676 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.467008 27837 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.500347 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.467072 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.501663 27156 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:44.470723 27153 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:11:44.472906 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.497087 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.502279 27150 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:44.502038 27153 pending_rounds.cc:85] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 7
I20260709 13:11:44.503736 27153 pending_rounds.cc:107] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:44.504029 27153 raft_consensus.cc:2889] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.502435 27155 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
W20260709 13:11:44.506251 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49548.2us
I20260709 13:11:44.507251 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.507539 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.509449 27840 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:44.511428 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.512701 27152 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.457311 30477 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:44.517410 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.517767 30499 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.518168 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.518839 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:44.476718 30701 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:44.531054 27833 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 LEARNER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:11:44.530474 27840 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:11:44.536139 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72567.2us
I20260709 13:11:44.537181 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.539299 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:44.467808 29995 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.515316 30425 raft_consensus.cc:2764] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:44.519811 30726 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:44.555228 27304 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:44.674849 27840 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:44.534077 30499 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:11:44.641794 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 91364.8us
W20260709 13:11:44.589850 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 73084.2us
W20260709 13:11:44.736685 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 185815us
W20260709 13:11:44.629415 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 272846us
I20260709 13:11:44.739359 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.677047 30742 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.744151 30499 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:44.744588 30499 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:44.745013 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.600s	user 0.015s	sys 0.007s
W20260709 13:11:44.745429 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.600s	user 0.015s	sys 0.007s
I20260709 13:11:44.746157 30557 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.746575 30557 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:44.746954 30557 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:44.747097 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.747349 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1015) took 1157 ms. Trace:
I20260709 13:11:44.747745 27836 rpcz_store.cc:276] 0709 13:11:43.589586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.589721 (+   135us) service_pool.cc:224] Handling call
0709 13:11:44.747134 (+1157413us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400660154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:44.747283 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509677952}
I20260709 13:11:44.750296 30709 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:44.745646 30499 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:44.752110 30499 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.752411 30732 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:44.753140 30732 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.541657 30713 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:44.658820 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.587399 30727 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:44.688527 30535 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 13:11:44.677357 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1310) took 1014 ms. Trace:
I20260709 13:11:44.803280 27839 rpcz_store.cc:276] 0709 13:11:43.663338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.534578 (+871240us) service_pool.cc:224] Handling call
0709 13:11:44.676847 (+142269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.677046 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.677069 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.677110 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:44.677141 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.677196 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.677296 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:44.682482 30689 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.677804 30729 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:44.680768 27837 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:11:44.707811 30714 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.702s	user 0.003s	sys 0.008s
W20260709 13:11:44.709365 30688 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.143s	user 0.007s	sys 0.011s
I20260709 13:11:44.712559 30677 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:44.716102 30671 raft_consensus.cc:993] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
W20260709 13:11:44.716451 30676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.007s	sys 0.023s
I20260709 13:11:44.652616 30477 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.816833 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:44.720824 30694 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.157s	user 0.004s	sys 0.004s
I20260709 13:11:44.533541 30708 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.735162 27840 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:44.741430 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:44.742630 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:44.822009 27149 raft_consensus.cc:2410] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:11:44.745754 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.60032e+06us
I20260709 13:11:44.756841 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:44.836891 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.837734 27224 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:44.734272 30726 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:44.813091 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56550.7us
I20260709 13:11:44.768055 29995 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.819974 30689 raft_consensus.cc:1081] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:11:44.811178 30713 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:44.816473 30693 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:44.844871 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.844586 27840 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.845737 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2824) took 1713 ms. Trace:
I20260709 13:11:44.845908 27230 pending_rounds.cc:85] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
I20260709 13:11:44.894047 27230 pending_rounds.cc:107] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:11:44.846493 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:44.894708 27223 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:44.846742 30747 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:11:44.902523 27228 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:44.904376 27228 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:44.850423 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.907687 27231 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:44.851315 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:44.909736 27232 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.910226 30721 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:44.911038 29995 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:44.911796 29995 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:44.913005 29995 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:44.852567 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 95806.6us
I20260709 13:11:44.914690 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.853266 30752 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:44.915498 30752 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.915930 30752 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:44.815819 30676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.007s	sys 0.024s
I20260709 13:11:44.806191 30535 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:44.859508 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:44.881319 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.843436 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:44.889262 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67281.9us
I20260709 13:11:44.891137 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.922915 27224 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:44.844216 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.923355 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:44.922322 27226 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:44.895936 27230 raft_consensus.cc:2917] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:11:44.897305 27840 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.893913 27154 rpcz_store.cc:276] 0709 13:11:43.132247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.136075 (+  3828us) service_pool.cc:224] Handling call
0709 13:11:43.136444 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.137006 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.137035 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.137524 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.437690 (+300166us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:43.437734 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.437803 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.708591 (+1270788us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:44.845421 (+136830us) raft_consensus.cc:1685] finished
0709 13:11:44.845448 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.845666 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1289,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1704,"spinlock_wait_cycles":6449408,"thread_start_us":291310,"threads_started":1,"wal-append.queue_time_us":383583}
W20260709 13:11:44.900249 30312 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.006s
I20260709 13:11:44.924252 27227 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:44.925633 30312 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:44.924875 27230 raft_consensus.cc:2889] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.891352 30703 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:44.933109 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:44.931044 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 194294us
I20260709 13:11:44.934096 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.934685 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.929937 30312 raft_consensus.cc:2764] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:44.936827 30726 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:44.938328 30713 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:44.944983 27223 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:44.951483 27299 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:44.957955 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:44.958218 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.959035 27298 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:44.959944 30721 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:44.961906 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:44.962193 30742 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.962914 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:44.963857 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:44.963989 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.964749 27304 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:44.965986 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.967572 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:44.968858 30590 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:44.969153 30709 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:44.969594 30709 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:44.970012 27122 leader_election.cc:336] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.580s (SENT)
I20260709 13:11:44.966140 30703 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:44.969964 30709 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.996953 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.971004 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:44.962677 30742 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:44.976245 27306 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:44.998764 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:44.986413 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.968761 30535 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:44.949885 30726 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.922207 30693 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.001748 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:44.996025 30703 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.023303 30745 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:45.011785 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.035528 27297 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:45.012316 30535 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:45.037045 30535 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.038514 30658 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.039706 27232 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:45.014251 30742 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:44.998572 30426 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:45.025489 30744 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.041257 30426 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.025619 30703 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.041882 30426 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.005345 30425 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:45.025651 30312 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:44.971125 30689 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:45.025316 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54396.9us
I20260709 13:11:45.003801 30671 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:11:45.050531 30739 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:45.050956 30739 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:45.026286 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56304.6us
I20260709 13:11:45.051831 30739 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:45.052768 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:45.053298 30739 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.028956 30721 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:45.054559 30751 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.055006 30751 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.055378 30751 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.031816 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.023777 30750 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.060808 30704 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.061338 30704 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.062999 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1012) took 1474 ms. Trace:
I20260709 13:11:45.063374 27837 rpcz_store.cc:276] 0709 13:11:43.588730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.588841 (+   111us) service_pool.cc:224] Handling call
0709 13:11:45.062826 (+1473985us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:45.062940 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976507648}
I20260709 13:11:45.024811 27197 leader_election.cc:400] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8.
I20260709 13:11:45.067694 27197 leader_election.cc:403] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:45.068260 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43635.3us
I20260709 13:11:45.069113 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.070103 30671 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8.
I20260709 13:11:45.070284 30425 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.070865 30425 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.071282 30425 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.069227 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.072921 27149 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:45.075073 27157 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:45.076922 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.077553 27151 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:45.078226 30654 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.078338 30732 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:45.078872 30654 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.081269 30654 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:45.082016 30557 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.082626 30725 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:45.083093 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:45.084069 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:45.084127 30725 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:45.084533 30663 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.084939 30663 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.085072 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:45.085296 30725 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:45.087105 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 815959us
I20260709 13:11:45.087442 30707 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:45.087987 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:45.088901 30748 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:45.088958 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1016) took 1499 ms. Trace:
I20260709 13:11:45.089272 30707 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:45.090683 27806 leader_election.cc:400] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10.
I20260709 13:11:45.090441 30723 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:45.091024 27806 leader_election.cc:403] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:11:45.091076 30722 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.907s	user 0.000s	sys 0.003s
I20260709 13:11:45.091635 30723 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:45.090488 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.092828 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.093370 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:45.026885 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2170) took 1028 ms. Trace:
I20260709 13:11:45.085811 30725 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:45.089507 27833 rpcz_store.cc:276] 0709 13:11:43.589860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.541191 (+951331us) service_pool.cc:224] Handling call
0709 13:11:44.682987 (+141796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.088576 (+405589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.088611 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.088657 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:45.088708 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.088781 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.088895 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":405191,"raft.queue_time_us":405753,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84}
I20260709 13:11:45.094244 27299 rpcz_store.cc:276] 0709 13:11:43.998849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.000384 (+  1535us) service_pool.cc:224] Handling call
0709 13:11:44.019984 (+ 19600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.997194 (+977210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.026616 (+ 29422us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54002d3cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:45.026816 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139200896}
I20260709 13:11:45.089738 30707 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.110525 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.115170 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.117084 27148 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:45.092082 30723 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:45.123567 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.085345 30663 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.125339 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:45.125937 27157 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.126632 27148 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:45.127518 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.129083 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:45.123498 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45452us
W20260709 13:11:45.136606 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 43866.9us
I20260709 13:11:45.137041 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 794) took 1349 ms. Trace:
I20260709 13:11:45.034119 30693 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:45.137567 27840 rpcz_store.cc:276] 0709 13:11:43.787501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.542707 (+755206us) service_pool.cc:224] Handling call
0709 13:11:44.674627 (+131920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.136514 (+461887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.136566 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.136622 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:45.136681 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.136783 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.136947 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36661}
I20260709 13:11:45.145083 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.115996 30686 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:45.152523 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:45.124384 30707 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:45.155404 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:45.151199 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:45.123973 30689 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:45.186623 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.190646 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.192149 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.133272 30742 raft_consensus.cc:2764] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:45.108641 30671 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:11:45.132448 30433 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10.
I20260709 13:11:45.138993 30590 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:45.206974 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.157111 30557 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:45.142951 30397 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.150854 30450 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:45.125573 30752 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.193991 30436 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.203640 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.206353 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.206952 27153 pending_rounds.cc:85] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 6
I20260709 13:11:45.208618 27223 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:45.196230 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52116.2us
I20260709 13:11:45.209227 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:45.210702 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.211328 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.204075 30669 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:45.175837 30690 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:45.213168 27232 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:45.179867 30713 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.183274 30686 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.216826 27226 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:45.200592 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.246878 27841 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:45.176061 30678 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:11:45.207892 30687 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:11:45.204694 27834 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:45.212221 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.222913 27835 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:45.223523 27153 pending_rounds.cc:107] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:45.257295 27153 raft_consensus.cc:2889] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:45.222288 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 77349.4us
I20260709 13:11:45.228456 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:45.258383 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:45.201788 30689 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:11:45.207208 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51908.3us
I20260709 13:11:45.259613 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.239293 27833 raft_consensus.cc:2376] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10. Re-sending same reply.
I20260709 13:11:45.224486 27225 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:45.216909 30655 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:45.266584 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.221954 30724 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:45.218406 30281 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:45.269150 27837 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:45.203408 30725 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.214476 30397 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:45.230491 30436 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.218775 30723 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.353211 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.250164 30686 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.251163 30615 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.310123 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:45.369930 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.304266 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.264945 30669 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:45.317615 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.308348 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.385123 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.458989 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.330799 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.378029 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.315557 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.407471 27149 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:45.319104 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:45.441005 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87940.5us
W20260709 13:11:45.443176 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 291203us
I20260709 13:11:45.459997 27833 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:45.465571 30671 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.454317 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.460645 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:45.335628 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 184513us
I20260709 13:11:45.319031 30450 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:45.461289 27835 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:45.466140 30671 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.466672 27840 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:45.462778 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.293401 30730 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:45.467128 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 230883us
I20260709 13:11:45.303751 27837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35860
I20260709 13:11:45.481565 27837 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.482337 27837 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.468809 27841 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:45.473866 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:45.486074 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:45.310525 30281 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:45.419380 30704 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:45.474421 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.308733 30701 raft_consensus.cc:2764] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:11:45.445976 30718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.015s	sys 0.017s
I20260709 13:11:45.455798 30615 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.488951 27841 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:45.470611 27832 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:45.452466 30754 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:45.493331 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:45.509073 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.499828 27836 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:45.510010 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:45.495339 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 187067us
I20260709 13:11:45.511590 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.497689 30730 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:45.317299 30709 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.521292 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:45.506676 30718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.015s	sys 0.017s
I20260709 13:11:45.306994 30689 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:45.530773 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 240250us
I20260709 13:11:45.500286 30679 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:45.505000 30507 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:45.515627 30615 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.516510 30590 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:45.521375 30732 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.549597 27152 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:45.507179 30450 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:45.526755 30721 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:45.517871 30669 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:45.592060 30760 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:11:45.592182 30450 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.581414 30732 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.594576 30732 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:45.595191 30755 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
W20260709 13:11:45.598407 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86889.4us
I20260709 13:11:45.599362 27807 leader_election.cc:400] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:45.599695 27807 leader_election.cc:403] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:11:45.602413 30759 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.263s	user 0.000s	sys 0.002s
W20260709 13:11:45.602629 30727 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.001s
W20260709 13:11:45.604893 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.602434 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:45.599704 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.567747 27157 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:45.567901 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.516556 30754 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.557593 27837 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.499298 30765 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:11:45.571055 30701 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:45.599363 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.554569 30499 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:45.555222 30679 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.543699 30718 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:45.603184 30758 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:11:45.560410 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:45.591955 30774 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:11:45.597836 30761 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:11:45.624466 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.625676 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:45.555035 30507 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:45.638993 30507 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.640157 29995 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:45.640744 29995 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:45.641209 29995 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.585019 30654 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 13:11:45.644330 30767 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:45.645397 30718 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.623451 30677 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:11:45.650650 30763 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:11:45.651022 30436 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:45.655385 30397 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:45.660086 27837 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:45.625823 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:45.660826 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 176071us
I20260709 13:11:45.661566 27304 raft_consensus.cc:2410] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:45.618294 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:45.569172 30693 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.584898 30721 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.688570 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.626384 30701 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:45.611069 30742 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.664268 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65056.3us
I20260709 13:11:45.702709 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.610786 30754 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.638098 27157 raft_consensus.cc:2410] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:45.631063 30655 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:45.633253 30679 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:45.704480 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 144150us
W20260709 13:11:45.706807 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 88754.7us
I20260709 13:11:45.710428 27197 leader_election.cc:400] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:45.710975 27197 leader_election.cc:403] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:45.722261 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:45.715214 30525 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:45.728238 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.729301 30672 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:45.730257 30672 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:45.700099 27306 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:45.662310 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:45.745477 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 83289.8us
I20260709 13:11:45.693704 30721 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.703505 30701 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.692695 30678 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:45.761648 27157 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:45.759538 30717 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.771183 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:45.691852 30693 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.746387 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.772966 30678 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:45.696775 30730 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.794895 30281 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:45.718132 30742 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:45.765182 30676 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:45.798807 30655 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:45.798525 30671 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:45.797426 30717 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.829851 27837 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:45.813582 30312 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.000s
I20260709 13:11:45.807348 30766 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.793165 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:45.836298 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55439.5us
I20260709 13:11:45.839468 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:45.844167 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.846092 27153 raft_consensus.cc:2410] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:11:45.834558 30751 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.008s
I20260709 13:11:45.855602 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:45.856290 27149 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.858516 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.871762 27149 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:45.849409 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56321us
I20260709 13:11:45.850306 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:45.880545 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:45.853873 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 385952us
I20260709 13:11:45.793252 30732 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.834182 30655 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:45.927975 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.837630 30717 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:45.845021 30703 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.005s
I20260709 13:11:45.843808 30312 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:45.966627 30777 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:11:45.843477 30766 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:45.970229 30766 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:45.845314 30765 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.973513 30765 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:45.977351 30765 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:45.980619 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 131395us
I20260709 13:11:45.849445 30709 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:45.980710 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 100259us
I20260709 13:11:45.981745 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:45.927594 30689 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:45.988340 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:45.991191 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 104562us
I20260709 13:11:45.998708 27150 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:45.927953 30780 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:45.956640 30655 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.032411 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:46.032907 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44650us
I20260709 13:11:46.033262 27157 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:45.999500 30768 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.341s	user 0.000s	sys 0.002s
I20260709 13:11:45.993544 30772 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.043968 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:45.984229 30744 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:45.941923 30677 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:11:45.935535 30751 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.029948 30671 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:46.061740 30782 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:11:45.969152 30703 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.032215 30780 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.062309 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:45.942096 30678 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:45.999847 30397 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:11:46.083506 27157 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:46.086833 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.067606 30499 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.092438 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.075718 30780 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.110631 27157 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:46.111347 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:46.114352 30779 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:46.115295 30751 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.098702 30671 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:46.120146 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:46.117028 30783 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:46.125283 30789 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:11:46.128810 27149 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:46.133901 30790 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:46.133793 30766 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.113503 30693 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.137410 30796 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:46.101001 30676 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:46.142184 30426 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.100s	user 0.014s	sys 0.000s
I20260709 13:11:46.144172 30725 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.146175 30678 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:46.113021 30658 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.074s	user 0.009s	sys 0.006s
W20260709 13:11:46.153604 30663 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.002s	user 0.004s	sys 0.006s
W20260709 13:11:46.154495 30535 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.117s	user 0.008s	sys 0.007s
W20260709 13:11:46.177146 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 57094us
W20260709 13:11:46.137027 30707 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.002s
W20260709 13:11:46.160041 30615 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
W20260709 13:11:46.191048 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 209390us
W20260709 13:11:46.192989 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.190938 30744 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:46.207844 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 184835us
I20260709 13:11:46.212464 27157 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:46.214679 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:46.218266 27300 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:11:46.209182 30425 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.137s	user 0.015s	sys 0.002s
I20260709 13:11:46.192490 30742 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.195663 30796 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.220460 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:46.225225 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.232523 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.207512 30783 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.231103 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.235962 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.238970 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.239080 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.239660 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:46.239720 27226 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:46.240489 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.240706 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.208251 30426 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.242457 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.243541 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.243597 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.249574 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.250126 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.255226 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.255378 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.255864 27226 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.256232 27833 raft_consensus.cc:2376] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8. Re-sending same reply.
I20260709 13:11:46.228542 30676 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:46.224328 30744 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.228003 30417 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.267042 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.267866 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:46.243108 30507 consensus_meta.cc:287] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 13:11:46.275041 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.275708 27223 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.276799 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.278761 30766 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:46.279757 30679 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.000s
I20260709 13:11:46.271848 30803 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:46.280212 30679 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.222699 30707 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.257980 30765 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:11:46.268379 30787 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:46.244736 30693 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:11:46.218619 30535 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.298285 27226 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:46.236452 30796 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.243659 30742 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.243384 30658 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:46.292713 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.299506 27154 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:46.217512 30663 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:46.282040 30788 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:46.225137 30615 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.302793 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.314903 27226 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.268955 30676 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:46.288635 29995 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.003s
I20260709 13:11:46.234905 30425 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.317950 27223 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:46.275372 30703 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.320410 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.322528 27223 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:46.285326 30739 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.232s	user 0.018s	sys 0.000s
I20260709 13:11:46.322618 27151 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:46.276463 30744 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.283990 30707 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:46.367043 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.311518 30804 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.290330 30417 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.389300 27304 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:46.386770 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60901.1us
I20260709 13:11:46.257253 30397 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:11:46.390623 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.391709 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.245154 30783 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.400589 27230 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.387506 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:46.395375 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 138025us
I20260709 13:11:46.321466 30676 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.289924 30693 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.302875 30507 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.288729 30787 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:11:46.321589 30686 consensus_meta.cc:287] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.859s	user 0.014s	sys 0.000s
I20260709 13:11:46.401467 27228 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:46.398686 27226 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:46.403517 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:46.405459 27271 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:46.399578 30721 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.626s	user 0.014s	sys 0.000s
I20260709 13:11:46.417471 30807 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.417718 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:46.314272 30742 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.418393 30535 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.398684 30426 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.426263 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.450726 27838 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:46.426594 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 800) took 1046 ms. Trace:
I20260709 13:11:46.455026 27156 rpcz_store.cc:276] 0709 13:11:45.380252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.493299 (+113047us) service_pool.cc:224] Handling call
0709 13:11:46.426336 (+933037us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400067cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:46.426518 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254402944}
I20260709 13:11:46.427495 27840 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:46.457610 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.458885 27230 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:46.459638 27840 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:46.428162 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.460718 27230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:46.429252 27837 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:46.461501 27230 raft_consensus.cc:606] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.432726 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.461984 27230 raft_consensus.cc:614] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.393245 30658 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:46.463660 30658 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.439323 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:46.445879 27227 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:46.396593 30679 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:46.446979 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.400975 30772 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.467592 30772 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.468797 30669 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:46.469381 30669 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:46.470676 30772 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:46.471606 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:11:46.467255 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:46.473328 30433 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:46.473793 30433 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.474236 30433 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.472489 27302 raft_consensus.cc:606] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.469900 30669 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.486215 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.486927 27228 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:46.324508 29995 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.487124 27835 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:46.487234 27228 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:46.493083 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.502219 27226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:46.502969 27226 raft_consensus.cc:606] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.503305 27226 raft_consensus.cc:614] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:46.506754 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:46.509634 30810 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:46.510087 30707 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:46.511096 30809 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:46.513137 30752 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.515372 30732 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.448935 30721 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.586030 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1041) took 1002 ms. Trace:
I20260709 13:11:46.524240 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1325) took 1018 ms. Trace:
I20260709 13:11:46.520253 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.519274 27152 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:46.599061 27835 rpcz_store.cc:276] 0709 13:11:45.505587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.505842 (+   255us) service_pool.cc:224] Handling call
0709 13:11:45.522455 (+ 16613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.487619 (+965164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.523905 (+ 36286us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400477cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.524146 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217974528}
I20260709 13:11:46.526341 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:46.533249 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 795) took 1318 ms. Trace:
I20260709 13:11:46.604809 27150 rpcz_store.cc:276] 0709 13:11:45.214967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.215298 (+   331us) service_pool.cc:224] Handling call
0709 13:11:45.225120 (+  9822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.999189 (+774069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.532942 (+533753us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400357d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.533173 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778540288}
I20260709 13:11:46.561698 27228 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.539853 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.535976 30663 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.597436 27836 rpcz_store.cc:276] 0709 13:11:45.584056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.584186 (+   130us) service_pool.cc:224] Handling call
0709 13:11:45.594044 (+  9858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:45.606295 (+ 12251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.606335 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.629338 (+ 23003us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.842916 (+213578us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:45.842955 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.843027 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.585747 (+742720us) raft_consensus.cc:1685] finished
0709 13:11:46.585770 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.585954 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":198334,"threads_started":1,"wal-append.queue_time_us":520448}
W20260709 13:11:46.608151 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 190494us
I20260709 13:11:46.627765 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.624050 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.617555 27838 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:46.630345 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.623102 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:46.518579 30669 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.445399 30686 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.648142 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:46.539072 30754 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.006s
W20260709 13:11:46.539357 30717 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.004s
I20260709 13:11:46.494912 30811 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:46.642848 27228 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.636008 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:46.644682 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:46.638202 30784 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.016s
I20260709 13:11:46.650486 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:46.658684 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.585032 30732 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.658967 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.400710 30804 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.523002 30425 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.535087 30742 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.520114 30721 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.658286 27837 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.490759 30780 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.668282 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:46.675405 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.690296 27840 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.690475 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:46.676290 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.632930 30312 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.487815 30807 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.639030 30426 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.666357 27841 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:46.684667 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:46.669729 30663 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:46.707352 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:46.711575 30426 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.711855 30808 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:46.764392 30507 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.764873 30654 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:46.765451 30654 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:46.766778 30436 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:46.767221 30436 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:46.768661 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2835) took 1666 ms. Trace:
I20260709 13:11:46.768822 30433 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.769109 27151 rpcz_store.cc:276] 0709 13:11:45.102346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.102531 (+   185us) service_pool.cc:224] Handling call
0709 13:11:45.132240 (+ 29709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.323334 (+1191094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.768354 (+445020us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.768575 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736978688}
I20260709 13:11:46.769641 30807 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.770749 27298 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:46.768683 30818 raft_consensus.cc:993] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:11:46.771080 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2841) took 1161 ms. Trace:
I20260709 13:11:46.771781 30818 raft_consensus.cc:1081] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:11:46.771553 27152 rpcz_store.cc:276] 0709 13:11:45.609999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.784731 (+174732us) service_pool.cc:224] Handling call
0709 13:11:45.785151 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.599540 (+814389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.770724 (+171184us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400069ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.771003 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687489920}
W20260709 13:11:46.773471 30701 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.004s
I20260709 13:11:46.773998 30701 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.776189 30701 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.776932 30780 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.778415 30686 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.778858 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.661592 30717 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.779752 27152 raft_consensus.cc:2410] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:46.779866 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.780571 27153 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:46.704360 30811 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:46.781776 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.782464 27151 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:46.782603 30723 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.783893 30671 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.784410 30671 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.757572 30796 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.786353 30812 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.786779 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 787) took 1715 ms. Trace:
I20260709 13:11:46.786875 30812 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.787211 27154 rpcz_store.cc:276] 0709 13:11:45.071257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.071394 (+   137us) service_pool.cc:224] Handling call
0709 13:11:45.071785 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.306845 (+1235060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.786515 (+479670us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000df554. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.786717 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804420992}
I20260709 13:11:46.718885 30783 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.788592 30783 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:46.789088 30812 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.790201 27836 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:46.791940 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.766577 29995 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.792317 30742 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:46.794126 27229 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:46.794375 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:46.795429 30671 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.796003 30742 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:46.796375 27229 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:46.796710 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:46.797448 29995 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:46.797811 29995 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.798166 29995 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.719168 30425 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.677613 30732 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.802338 30425 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.803819 30732 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.720019 30615 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.721124 30787 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.661840 30754 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.726786 30312 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.806156 27297 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:46.659967 30752 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:46.694796 30821 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.739342 30669 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:46.826534 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.827486 30744 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.828565 30312 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.828132 30436 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.829527 30436 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.830698 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2839) took 1624 ms. Trace:
I20260709 13:11:46.831152 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:46.832302 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:46.832837 27836 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:46.740083 30712 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:46.834416 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.834865 30712 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:46.835278 30712 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:46.836148 30712 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.837271 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 736) took 1125 ms. Trace:
I20260709 13:11:46.837354 30712 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.837715 27304 rpcz_store.cc:276] 0709 13:11:45.712129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.723396 (+ 11267us) service_pool.cc:224] Handling call
0709 13:11:45.723735 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.399142 (+675407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.837036 (+437894us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400197b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.837212 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530180992}
I20260709 13:11:46.741446 30815 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:46.838863 30815 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:46.741973 30721 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.692826 27838 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
W20260709 13:11:46.665915 30784 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.013s	sys 0.017s
I20260709 13:11:46.752099 30804 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.753075 30426 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.787886 30796 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.796388 30742 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.804544 30425 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.811671 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.814666 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:46.792162 30678 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.001s
I20260709 13:11:46.813970 27837 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:46.669564 30397 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:11:46.829736 30744 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.873917 27152 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:46.852102 30821 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.875629 27832 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:11:46.876307 30821 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.816339 30663 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.879462 27303 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:46.881634 30693 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:46.882223 30281 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:46.882778 30281 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:46.883764 30281 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:46.888303 30806 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.643s	user 0.000s	sys 0.002s
I20260709 13:11:46.840535 30717 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:46.863006 30725 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.003s
I20260709 13:11:46.871244 30815 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.896775 30754 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.898357 30663 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:46.899767 30744 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.900460 30744 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.901624 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.902479 27148 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:46.903462 27304 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:46.908231 27154 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:46.887125 30281 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:46.914225 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:46.831175 27224 rpcz_store.cc:276] 0709 13:11:45.206634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.209914 (+  3280us) service_pool.cc:224] Handling call
0709 13:11:45.210231 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.252446 (+ 42215us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:45.527267 (+274821us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.742142 (+214875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.742227 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:45.742296 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.830424 (+1088128us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b54003930d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:46.830475 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.830617 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1801,"prepare.queue_time_us":373249,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":68139,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5619,"spinlock_wait_cycles":96498560,"thread_start_us":438613,"threads_started":2,"wal-append.queue_time_us":321156}
I20260709 13:11:46.845252 27840 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:46.824154 27228 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:46.917809 27839 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:46.815665 30499 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 13:11:46.861974 27227 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:46.925591 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:46.815130 30417 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:46.773990 30655 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 13:11:46.919018 27224 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: [4.6-6.8]
I20260709 13:11:46.932052 27224 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:11:46.923454 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:46.920271 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:46.927053 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:46.934154 27154 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:46.939568 27230 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:46.940831 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:46.942562 30812 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:46.938527 30417 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.942893 27227 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:46.943209 30812 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.944953 27227 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:46.768829 30654 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.946375 27227 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:46.946866 30654 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:46.951570 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.952458 27155 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:46.954668 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.956743 27152 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:46.957170 27156 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:46.958500 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:46.962752 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.942852 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.961864 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:46.859871 30721 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:46.969000 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:46.971246 27152 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:46.934837 30499 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:46.975390 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.976717 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:46.977375 27155 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:46.985862 30693 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:46.991236 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:46.992909 30721 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:46.941202 30655 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:46.993727 27225 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:11:47.001394 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 353342us
I20260709 13:11:46.977747 30717 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:46.975270 30754 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:46.994705 30744 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:47.000710 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:47.003278 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 80190.9us
I20260709 13:11:47.009738 27155 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:47.016094 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:47.019894 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:47.021013 27154 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:47.021729 27840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:11:47.022370 27840 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:47.022805 27840 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:47.023236 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.006956 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:47.026857 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:47.027175 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:47.027675 27837 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:47.028514 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:47.029109 27150 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:47.033649 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:46.979213 30676 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.004s
I20260709 13:11:46.870289 30742 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:46.782634 30811 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.048874 27156 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.049265 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.042941 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:47.043473 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:47.052518 27837 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:47.054275 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:46.997663 30693 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:47.044194 27835 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:47.041194 27840 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.061103 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:46.976886 30324 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:11:47.010979 30821 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:47.021572 30590 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:46.998085 30725 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:11:47.068202 27837 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:47.030187 30669 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:47.026885 30807 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:11:47.060057 30312 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.062640 30693 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.048002 30823 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.091948 30814 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.092319 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:47.064680 30730 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.102031 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:47.114789 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 60576.2us
I20260709 13:11:47.071043 30535 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:47.101974 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:47.119215 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 734) took 1506 ms. Trace:
I20260709 13:11:47.129552 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:47.100106 30820 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:11:47.141825 27297 rpcz_store.cc:276] 0709 13:11:45.612904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.659129 (+ 46225us) service_pool.cc:224] Handling call
0709 13:11:45.659460 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.806534 (+1147074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.118872 (+312338us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000e9054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:47.119136 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636596608}
I20260709 13:11:47.143205 30689 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.143322 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.144814 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.149132 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.150506 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.136119 27840 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:47.117268 27269 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:47.143714 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.156921 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 733) took 1575 ms. Trace:
I20260709 13:11:47.157131 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.078033 30590 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:47.052835 30676 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.178267 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.197769 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.205168 27231 raft_consensus.cc:2393] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:47.207324 27156 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:47.208386 30308 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:47.210681 30827 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:11:47.191684 30689 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:47.310940 27229 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:47.209475 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.115556 30433 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:47.217469 30824 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:11:47.136487 30779 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:47.152839 30535 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.151393 30787 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:47.152701 30324 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:47.225171 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.225476 30678 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.227126 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.232874 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:47.235648 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.068444 30752 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:11:47.117255 30693 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.130717 30499 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:47.239835 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.337786 27297 raft_consensus.cc:2410] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:11:47.338990 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.157399 27299 rpcz_store.cc:276] 0709 13:11:45.581114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.616411 (+ 35297us) service_pool.cc:224] Handling call
0709 13:11:45.649799 (+ 33388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.814288 (+164489us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:46.082683 (+268395us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.157930 (+ 75247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:46.158005 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:46.158072 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.887695 (+729623us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:47.156693 (+268998us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540005d2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:47.156748 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.156866 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138047,"prepare.queue_time_us":1077229,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":892,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9594,"spinlock_wait_cycles":391033600,"thread_start_us":177259,"threads_started":2,"wal-append.queue_time_us":130031}
I20260709 13:11:47.204120 30590 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.314363 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.321208 30779 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.334317 30535 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.365542 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.364661 30821 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:47.371483 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.371795 27297 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:47.364404 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 303381us
I20260709 13:11:47.374765 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1967) took 1147 ms. Trace:
I20260709 13:11:47.334466 30308 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:47.376045 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:47.377166 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.375288 27226 rpcz_store.cc:276] 0709 13:11:46.227382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.509388 (+282006us) service_pool.cc:224] Handling call
0709 13:11:46.509788 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.539211 (+ 29423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.539237 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.619930 (+ 80693us) log.cc:844] Serialized 26 byte log entry
0709 13:11:46.807424 (+187494us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:46.807483 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.807581 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.374435 (+566854us) raft_consensus.cc:1685] finished
0709 13:11:47.374463 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.374684 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":176281,"threads_started":1,"wal-append.queue_time_us":295152}
I20260709 13:11:47.380729 27297 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:47.384408 27840 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:47.386718 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.387558 27297 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:47.390578 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.370988 30779 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.370803 30499 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:47.361374 30787 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:47.413048 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 218200us
I20260709 13:11:47.394644 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.356534 30678 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.383349 30655 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:47.434327 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.393127 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.435571 27302 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:47.383849 30752 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:47.451422 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 246019us
W20260709 13:11:47.436841 27300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2189) took 1858 ms (client timeout 2310 ms). Trace:
I20260709 13:11:47.446112 27299 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:47.439519 30308 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.410270 30730 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.378139 30689 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:11:47.382659 30821 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:47.452822 27300 rpcz_store.cc:269] 0709 13:11:45.578257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.578401 (+   144us) service_pool.cc:224] Handling call
0709 13:11:47.410146 (+1831745us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540031bad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:47.436653 (+ 26507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396807424}
I20260709 13:11:47.446122 30312 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.477530 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.479440 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.484930 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.500768 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:47.507735 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 464800us
W20260709 13:11:47.507597 27305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.014s	sys 0.024s
I20260709 13:11:47.481729 30739 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:11:47.567618 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67149.9us
I20260709 13:11:47.510847 27297 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:47.476480 30730 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.573822 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1874) took 1884 ms. Trace:
I20260709 13:11:47.492702 30312 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.581723 27297 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:47.583449 27297 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:47.488809 30845 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:47.569561 27305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.033s
I20260709 13:11:47.576022 30253 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.575007 27306 rpcz_store.cc:276] 0709 13:11:45.689539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.699204 (+  9665us) service_pool.cc:224] Handling call
0709 13:11:45.699642 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.699930 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:45.823336 (+123406us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.891068 (+1067732us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18001aff20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:11:47.319504 (+428436us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.573152 (+253648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.573221 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:47.573285 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.573637 (+   352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.573763 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94218,"prepare.queue_time_us":923893,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":36864,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":38169,"spinlock_wait_cycles":7016320,"thread_start_us":790407,"threads_started":3,"wal-append.queue_time_us":413938,"wal-append.run_cpu_time_us":1183,"wal-append.run_wall_time_us":1042730}
I20260709 13:11:47.547922 30850 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.615523 27150 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:47.572662 30417 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:47.548447 30676 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:47.617152 30834 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:11:47.638599 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 197009us
W20260709 13:11:47.620575 30831 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:11:47.646761 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:47.644630 27834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.019s	sys 0.019s
W20260709 13:11:47.648324 27834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.020s	sys 0.019s
I20260709 13:11:47.622949 30417 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:47.644879 30833 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:11:47.639472 30689 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:47.631487 30397 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:47.675628 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2849) took 1369 ms. Trace:
I20260709 13:11:47.655175 30417 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.677799 27223 rpcz_store.cc:276] 0709 13:11:46.305749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.803606 (+497857us) service_pool.cc:224] Handling call
0709 13:11:46.803991 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.804810 (+   819us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:46.804855 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.805469 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.243562 (+438093us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:47.243630 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.243733 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.675277 (+431544us) raft_consensus.cc:1685] finished
0709 13:11:47.675311 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.675537 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":437642,"threads_started":1,"wal-append.queue_time_us":572912}
I20260709 13:11:47.624320 30850 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.658113 30752 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:47.680711 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 201357us
I20260709 13:11:47.618268 30845 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.660410 30787 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:47.676991 30397 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:47.699039 30861 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:47.699312 30838 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:11:47.699945 30836 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:11:47.702216 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 54474.6us
W20260709 13:11:47.696743 30846 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:11:47.702869 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:47.697233 29995 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.899s	user 0.011s	sys 0.003s
I20260709 13:11:47.711052 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:47.709486 29995 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.714277 29995 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:47.712177 30676 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.715559 30787 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.715662 30717 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:47.717582 30717 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:47.718508 30717 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.719352 30717 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.720417 30779 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.721604 27305 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:47.716044 30730 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:47.723284 27839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1317) took 2415 ms (client timeout 1982 ms). Trace:
W20260709 13:11:47.723723 27839 rpcz_store.cc:269] 0709 13:11:45.308119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.458557 (+150438us) service_pool.cc:224] Handling call
0709 13:11:47.723067 (+2264510us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54004a7254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:47.723177 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3233103232}
I20260709 13:11:47.726992 30850 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:47.712595 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.705250 30861 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:47.730508 30861 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:47.730571 30850 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.731603 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:47.732918 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.734366 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.738288 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:47.733470 30850 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:47.735494 30783 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:47.782161 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:47.746263 30860 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.811661 30590 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:47.813086 30654 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.000s
I20260709 13:11:47.737601 30730 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:47.740118 30841 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.815848 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:47.818905 30847 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
W20260709 13:11:47.820425 30436 consensus_meta.cc:287] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.990s	user 0.011s	sys 0.000s
I20260709 13:11:47.823770 30803 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:47.824342 30803 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:47.814617 30843 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:11:47.827762 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:47.806654 30854 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:11:47.815721 30844 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:11:47.837563 27152 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:47.835628 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:47.840483 27156 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.837128 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.826711 30671 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:47.846786 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.845171 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.857259 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.857954 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:47.862865 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:47.867640 27223 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.869375 27297 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:47.872385 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:47.873795 27156 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:47.875756 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:47.875880 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:47.876461 27226 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:11:47.879752 30852 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:11:47.880191 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 766) took 1569 ms. Trace:
I20260709 13:11:47.880738 27228 rpcz_store.cc:276] 0709 13:11:46.311031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.918592 (+607561us) service_pool.cc:224] Handling call
0709 13:11:46.938118 (+ 19526us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:47.003390 (+ 65272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.003424 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:47.004156 (+   732us) log.cc:844] Serialized 78 byte log entry
0709 13:11:47.356612 (+352456us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:47.631654 (+275042us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.649335 (+ 17681us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.657384 (+  8049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.657508 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.876412 (+218904us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4800190158. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:11:47.879825 (+  3413us) raft_consensus.cc:1685] finished
0709 13:11:47.879861 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.880108 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74478,"prepare.queue_time_us":28080,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2123,"raft.queue_time_us":168094,"raft.run_cpu_time_us":3225,"raft.run_wall_time_us":872582,"spinlock_wait_cycles":10575232,"thread_start_us":561013,"threads_started":2,"wal-append.queue_time_us":585586}
W20260709 13:11:47.885406 27225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 1959) took 1660 ms (client timeout 1530 ms). Trace:
W20260709 13:11:47.886801 27225 rpcz_store.cc:269] 0709 13:11:46.224814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.224951 (+   137us) service_pool.cc:224] Handling call
0709 13:11:47.885132 (+1660181us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400094cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:47.885284 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749233920}
I20260709 13:11:47.888121 30678 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:47.892973 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1046) took 1361 ms. Trace:
W20260709 13:11:47.898077 30840 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:11:47.898339 27835 rpcz_store.cc:276] 0709 13:11:46.531431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.653424 (+121993us) service_pool.cc:224] Handling call
0709 13:11:46.653817 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.058409 (+404592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.892714 (+834305us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540010e354. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:47.892906 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897251072}
I20260709 13:11:47.834527 30863 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:47.910342 30817 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.219s	user 0.005s	sys 0.000s
I20260709 13:11:47.912653 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1962) took 1687 ms. Trace:
I20260709 13:11:47.834619 30721 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:47.913118 27232 rpcz_store.cc:276] 0709 13:11:46.225663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.225867 (+   204us) service_pool.cc:224] Handling call
0709 13:11:46.226250 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.232396 (+  6146us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:46.232425 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.249507 (+ 17082us) log.cc:844] Serialized 26 byte log entry
0709 13:11:46.447921 (+198414us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:46.447976 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.448080 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.799189 (+351109us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b4800190158. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:11:47.909553 (+1110364us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:47.912342 (+  2789us) raft_consensus.cc:1685] finished
0709 13:11:47.912369 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.912557 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3555,"raft.run_cpu_time_us":1945,"raft.run_wall_time_us":560222,"spinlock_wait_cycles":76689024,"thread_start_us":161199,"threads_started":1,"wal-append.queue_time_us":358079}
I20260709 13:11:47.803390 30752 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:47.838979 30615 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:11:47.873665 30839 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:11:47.860726 30808 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:47.944304 27223 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:47.838589 30860 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:11:47.826397 30803 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:47.933409 30312 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:47.955199 30779 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.013135 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 771) took 1699 ms. Trace:
I20260709 13:11:48.014667 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2850) took 1701 ms. Trace:
I20260709 13:11:48.013855 27230 rpcz_store.cc:276] 0709 13:11:46.313942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.940590 (+626648us) service_pool.cc:224] Handling call
0709 13:11:46.965260 (+ 24670us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.011577 (+ 46317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.011626 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:47.030981 (+ 19355us) log.cc:844] Serialized 52 byte log entry
0709 13:11:47.458859 (+427878us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:47.459081 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.459163 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.818281 (+359118us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:47.905936 (+ 87655us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b24003c7928. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ead09c4 00007f9a4eaceacb 00007f9a4ec89dc9 00007f9a4ec89a55 00007f9a4ec88fb0 00007f9a518ff488 00007f9a518ffbe8 00007f9a518d7398 00007f9a518d276a 00007f9a518d1bb6
0709 13:11:48.012813 (+106877us) raft_consensus.cc:1685] finished
0709 13:11:48.012844 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.013046 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34253,"raft.queue_time_us":48714,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8040,"spinlock_wait_cycles":82585600,"thread_start_us":382633,"threads_started":1,"wal-append.queue_time_us":556109}
I20260709 13:11:48.015321 27224 rpcz_store.cc:276] 0709 13:11:46.313272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.936670 (+623398us) service_pool.cc:224] Handling call
0709 13:11:46.937098 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.025987 (+ 88889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.026036 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:47.060680 (+ 34644us) log.cc:844] Serialized 52 byte log entry
0709 13:11:47.487619 (+426939us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:47.571891 (+ 84272us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.804317 (+232426us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4800190158. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:11:47.821269 (+ 16952us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b18004502e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:11:48.014193 (+192924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.014305 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.014375 (+    70us) raft_consensus.cc:1685] finished
0709 13:11:48.014394 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.014589 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16533,"prepare.queue_time_us":80914,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":3166,"raft.queue_time_us":96672,"raft.run_cpu_time_us":3659,"raft.run_wall_time_us":787119,"spinlock_wait_cycles":56108032,"thread_start_us":569822,"threads_started":2,"wal-append.queue_time_us":615968}
W20260709 13:11:48.036674 27123 connection.cc:256] RPC call timeout handler was delayed by -1.1518199460001597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:11:48.037516 27123 connection.cc:256] RPC call timeout handler was delayed by -1.0042199460001484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260709 13:11:48.038451 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:48.041165 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:47.966686 30324 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:11:47.956236 30721 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:47.958539 30808 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.058046 30808 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:48.013695 30397 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:48.033432 30783 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:48.065827 30535 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
W20260709 13:11:48.068181 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 175685us
I20260709 13:11:48.073719 30426 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:48.074236 30426 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:48.074622 30693 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.711s	user 0.013s	sys 0.000s
I20260709 13:11:48.072459 30535 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.075142 30426 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.076610 30426 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.077612 30535 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.078379 30730 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:48.078815 30730 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:48.079233 30730 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:48.080783 30855 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.344s	user 0.002s	sys 0.003s
I20260709 13:11:48.082446 30866 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.083375 30762 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.086692 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 740) took 1115 ms. Trace:
I20260709 13:11:48.087085 27305 rpcz_store.cc:276] 0709 13:11:46.971697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.586922 (+615225us) service_pool.cc:224] Handling call
0709 13:11:47.587299 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.722002 (+134703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.086450 (+364448us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54000a5854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:48.086633 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308371328}
I20260709 13:11:48.091365 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.092178 27232 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:48.090209 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1876) took 1490 ms. Trace:
I20260709 13:11:48.092953 27302 rpcz_store.cc:276] 0709 13:11:46.599724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.600907 (+  1183us) service_pool.cc:224] Handling call
0709 13:11:47.435067 (+834160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.450409 (+ 15342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.089986 (+639577us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540031bad0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:48.090146 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917234432}
I20260709 13:11:48.084017 30762 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.095114 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.096956 27225 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:48.098824 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.099581 27225 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:48.095669 30253 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:11:48.103966 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:48.096601 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.105387 27223 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.113831 30717 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:48.114441 30845 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.116086 27225 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:48.121543 27225 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.123876 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.124724 27232 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:48.134042 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.07075e+06us
I20260709 13:11:48.136940 27303 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:48.137354 27303 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:48.138724 30832 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:48.139477 27226 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.146979 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:48.075166 30693 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:48.154094 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.167647 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.168557 27154 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:48.153607 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.169190 27232 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.114488 30717 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:48.152280 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1338) took 1144 ms. Trace:
I20260709 13:11:48.170773 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.172688 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.196332 27223 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:48.195883 27228 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:48.170540 27303 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.202919 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.205220 27228 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:48.195968 27833 rpcz_store.cc:276] 0709 13:11:47.007550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.007695 (+   145us) service_pool.cc:224] Handling call
0709 13:11:47.027980 (+ 20285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.028177 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:47.365296 (+337119us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.151785 (+786489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.151860 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:48.151934 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.152035 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.152201 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532596,"prepare.queue_time_us":68558,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":534699,"spinlock_wait_cycles":47669632,"thread_start_us":590228,"threads_started":2,"wal-append.queue_time_us":334869}
I20260709 13:11:48.212730 27300 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.197592 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.215412 27223 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:48.173008 30815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.010s	sys 0.007s
I20260709 13:11:48.125612 30450 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:11:48.139525 30707 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:48.172513 30678 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.242977 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.244139 27228 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.154518 30701 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.245222 27232 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:48.245563 30868 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:48.243268 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 202194us
I20260709 13:11:48.248448 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:48.238225 30308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.009s
W20260709 13:11:48.244702 30815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.010s	sys 0.008s
I20260709 13:11:48.256723 27123 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:48.253540 27195 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:48.208168 30808 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:48.169207 30723 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:11:48.248631 30742 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.178s	user 0.012s	sys 0.004s
W20260709 13:11:48.249037 30712 consensus_meta.cc:287] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.411s	user 0.010s	sys 0.009s
I20260709 13:11:48.279276 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:48.238736 30669 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:48.276240 30308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.009s
I20260709 13:11:48.287344 27150 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:48.275013 30397 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.287938 30807 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.244211 30436 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:48.251263 30725 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:48.286966 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 140091us
I20260709 13:11:48.307363 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:48.309739 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.309993 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.275305 30450 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:11:48.287737 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 123192us
I20260709 13:11:48.279809 30845 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:48.348917 27156 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:48.354971 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47769.6us
I20260709 13:11:48.355734 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:48.356421 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.253326 30707 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.327441 30721 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.254798 30701 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.253140 30678 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.341001 30671 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:48.326483 30752 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.362950 30450 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:48.342417 30744 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:48.372681 30866 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:48.379674 30721 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:11:48.288843 30717 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.405781 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1055) took 1549 ms. Trace:
I20260709 13:11:48.407158 27838 rpcz_store.cc:276] 0709 13:11:46.856374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.856529 (+   155us) service_pool.cc:224] Handling call
0709 13:11:46.872097 (+ 15568us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:46.872457 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.872488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:46.873028 (+   540us) log.cc:844] Serialized 52 byte log entry
0709 13:11:47.384380 (+511352us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:47.443534 (+ 59154us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.404422 (+960888us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.404789 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.404986 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.405046 (+    60us) raft_consensus.cc:1685] finished
0709 13:11:48.405062 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.405705 (+   643us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":722004,"prepare.queue_time_us":54391,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2938,"raft.queue_time_us":708058,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":39387,"thread_start_us":671536,"threads_started":2,"wal-append.queue_time_us":600274}
I20260709 13:11:48.371757 27304 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:48.345878 30725 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:48.372378 27156 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:11:48.348920 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.290830 30808 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.421379 30725 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.376571 27228 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:48.374524 30732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.007s	sys 0.015s
I20260709 13:11:48.422716 30725 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:48.423007 30732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.008s	sys 0.015s
I20260709 13:11:48.423302 30808 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.423609 30732 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:48.424037 30732 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:48.424829 30732 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.425796 30732 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:48.298583 30742 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.427827 30864 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:48.428083 27227 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.428416 30864 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:48.429852 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2852) took 1800 ms. Trace:
I20260709 13:11:48.430766 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2317) took 1622 ms. Trace:
I20260709 13:11:48.353332 30436 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.432087 30871 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:48.431164 27151 rpcz_store.cc:276] 0709 13:11:46.808739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.809476 (+   737us) service_pool.cc:224] Handling call
0709 13:11:46.827092 (+ 17616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.998968 (+171876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.999014 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.014504 (+ 15490us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.367926 (+353422us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:47.367994 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.430317 (+1062323us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540012bbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:48.430382 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.430448 (+    66us) raft_consensus.cc:1685] finished
0709 13:11:48.430462 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.430698 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1159,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10080,"spinlock_wait_cycles":394207488,"thread_start_us":300056,"threads_started":1,"wal-append.queue_time_us":480586}
I20260709 13:11:48.353179 30807 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.385733 30762 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.369832 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:48.387312 30752 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.418032 30324 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:48.447762 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 78020.5us
I20260709 13:11:48.419447 30884 raft_consensus.cc:1064] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
I20260709 13:11:48.418365 30678 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.274727 30868 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.430261 27227 rpcz_store.cc:276] 0709 13:11:46.629519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.947134 (+317615us) service_pool.cc:224] Handling call
0709 13:11:46.947553 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.428490 (+1480937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.429607 (+  1117us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001257d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:48.429790 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404327808}
I20260709 13:11:48.385406 30450 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:48.456810 30450 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.458120 30450 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.352481 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:48.429375 30864 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.444597 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:48.461242 27302 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:48.432848 30436 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:48.449760 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:48.462672 27305 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
W20260709 13:11:48.464334 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 111953us
I20260709 13:11:48.464941 30752 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.465576 30880 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:48.466825 30880 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:48.467218 30880 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:48.471139 30868 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:48.472790 30867 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:11:48.451545 30324 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:48.476069 30324 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:48.476979 30869 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:11:48.450831 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:48.477797 30880 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.478776 30671 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:48.479261 30671 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:48.480158 30671 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.482798 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.483466 27151 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.484232 30807 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.491616 30850 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.492381 27151 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:48.492221 30850 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.494944 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.495507 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.386973 30730 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.454809 30535 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:48.503082 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:48.445434 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 267200us
I20260709 13:11:48.477038 30752 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:48.427868 30742 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.499385 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:48.433990 30866 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:48.504621 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:48.504694 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.505450 27227 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.516789 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.533761 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.535611 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:48.560635 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2845) took 2311 ms. Trace:
I20260709 13:11:48.561328 27229 rpcz_store.cc:276] 0709 13:11:46.248790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.797962 (+549172us) service_pool.cc:224] Handling call
0709 13:11:46.817245 (+ 19283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.311656 (+494411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.560311 (+1248655us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54001db5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:48.560563 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119245568}
I20260709 13:11:48.451515 30860 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:48.452705 30883 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.570650 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.453874 30693 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:48.576367 27225 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:48.577383 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.585486 27305 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.585906 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:48.471943 30762 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:11:48.576220 30436 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:48.659390 30436 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:48.659936 30436 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.665206 30590 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.667448 30821 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.669315 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:48.670291 30803 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.670531 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:48.402720 30669 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.622541 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.634377 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:48.642871 27833 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:11:48.644162 30876 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 13:11:48.534509 30752 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.655727 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2318) took 1845 ms. Trace:
I20260709 13:11:48.670734 27841 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.617440 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:48.681161 27840 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:48.672646 27153 rpcz_store.cc:276] 0709 13:11:46.810179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.810370 (+   191us) service_pool.cc:224] Handling call
0709 13:11:46.826385 (+ 16015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.840896 (+ 14511us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:47.244651 (+403755us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.932735 (+688084us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b18004326a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a 00007f9a51d41a2a
0709 13:11:48.357509 (+424774us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.358013 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.358162 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:48.358193 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.358262 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.655348 (+297086us) raft_consensus.cc:1685] finished
0709 13:11:48.655476 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.655652 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15339,"prepare.queue_time_us":470707,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":33670,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":20815,"spinlock_wait_cycles":16235776,"thread_start_us":794100,"threads_started":2,"wal-append.queue_time_us":1211143}
I20260709 13:11:48.560501 30811 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:48.529191 30725 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:48.586503 30807 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:48.548231 30535 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.682555 30860 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:48.586723 30654 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
W20260709 13:11:48.706837 30253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.010s
I20260709 13:11:48.619093 30655 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:11:48.699330 30807 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.694439 30850 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:48.711783 30861 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.981s	user 0.011s	sys 0.004s
W20260709 13:11:48.737413 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.715250 30823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.001s	sys 0.024s
I20260709 13:11:48.704386 30811 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:48.620628 30883 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:48.744741 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.763029 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:11:48.730799 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 365979us
I20260709 13:11:48.784731 27123 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:48.711433 30436 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.692731 30725 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:48.717679 30253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.013s	sys 0.011s
W20260709 13:11:48.786495 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.797899 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:48.752544 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 393915us
I20260709 13:11:48.800786 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:48.801184 27804 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.615s (SENT)
I20260709 13:11:48.801888 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:48.716383 30886 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.726279 30889 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.749930 30823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.001s	sys 0.025s
W20260709 13:11:48.755594 27806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.740s (SENT) [suppressed 19 similar messages]
I20260709 13:11:48.693094 30866 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:48.750196 30881 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
W20260709 13:11:48.808929 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 53394.9us
I20260709 13:11:48.721377 30807 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:48.811919 30871 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:48.817040 30426 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.002s
I20260709 13:11:48.818980 30752 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.819384 30883 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:48.820150 30811 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.794309 30693 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:48.793318 30873 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:48.795266 30888 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:48.807576 30707 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.803123 30882 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:11:48.828630 27156 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:11:48.885067 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 84385.9us
I20260709 13:11:48.715852 30860 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:48.871976 30862 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:11:48.868320 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67177.9us
I20260709 13:11:48.803660 30821 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 13:11:48.893518 27804 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.648s (SENT)
I20260709 13:11:48.894147 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:48.757047 30861 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:48.878876 30888 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.829820 30654 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:48.832886 30832 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:48.886861 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:48.929826 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.930935 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:48.863384 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.872273 30426 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.831090 30864 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:48.902657 27153 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.904783 30821 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:48.907241 30879 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:11:48.882638 30863 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.932955 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.942206 27837 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:48.933197 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.942996 27149 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:48.943116 27838 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:48.934832 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.944064 27154 raft_consensus.cc:2376] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:48.944113 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.945127 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.946353 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.826792 30886 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.953569 27151 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 4: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:48.939293 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.945194 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.953379 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.954269 27152 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:48.940374 27148 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:48.955543 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.956478 27149 raft_consensus.cc:2410] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:48.901535 30730 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:48.958166 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:48.956965 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 286472us
I20260709 13:11:48.960436 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.961197 27231 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:48.928635 30654 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.829771 30889 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.927131 30888 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.940907 30821 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:48.965926 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:48.967597 27155 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:48.972232 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.940560 30890 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:48.952069 30875 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:11:48.994514 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:48.995635 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:48.975281 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:48.996595 27157 raft_consensus.cc:2410] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:48.940783 30871 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:48.969919 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.947113 30721 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:48.994326 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.963083 30850 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:11:48.978637 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.984787 27225 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:49.004850 27804 leader_election.cc:336] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.582s (SENT)
I20260709 13:11:48.980149 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.946789 30426 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.959432 30863 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:48.987488 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.982434 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:48.989758 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:48.993727 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:48.974395 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:48.976016 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.013243 27832 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.000018 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:49.007252 30725 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:48.965845 30832 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:48.974244 30654 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:48.967099 30819 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:48.969779 30762 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.030835 27231 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:49.005288 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:48.977909 30897 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:49.001034 30871 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:49.019055 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.018818 30752 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:49.018163 30312 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.024430 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.043883 27155 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:11:49.008018 30878 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:11:48.995302 30535 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.009426 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:49.012660 27149 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:11:49.040967 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.034636 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:49.042338 30894 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:11:49.008417 30669 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:11:49.056233 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46896.9us
I20260709 13:11:49.008566 30864 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:49.059165 30915 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:49.065694 30863 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.067828 30889 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.068606 30889 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:49.069159 30889 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.072242 30832 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.037883 30725 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:49.061331 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.082290 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.018419 30850 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.041036 30871 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.082857 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.043169 30752 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.045764 30312 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:49.059569 30417 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.355s	user 0.010s	sys 0.006s
I20260709 13:11:49.061564 30864 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:49.036883 30819 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.077732 30535 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.114044 30535 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.114516 30535 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.115296 30850 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.061631 30525 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:11:49.116338 30732 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.680s	user 0.004s	sys 0.005s
I20260709 13:11:49.117472 30436 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:49.117923 30436 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.037475 30762 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.122984 30886 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.123165 27152 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:49.108505 30864 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:49.124346 30864 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.125699 30864 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:49.094342 30812 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.126379 30762 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.127671 30426 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.131953 30860 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:49.137228 27271 connection.cc:256] RPC call timeout handler was delayed by -1.3280385720001959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:11:49.139964 27832 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:49.140028 30807 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.142578 27154 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:49.143106 30433 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.143584 30433 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.144687 30433 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.147660 27303 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:49.147851 30535 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:49.148427 30450 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.004s
I20260709 13:11:49.056919 30821 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.149770 30821 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.148901 30807 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.153806 30880 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.150023 30535 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.155074 30819 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.091776 30312 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.093372 30752 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:49.164448 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.145911 30433 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.177909 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:49.160718 30725 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:49.173440 30803 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.007s
I20260709 13:11:49.106192 30417 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.164774 30721 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:49.182871 30655 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:49.209656 30858 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.498s	user 0.011s	sys 0.001s
I20260709 13:11:49.185330 30889 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.210878 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2867) took 1377 ms. Trace:
W20260709 13:11:49.213155 30908 log.cc:927] Time spent T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:11:49.214603 30909 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:49.178717 30892 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:49.219161 27150 rpcz_store.cc:276] 0709 13:11:47.833455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.835156 (+  1701us) service_pool.cc:224] Handling call
0709 13:11:47.863007 (+ 27851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.327216 (+464209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.210542 (+883326us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400069ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:49.210804 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975189248}
I20260709 13:11:49.220084 30892 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.192785 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:49.217650 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 183130us
I20260709 13:11:49.221710 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:49.220472 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 261125us
I20260709 13:11:49.223114 30892 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.227068 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.237502 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.187613 30819 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:49.248665 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.251924 30912 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:49.226348 30525 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.228200 30812 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:49.240301 30679 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.253041 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.252607 30807 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.258494 30883 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:49.258988 30707 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:49.224536 30860 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:49.218081 30655 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.254284 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:49.240911 30891 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:49.253762 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 253791us
I20260709 13:11:49.256667 30725 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.275177 27836 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:49.246369 30819 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:49.277508 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.322870 27837 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:49.281565 27303 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
W20260709 13:11:49.324424 27303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 745) took 1492 ms (client timeout 1639 ms). Trace:
W20260709 13:11:49.285079 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.326537 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.286306 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 90780.4us
I20260709 13:11:49.332700 30701 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.332060 30655 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.333688 30655 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.334471 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.265666 30912 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.328975 30819 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:49.334877 27304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 742) took 2275 ms (client timeout 1740 ms). Trace:
W20260709 13:11:49.337615 30779 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:11:49.290163 30707 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.340260 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:49.294798 30679 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.265421 30525 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:49.351378 27304 rpcz_store.cc:269] 0709 13:11:47.059907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.325387 (+265480us) service_pool.cc:224] Handling call
0709 13:11:49.334664 (+2009277us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000e9554. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:49.334787 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315407744}
I20260709 13:11:49.355594 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:49.324867 27303 rpcz_store.cc:269] 0709 13:11:47.832101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.858771 (+ 26670us) service_pool.cc:224] Handling call
0709 13:11:48.136788 (+278017us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002d8fa0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d3ae18 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6
0709 13:11:49.147100 (+1010312us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b58006dcdd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51c930aa 00007f9a51d15447 00007f9a51d2dfe7 00007f9a51d2f7de 00007f9a51d3b27c 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c
0709 13:11:49.324354 (+177254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842298368}
I20260709 13:11:49.276539 30907 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:11:49.286554 30721 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.355242 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:49.278520 30812 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.289938 30860 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.361409 27149 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:49.291214 30888 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.388635 30888 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.390507 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:49.391495 27155 raft_consensus.cc:2410] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:11:49.392887 27153 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:49.399645 30812 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.289572 30807 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.365288 30850 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.365608 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.368031 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.408704 27154 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:49.359746 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:49.362949 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:49.297492 30654 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.377912 30860 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.378762 27836 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:49.386446 30907 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.344785 30742 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:49.366828 30921 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:49.400240 30417 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.373029 27225 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:49.420882 30921 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.423221 30921 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.404898 30707 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.406162 27840 raft_consensus.cc:2376] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8. Re-sending same reply.
I20260709 13:11:49.362226 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.397585 30871 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:49.412603 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49742us
I20260709 13:11:49.416100 27836 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:49.401528 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.417723 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1340) took 2409 ms. Trace:
I20260709 13:11:49.415228 30907 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.420316 30742 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.439731 27224 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:49.409621 27152 raft_consensus.cc:2376] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:11:49.444968 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.445868 27228 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:49.449359 27230 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:49.451820 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50389.5us
I20260709 13:11:49.443634 27834 rpcz_store.cc:276] 0709 13:11:47.008403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.008517 (+   114us) service_pool.cc:224] Handling call
0709 13:11:47.012499 (+  3982us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.020683 (+  8184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:47.044519 (+ 23836us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.116100 (+1071581us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b18004a5fc0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a55c0b58f 00007f9a4ec4a571 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd
0709 13:11:48.152955 (+ 36855us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:48.201482 (+ 48527us) log.cc:844] Serialized 52 byte log entry
0709 13:11:48.209220 (+  7738us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:48.209281 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.209385 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.187508 (+978123us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:49.417504 (+229996us) raft_consensus.cc:1685] finished
0709 13:11:49.417528 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.417666 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535509,"prepare.queue_time_us":23793,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3889,"raft.queue_time_us":521485,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":35699,"spinlock_wait_cycles":77628416,"thread_start_us":547800,"threads_started":1,"wal-append.queue_time_us":635660}
I20260709 13:11:49.452317 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.452702 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:49.453007 27230 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:49.414090 30783 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.453943 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.455928 27230 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:11:49.458037 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.482640 27232 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:49.411541 30752 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.486714 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:49.410807 30889 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:11:49.493338 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 150771us
I20260709 13:11:49.494760 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.456316 30655 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.456219 30707 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.497795 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.499099 30883 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.499507 30883 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.500439 30883 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.501731 30883 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:49.502606 30919 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:11:49.511397 30912 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.512053 30525 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.513145 30871 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.513525 30807 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.514091 30890 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:49.514705 30890 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.515046 30654 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.515694 30890 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.511475 30752 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.523658 30907 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.524240 30417 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.526669 30417 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.527040 30707 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:49.483014 30819 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.528015 27834 raft_consensus.cc:2368] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10.
I20260709 13:11:49.529178 30417 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.529412 30819 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.482985 30916 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.529922 30916 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:49.458127 30312 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.530342 30916 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.531888 30312 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.496019 30924 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.532768 30924 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:49.533133 30924 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:49.546183 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.549402 30819 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:49.549881 30815 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:49.550484 30819 consensus_queue.cc:1243] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:49.551287 30819 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.551898 30819 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:49.553040 30783 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.552978 30819 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.553645 30783 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.554464 30888 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:49.555158 30819 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.555109 30888 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.558030 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.558440 30742 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.492859 30701 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:11:49.551347 30896 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.560914 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.561641 27232 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:49.562563 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.566543 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.567207 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.569427 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.572427 27835 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:11:49.580464 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.581974 27835 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:11:49.582155 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:49.582566 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.583093 27149 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:49.586730 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.588881 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.590008 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:49.590742 27153 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.587534 27150 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:49.598106 27223 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:49.600638 27149 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:49.603178 30324 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.603817 30324 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:49.607086 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.607596 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.606775 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.612471 27153 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:49.562845 30896 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:49.613818 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:49.575430 30906 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.575974 30915 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.548069 30417 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:49.617789 27155 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:49.625861 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.626799 27835 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:49.583686 30811 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.634644 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:49.632546 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:49.637887 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.581189 30742 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:11:49.642414 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:49.623863 30888 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.640173 30811 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.645064 30865 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:11:49.625226 30701 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:49.644786 30783 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.654105 30324 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.668617 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.642040 30916 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.660952 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.669983 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:49.670419 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:49.671466 27232 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.679214 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.680100 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.681334 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.682013 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.682922 27301 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:49.684736 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.685564 27302 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:11:49.682453 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:49.694165 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.677527 30671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.025s	sys 0.035s
I20260709 13:11:49.698768 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:49.669507 30701 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:49.697661 30671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.025s	sys 0.035s
I20260709 13:11:49.709085 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:49.711010 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.711279 27835 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.686378 30324 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:49.712947 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.713538 30739 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.714046 30739 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.716141 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.717438 27232 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:49.718066 27303 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:49.718963 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.646512 30906 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.719930 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.719348 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.721590 27298 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.710634 30804 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.723172 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.729338 27232 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:49.730346 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:49.737474 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2197) took 2768 ms. Trace:
I20260709 13:11:49.737911 27300 rpcz_store.cc:276] 0709 13:11:46.969160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.511516 (+542356us) service_pool.cc:224] Handling call
0709 13:11:47.511920 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.214015 (+702095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.737201 (+1523186us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540031c4d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:49.737386 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611101952}
W20260709 13:11:49.740243 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.742487 30906 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.744709 30915 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.740618 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:47.742215 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:49.693851 30896 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.754325 30906 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.754729 27150 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:49.718218 30324 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.746680 27228 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:49.758529 30811 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.759141 30324 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.764530 30916 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:49.765183 30916 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:49.766037 30916 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.766445 30916 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.767315 30916 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.771659 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:49.773568 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.773869 30739 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.777068 30896 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.731564 30804 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.775723 30906 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:49.786764 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.788443 30906 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:49.748581 30701 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.792179 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.792856 27299 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:49.793780 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.794873 27300 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:11:49.794881 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.795868 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.796855 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.796959 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.797632 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:49.798835 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.799378 27297 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.802536 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.803300 27306 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:49.814999 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.817413 27231 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:49.836526 30672 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:49.837005 30672 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:49.820720 30861 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.825039 27230 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:49.838689 30672 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.839794 30672 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.824955 30924 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.780462 30804 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:49.826900 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.830686 27837 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:49.832674 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.833992 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.851462 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:49.852393 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.853233 27838 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:49.829154 30436 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:49.854310 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.854707 30436 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.856178 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.837148 27231 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.858129 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.846014 27298 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:49.862388 30864 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:49.863428 30864 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:49.864935 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.865633 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.867796 27838 raft_consensus.cc:2410] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:49.867547 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:49.869999 30906 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:49.870525 30906 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.871037 30906 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.870704 30312 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:49.872044 30752 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.872514 30752 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:49.873529 30752 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:49.875243 30752 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.880262 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:49.882282 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:49.893155 27306 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:11:49.900149 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:49.906229 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.881546 30871 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:49.933264 27840 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:49.881016 30916 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.943521 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:49.945240 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:49.949946 27838 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:49.908764 30721 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.960847 27297 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:49.963063 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:49.969254 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.940062 30859 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:49.971033 30861 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:49.992063 27156 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:49.993559 27838 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:11:49.995363 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:49.996456 27838 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:11:49.998553 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:50.000274 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:50.004102 27044 maintenance_manager.cc:419] P b1a1bf33a5434d58a8638deed0153f03: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033350
W20260709 13:11:50.019676 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 76266.4us
I20260709 13:11:49.979573 30859 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.010571 30861 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:50.022125 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:50.025135 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:50.026612 30721 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.029636 30866 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:50.024724 30948 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:50.034791 30693 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.036446 27835 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.069444 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:50.041219 30712 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.044975 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 808) took 1111 ms. Trace:
I20260709 13:11:50.074623 27156 rpcz_store.cc:276] 0709 13:11:48.933457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.933573 (+   116us) service_pool.cc:224] Handling call
0709 13:11:48.933844 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.992774 (+1058930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.044672 (+ 51898us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003c6254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:50.044898 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433001728}
I20260709 13:11:50.075409 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:50.045979 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1059) took 1115 ms. Trace:
I20260709 13:11:50.047480 27839 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:50.051035 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.052122 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.066018 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:50.071725 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:50.079260 27298 raft_consensus.cc:2376] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4. Re-sending same reply.
I20260709 13:11:50.072604 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.076120 27841 rpcz_store.cc:276] 0709 13:11:48.932272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.932404 (+   132us) service_pool.cc:224] Handling call
0709 13:11:48.951494 (+ 19090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.019160 (+ 67666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.019195 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.019241 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:49.019273 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.045705 (+1026432us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b5400649e54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:50.045765 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.045914 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155079424}
I20260709 13:11:50.080619 27302 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:50.081298 27839 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.022637 30871 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:50.086792 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:50.087527 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.089736 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.071557 30944 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:11:50.079376 30866 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:50.091883 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:50.095304 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.080631 30924 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.074496 30712 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:50.098649 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:50.085798 30417 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:50.099799 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.095896 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:50.101508 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:50.093658 30815 raft_consensus.cc:2764] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:11:50.102164 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.104813 27299 raft_consensus.cc:2376] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5. Re-sending same reply.
I20260709 13:11:50.080158 30897 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:11:50.104912 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:50.105840 30953 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.083570 30943 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:50.089511 30891 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.109038 27271 leader_election.cc:400] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10.
I20260709 13:11:50.111522 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:50.111419 27271 leader_election.cc:403] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.084041 30693 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.114671 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:50.092005 30885 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:50.119416 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:50.108711 30889 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.110776 30815 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:50.111049 30943 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:50.124281 30886 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.141429 30888 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.141623 30886 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.142688 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:50.147807 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.118692 30678 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:50.129325 27298 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:50.110863 30924 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.125226 30701 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:50.169708 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.100859 30861 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.141952 30888 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:50.127424 30821 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10.
I20260709 13:11:50.147079 30886 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:50.161332 30946 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:11:50.114156 30953 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.114324 30891 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:50.178326 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 65492.5us
I20260709 13:11:50.163622 30815 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.161623 30889 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:50.163228 30943 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:50.180359 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.181988 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:50.185364 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.280493 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.281104 27839 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:50.284010 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:50.292999 27833 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:50.166430 30944 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:11:50.301304 27305 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:50.303159 27305 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.272655 30815 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.308538 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:50.310042 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.142874 30871 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.125442 30866 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.167559 30712 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:50.321162 30896 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.001s
I20260709 13:11:50.322297 30889 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.325098 30906 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.352403 30912 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.353190 30912 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.353633 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:50.358927 30783 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.359661 30953 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.359627 30783 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.362246 30671 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.362885 30671 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:11:50.364181 30864 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.003s
I20260709 13:11:50.364699 30864 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.365342 30671 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.367533 30499 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.368234 30499 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.368978 30812 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.369458 30812 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.369796 30812 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.372228 30499 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.375305 30891 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.376004 30590 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.376492 30744 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.404094 30924 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.377063 30900 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:50.316395 30859 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:50.418922 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.421635 30672 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.000s
I20260709 13:11:50.424613 30953 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.478395 30953 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.481307 30953 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.423383 30954 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.486320 30906 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.486653 30954 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:50.458781 30924 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.497517 30924 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.373425 30783 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.403738 30678 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.425957 30590 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.421567 30850 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.446203 30744 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.346562 30815 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.422314 30918 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.377053 30693 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:50.463097 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.546465 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.412729 30712 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.489710 30954 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.546592 30924 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:50.533639 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1362) took 1258 ms. Trace:
I20260709 13:11:50.577081 27837 rpcz_store.cc:276] 0709 13:11:49.275002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.323678 (+ 48676us) service_pool.cc:224] Handling call
0709 13:11:49.830235 (+506557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.849127 (+ 18892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.533267 (+684140us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54004a7250. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:50.533526 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163998976}
W20260709 13:11:50.549456 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.576315 30924 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.583752 30924 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:50.600005 30744 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.507380 30671 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.507773 30916 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.003s
W20260709 13:11:50.606982 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 253428us
I20260709 13:11:50.506819 30850 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:50.511365 30678 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.614017 27834 raft_consensus.cc:2410] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:11:50.614709 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.461599 30900 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:50.619693 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.616125 30954 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.634442 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.635093 30912 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.638144 30886 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.549450 30918 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.611449 30671 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.644816 30590 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.644800 30943 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.647305 30943 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.647825 30815 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.633034 30954 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.650310 30954 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.651751 30678 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.653110 30900 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.632193 30850 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.655193 30671 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.656227 30850 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:50.655503 30436 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.001s
I20260709 13:11:50.663419 30812 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.665766 30812 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.669685 30886 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:50.704418 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.719126 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:50.720849 27228 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.722935 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.723147 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.724406 27224 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:11:50.726317 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:50.731329 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.733014 27231 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:50.735852 27151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2334) took 1908 ms (client timeout 2091 ms). Trace:
I20260709 13:11:50.742041 30436 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.747996 27832 raft_consensus.cc:2410] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:50.751549 30886 raft_consensus.cc:476] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:11:50.743579 27230 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.754478 30783 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:11:50.760408 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.764755 30886 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:50.767534 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.767858 30886 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.765535 30436 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.772935 30436 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:50.775753 30886 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.777202 30954 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.778991 30954 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:50.780570 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.786424 30954 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.790133 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:50.791522 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:50.795699 27148 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:50.748751 27151 rpcz_store.cc:269] 0709 13:11:48.826991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.827224 (+   233us) service_pool.cc:224] Handling call
0709 13:11:50.735283 (+1908059us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:50.735572 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47396608}
I20260709 13:11:50.797035 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:50.801900 27156 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:50.804100 27806 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:50.806052 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.807843 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.806777 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:50.753371 27230 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:50.810245 27224 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:50.812605 27157 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:50.767028 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.813937 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:50.815893 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.815725 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:50.817174 30897 raft_consensus.cc:2764] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:11:50.817425 30312 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.835903 30312 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.787870 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:50.819244 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:50.819371 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.819855 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:50.805691 30932 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.183s	user 0.000s	sys 0.013s
I20260709 13:11:50.821593 30918 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:50.822638 30945 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.808s	user 0.001s	sys 0.013s
W20260709 13:11:50.820150 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 131346us
W20260709 13:11:50.825515 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.826972 30693 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.832280 30954 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:50.840814 27297 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.841678 30312 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:50.842469 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.842514 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.844992 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1891) took 1157 ms. Trace:
I20260709 13:11:50.844955 30693 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.836145 27230 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.845638 27301 rpcz_store.cc:276] 0709 13:11:49.687681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.694703 (+  7022us) service_pool.cc:224] Handling call
0709 13:11:49.704344 (+  9641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.704731 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.704775 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.705384 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.745978 (+ 40594us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:49.746021 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.746104 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.821430 (+1075326us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:50.844344 (+ 22914us) raft_consensus.cc:1685] finished
0709 13:11:50.844367 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.844705 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8349,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6531,"spinlock_wait_cycles":4407040,"thread_start_us":33704,"threads_started":1,"wal-append.queue_time_us":264246}
I20260709 13:11:50.847657 27230 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.848632 30693 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.850267 27154 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:50.835109 27155 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:11:50.839346 27231 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:50.833478 30888 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.841320 30954 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:50.840618 27226 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:11:50.852034 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64640.6us
I20260709 13:11:50.854153 30693 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:50.855563 30918 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.856510 30918 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.859522 30918 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.861290 30918 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:50.856556 30971 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:50.862234 30918 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:50.862722 30971 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:50.863418 30971 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:50.863968 30971 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:50.864560 30907 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.865065 30918 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.866671 30312 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:50.866797 27226 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:50.867122 30693 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.867442 30312 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:50.868067 30693 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.874644 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.874521 30312 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.876446 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 1991) took 1536 ms. Trace:
I20260709 13:11:50.865419 30971 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.879364 30971 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.849382 30884 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.887356 30693 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.887965 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:50.888860 27837 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:50.892112 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:50.892953 27837 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.897969 27306 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:50.898288 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:50.899353 27832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1357) took 1651 ms (client timeout 1571 ms). Trace:
I20260709 13:11:50.900066 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:50.899803 27832 rpcz_store.cc:269] 0709 13:11:49.248136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.248313 (+   177us) service_pool.cc:224] Handling call
0709 13:11:50.899007 (+1650694us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54007b7ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:50.899226 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3444120320}
I20260709 13:11:50.902323 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:50.903240 27304 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.903575 27300 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:50.900264 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.902340 27836 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:50.899370 27229 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:50.909068 27836 pending_rounds.cc:85] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 8
W20260709 13:11:50.913158 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 118934us
W20260709 13:11:50.914276 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 110531us
I20260709 13:11:50.915747 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:50.912386 27836 pending_rounds.cc:107] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:50.918342 27836 raft_consensus.cc:2889] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:50.920537 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:50.925320 27231 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 3.
I20260709 13:11:50.928261 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.930111 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:50.930547 27832 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:50.930210 30669 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:50.932552 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.934799 27154 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:50.934999 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.927911 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.936223 30721 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.931324 30669 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.936991 30721 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.927820 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:50.935786 27303 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 4.
I20260709 13:11:50.938699 27232 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:50.944010 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.944281 27230 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:11:50.944752 27230 pending_rounds.cc:85] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 4
I20260709 13:11:50.945291 30701 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.945605 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1072) took 1239 ms. Trace:
I20260709 13:11:50.946648 27834 rpcz_store.cc:276] 0709 13:11:49.706380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.983658 (+277278us) service_pool.cc:224] Handling call
0709 13:11:50.944068 (+960410us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54004bc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:50.945380 (+  1312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412458240}
I20260709 13:11:50.949010 30765 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.949184 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:50.949786 30765 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.952936 30669 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:50.948508 27230 pending_rounds.cc:107] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:50.965541 27230 raft_consensus.cc:2889] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:50.876865 27225 rpcz_store.cc:276] 0709 13:11:49.339597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.339848 (+   251us) service_pool.cc:224] Handling call
0709 13:11:49.340202 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.372880 (+ 32678us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:49.451092 (+ 78212us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.580914 (+129822us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.345562 (+764648us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180046bee0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:11:50.345750 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.345813 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:50.345866 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.875864 (+529998us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b54000956d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:50.875942 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.876228 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779276,"prepare.queue_time_us":16216,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":779322,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":4829,"spinlock_wait_cycles":104008320,"thread_start_us":112770,"threads_started":1,"wal-append.queue_time_us":185323,"wal-append.run_cpu_time_us":1582,"wal-append.run_wall_time_us":1005979}
I20260709 13:11:50.970124 30752 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.971345 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:50.971802 30752 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:50.977753 27304 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:50.977162 30880 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.979326 30880 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:50.981186 30928 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.598s	user 0.006s	sys 0.007s
I20260709 13:11:50.952966 30765 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:50.992259 27837 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:11:50.981994 30880 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:50.996471 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:50.997437 27834 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:50.998430 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2879) took 1399 ms. Trace:
I20260709 13:11:50.998980 27230 rpcz_store.cc:276] 0709 13:11:49.599229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.839714 (+240485us) service_pool.cc:224] Handling call
0709 13:11:49.840084 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.743200 (+903116us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54003212a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:11:50.991922 (+248722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.998327 (+  6405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010018048}
I20260709 13:11:50.971365 30721 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.006783 30962 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:51.007746 30962 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.009289 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2866) took 1465 ms. Trace:
I20260709 13:11:51.009748 27223 rpcz_store.cc:276] 0709 13:11:49.543945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.571696 (+ 27751us) service_pool.cc:224] Handling call
0709 13:11:49.588442 (+ 16746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.598649 (+ 10207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.008708 (+1410059us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b5400218c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:51.009042 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21155584}
I20260709 13:11:51.010459 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.011184 27154 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 4.
I20260709 13:11:51.011667 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1366) took 1667 ms. Trace:
I20260709 13:11:51.012027 30739 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:51.014467 30866 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:51.014986 30866 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:51.016383 30866 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.013569 30739 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:11:51.012070 27836 rpcz_store.cc:276] 0709 13:11:49.343833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.443406 (+ 99573us) service_pool.cc:224] Handling call
0709 13:11:50.901638 (+1458232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.941189 (+ 39551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.011449 (+ 70260us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54007b7ad0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:51.011595 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3333686656}
I20260709 13:11:51.005784 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:51.023998 30866 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:51.035528 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:51.059798 30739 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.060951 30739 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:51.061710 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.029937 30954 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:51.071568 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:51.131004 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99612.2us
I20260709 13:11:51.129026 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:51.124655 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 140975us
I20260709 13:11:51.075063 27228 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:51.063252 30752 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:51.148679 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 180884us
W20260709 13:11:51.151912 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.135053 30721 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:51.157891 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 152335us
I20260709 13:11:51.161337 27226 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.163297 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.030694 30962 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.168542 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:51.169481 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.172026 27154 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:11:51.174216 30725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.688s	user 0.005s	sys 0.014s
W20260709 13:11:51.174664 30725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.789s	user 0.006s	sys 0.014s
W20260709 13:11:51.175978 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 199094us
I20260709 13:11:51.177095 27840 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:11:51.178354 30819 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:51.179888 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108325us
W20260709 13:11:51.184250 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.191149 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.199651 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.208412 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:51.215540 30863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:11:51.216138 30863 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:51.216688 30863 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:51.218292 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:51.223505 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.225035 30397 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:51.225528 30397 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.225941 30397 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.231557 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.231549 27156 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:51.233819 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.235989 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.237679 27155 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:51.236620 27301 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:51.241577 30863 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:51.244473 30873 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:51.259533 30873 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:51.244313 30712 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:51.256855 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:51.265466 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 55982.4us
I20260709 13:11:51.194736 30312 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:51.269289 27835 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:51.272889 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:51.250402 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.254515 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.253649 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1064) took 1559 ms. Trace:
I20260709 13:11:51.228569 30725 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:51.277316 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.256171 27306 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:51.279002 27840 rpcz_store.cc:276] 0709 13:11:49.693764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.009070 (+315306us) service_pool.cc:224] Handling call
0709 13:11:50.009476 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.177532 (+1168056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.253300 (+ 75768us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005a1c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:51.253557 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683959040}
I20260709 13:11:51.280583 27154 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:51.280686 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.285254 27151 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:51.289613 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.290293 30939 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.290194 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.291220 27301 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:51.292011 27302 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:51.293684 30725 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.294103 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.299209 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:51.302408 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.303092 27153 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:51.304142 27304 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:51.304934 30892 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:51.305248 27302 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.305421 30892 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:51.306679 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71180.1us
I20260709 13:11:51.308013 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.309011 30712 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.309433 30712 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:51.309813 30712 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.311311 27149 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:51.311738 27153 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:51.315644 30873 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:51.316912 30978 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.058s	user 0.002s	sys 0.002s
I20260709 13:11:51.318818 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.319125 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.300621 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.326669 27157 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.337658 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64084.7us
I20260709 13:11:51.283008 30739 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:51.340577 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 68889.1us
I20260709 13:11:51.330032 30886 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.375721 27148 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
W20260709 13:11:51.385026 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.380617 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.357990 30739 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:11:51.415804 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57165us
I20260709 13:11:51.382606 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:51.382879 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:51.424440 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.426039 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 63969.1us
I20260709 13:11:51.434412 27150 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:51.435247 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.439548 27306 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.385326 30725 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:51.414317 27055 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 5 to 7, now has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:51.443311 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:51.444101 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 63630.8us
W20260709 13:11:51.446532 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 64095.2us
I20260709 13:11:51.450294 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:51.451438 27836 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:51.452234 30815 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:11:51.452896 30815 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:51.380812 30882 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.417070 30312 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:11:51.456707 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:51.468742 27302 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:51.388746 30886 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.476609 30417 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.478657 30892 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.483294 30882 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.484383 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.478832 30712 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:51.463598 30739 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:51.488806 30960 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:51.494307 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 55250.6us
I20260709 13:11:51.463295 30863 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.509218 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:51.510901 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.511822 27148 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
W20260709 13:11:51.505102 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49064.8us
I20260709 13:11:51.508031 30739 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.510370 30863 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:51.517666 27149 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:51.516690 27157 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
W20260709 13:11:51.514199 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45449.7us
I20260709 13:11:51.506460 27055 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 4 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:51.530821 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.533903 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:51.533773 27833 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:51.517266 30863 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.508442 30960 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:51.517447 30739 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:51.548575 27302 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.555279 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.557276 27153 pending_rounds.cc:85] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 6
I20260709 13:11:51.557662 27153 pending_rounds.cc:107] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:11:51.532687 30892 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.557901 27153 raft_consensus.cc:2889] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.544101 30888 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.568507 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:51.524113 30954 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:11:51.569273 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.550132 30725 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.567641 27297 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:51.577471 27150 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.579248 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.581041 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.581821 27150 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:11:51.557335 30962 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.583945 27301 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:51.583762 30962 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.586205 30717 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.587378 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.588011 30962 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.588160 27833 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:51.589661 30921 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:51.590335 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:51.592808 30907 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.008s
I20260709 13:11:51.594496 30960 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.595111 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.595687 30960 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:51.596033 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.596832 30880 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:51.597262 30880 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.597637 30880 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:51.597822 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.598191 30725 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.598394 30397 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:51.606608 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.606704 27304 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:51.606441 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.607719 27148 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:51.611068 27055 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:11:51.614208 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 89065.7us
I20260709 13:11:51.617162 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:51.618938 27834 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:51.619490 30815 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.619616 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.619969 30815 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.620426 30815 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.621035 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:51.621788 27226 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:51.622390 30943 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:51.623013 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.623745 27833 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:51.624756 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.613641 27055 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.608917 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.631909 27836 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:51.632300 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.627787 30752 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:51.633365 30717 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:51.633251 30752 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.638818 30886 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:51.639559 27228 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:51.640583 30752 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.607127 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:51.642590 27838 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.643010 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:51.643707 27226 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:51.629751 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46778.8us
I20260709 13:11:51.634737 30882 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:51.636812 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:51.637714 30954 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.637768 27122 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:51.638486 30397 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:51.624651 30324 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:11:51.634770 30717 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:51.618968 30712 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:51.656152 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88239.7us
I20260709 13:11:51.658478 27225 pending_rounds.cc:85] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:11:51.663884 27225 pending_rounds.cc:107] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:51.664203 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:51.664913 27230 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.664170 27225 raft_consensus.cc:2889] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.666555 30926 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:51.667071 30926 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.667474 30926 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.664510 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:51.669672 27229 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.670574 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:51.658771 27223 raft_consensus.cc:2376] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7. Re-sending same reply.
I20260709 13:11:51.661227 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.673346 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.674630 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.614637 30865 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:51.689888 30865 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.692248 30865 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.693552 27841 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:51.698515 30679 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:51.700279 30679 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:51.700457 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:51.659657 30752 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:51.671561 30815 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.679064 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:51.679474 30986 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:51.653446 30943 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:51.684778 30886 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.685541 30804 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.680428 27055 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.686312 27832 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:11:51.688925 27866 heartbeater.cc:646] Failed to heartbeat to 127.25.109.190:33321 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.109.190:33321 timed out after 15.000s (SENT)
I20260709 13:11:51.679672 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:51.750290 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:51.751029 27229 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:51.751245 27157 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
W20260709 13:11:51.752480 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72889.2us
I20260709 13:11:51.661538 30717 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:51.707582 30765 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:51.764935 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 101466us
I20260709 13:11:51.771893 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.664139 30417 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.772944 27833 raft_consensus.cc:2410] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:51.771260 27838 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:11:51.780843 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.781600 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.728449 30752 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.712404 30865 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:51.795971 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.799834 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 99430.6us
I20260709 13:11:51.672133 30954 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.794754 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.784870 30397 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.806399 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:51.783074 30986 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:51.803845 27841 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:51.782580 30701 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:51.767251 30960 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:51.797180 30752 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.776373 30312 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:11:51.771922 30886 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.771946 30804 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:51.826529 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 117535us
I20260709 13:11:51.853782 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.804152 30725 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:51.803211 30939 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.832304 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:51.796548 30971 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:11:51.842633 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 51024.2us
I20260709 13:11:51.844031 30765 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.813956 30397 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.843885 30717 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:51.850180 30918 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:51.814455 30417 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.799243 30865 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:51.854840 27838 raft_consensus.cc:2410] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:51.857120 27839 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:51.820351 30960 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:51.874578 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.883882 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:51.860118 30939 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.822880 30926 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.869845 30765 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:51.889492 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:51.897321 27150 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.878662 30701 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.876765 30397 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.959022 27836 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:11:51.948033 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 157986us
I20260709 13:11:51.950778 27832 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:51.906401 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:51.946768 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.914800 27055 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 6 to 7, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:51.960086 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:52.011768 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51780.8us
W20260709 13:11:51.926497 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 94281us
I20260709 13:11:51.910300 27833 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.907045 27157 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:51.885772 30865 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.892225 30679 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:52.012717 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:52.022163 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 150571us
I20260709 13:11:51.884078 30324 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:51.892457 30960 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.908049 30939 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.959028 30765 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.932832 30954 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.946411 30921 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.902573 30417 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:51.919049 30717 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.915006 30815 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:52.062531 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 178713us
I20260709 13:11:52.045572 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:52.063378 27154 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:11:52.016302 27271 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:52.064553 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:52.064651 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48487.7us
I20260709 13:11:51.937813 30886 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:52.061312 27297 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:52.026087 30971 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.898205 30739 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:51.936681 30804 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.066572 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:52.076028 27838 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:52.063453 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:51.913810 30863 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:52.045995 30866 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:52.059015 27055 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 5 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 6 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.082162 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.082851 27228 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.073879 27839 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:11:52.083508 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 49496.4us
I20260709 13:11:51.891999 30986 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:52.079916 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 152612us
I20260709 13:11:52.059860 30921 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:52.084235 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:52.098040 30880 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.102262 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.103001 27229 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:52.106431 30712 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:52.107558 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.107200 30712 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.111622 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.112406 27229 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:52.112411 27223 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:52.113988 30880 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.049120 30873 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:11:52.116657 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:52.074582 30971 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.126287 27226 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:52.109795 30712 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.074041 30417 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:52.133970 27841 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:11:52.083020 30892 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:52.135504 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:52.091571 30866 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:52.079641 30918 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:52.143985 27055 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 2 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:52.115258 30943 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.129086 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:52.138720 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 66120.6us
I20260709 13:11:52.134483 27841 pending_rounds.cc:85] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 7
I20260709 13:11:52.147229 27840 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:52.147274 27841 pending_rounds.cc:107] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:52.148181 27841 raft_consensus.cc:2889] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:52.113906 30886 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.077099 30324 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.130558 30971 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.074298 30882 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:52.158615 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:52.153714 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 105218us
I20260709 13:11:52.139390 30712 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:52.142928 30866 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:52.150658 30990 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:52.162916 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:52.137728 30417 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:52.163822 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 69178.6us
I20260709 13:11:52.166453 27228 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:52.164127 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:52.160458 30888 consensus_meta.cc:287] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.002s
I20260709 13:11:52.178260 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:52.178879 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:52.181324 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:52.186508 30701 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.191175 30918 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.157388 30804 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:52.151017 30312 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:52.207878 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:52.209213 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 66011us
I20260709 13:11:52.227743 27305 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
W20260709 13:11:52.232688 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.233047 27054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 384) took 15727 ms (client timeout 15000 ms). Trace:
I20260709 13:11:52.158277 30886 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.174171 30417 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.193718 30811 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:52.180545 30712 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:52.252990 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 77763us
I20260709 13:11:52.172034 30943 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.262866 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:52.263114 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:52.263562 27833 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.263712 27838 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:52.287679 30308 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.236326 30926 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.238679 30888 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:52.236148 30701 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.260679 30921 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.239167 30725 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:52.295871 30712 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.264518 31000 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.308478 27833 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:11:52.310528 27305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1916) took 1460 ms (client timeout 1773 ms). Trace:
I20260709 13:11:52.313819 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.236979 30880 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:11:52.315572 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:52.328418 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:52.329862 27305 rpcz_store.cc:269] 0709 13:11:50.840131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.841918 (+  1787us) service_pool.cc:224] Handling call
0709 13:11:52.289999 (+1448081us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540031c9d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:52.300494 (+ 10495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3182736768}
W20260709 13:11:52.317160 31005 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:11:52.321149 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 271526us
I20260709 13:11:52.333237 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.333393 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.334290 27223 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:52.334869 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:52.354440 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 189418us
I20260709 13:11:52.357396 27231 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:52.322578 30811 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:52.253875 30804 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.326073 30725 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:52.335466 31007 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:52.375830 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 259240us
I20260709 13:11:52.377434 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.344576 30882 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.381851 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:52.384827 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:52.236105 27054 rpcz_store.cc:269] 0709 13:11:36.328853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.329265 (+   412us) service_pool.cc:224] Handling call
0709 13:11:52.056323 (+15727058us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:44.678893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:44.679705 (+   812us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:44.679761 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:11:44.679779 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:44.681559 (+  1780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:44.681679 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:44.681708 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:44.914491 (+232783us) tablet.cc:701] Row locks acquired
0709 13:11:44.914576 (+    85us) write_op.cc:260] PREPARE: finished
0709 13:11:44.914812 (+   236us) write_op.cc:270] Start()
0709 13:11:44.915020 (+   208us) write_op.cc:276] Timestamp: P: 1783602704914729 usec, L: 0
0709 13:11:44.915046 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:44.916080 (+  1034us) log.cc:844] Serialized 7631 byte log entry
0709 13:11:45.999163 (+1083083us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.497464 (+498301us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a5576def0
0709 13:11:46.838450 (+340986us) write_op.cc:301] APPLY: starting
0709 13:11:46.838546 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.838946 (+   400us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.838979 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:46.887571 (+ 48592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:46.887941 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:11:46.887996 (+    55us) write_op.cc:312] APPLY: finished
0709 13:11:46.888419 (+   423us) log.cc:844] Serialized 132 byte log entry
0709 13:11:47.361273 (+472854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.370729 (+  9456us) write_op.cc:454] Released schema lock
0709 13:11:47.378151 (+  7422us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:47.447304 (+ 69153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.449861 (+  2557us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6689,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":808367,"apply.run_cpu_time_us":54299,"apply.run_wall_time_us":559425,"num_ops":19,"prepare.queue_time_us":232024,"prepare.run_cpu_time_us":23323,"prepare.run_wall_time_us":446601,"raft.queue_time_us":244967,"raft.run_cpu_time_us":54358,"raft.run_wall_time_us":1013304,"replication_time_us":1031101,"spinlock_wait_cycles":6470528,"thread_start_us":1681895,"threads_started":5,"wal-append.queue_time_us":983187,"wal-append.run_cpu_time_us":22249,"wal-append.run_wall_time_us":2758321}]]}
I20260709 13:11:52.388198 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.392503 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:52.398633 27224 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.401456 27230 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.402005 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.324712 30308 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.361140 30954 raft_consensus.cc:2764] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:11:52.403990 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48061.5us
W20260709 13:11:52.393637 30993 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:52.331396 30701 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.382217 30921 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.388813 30725 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:52.382808 30739 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.447571 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.449043 27231 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:52.412676 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.457005 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.457690 27231 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:52.458632 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.459710 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.461701 27223 raft_consensus.cc:2376] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8. Re-sending same reply.
I20260709 13:11:52.462833 30886 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:52.463089 27223 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:52.464309 27223 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:52.358003 31000 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.410290 30892 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:52.475170 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 212297us
I20260709 13:11:52.382694 30863 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.482769 27226 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:52.447167 30324 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:52.410022 30986 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:11:52.498711 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:52.498708 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 317454us
I20260709 13:11:52.410120 30882 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.469565 31011 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:52.514834 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 159484us
I20260709 13:11:52.467779 30811 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.500176 27232 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:52.525749 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.528138 30939 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.530997 30939 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:52.532922 30765 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:52.538574 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 275345us
I20260709 13:11:52.541972 31009 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:52.543306 31009 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:52.543872 31009 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.544664 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:52.544555 31004 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:52.552452 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.552627 31004 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:52.553709 31004 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.555099 31004 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:52.555766 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:52.558333 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.558969 27226 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:52.562888 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:52.563805 30821 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:52.564275 30821 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:52.564641 30821 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.565460 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.566437 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.578336 27225 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.576136 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:52.582669 30765 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.584749 30821 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.588377 30765 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.590606 30765 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.597432 30821 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:52.599817 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:52.600643 30971 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.605145 31009 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.606977 30765 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:52.589962 27230 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:52.613715 27223 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:52.402649 31007 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.622599 27226 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:52.622783 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108098us
W20260709 13:11:52.623206 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59941.9us
I20260709 13:11:52.625155 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:52.622303 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 173890us
I20260709 13:11:52.627800 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:52.518360 30880 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:52.521839 31011 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.518908 30739 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.634317 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.484409 31017 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:11:52.515249 31012 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:52.661935 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48925.7us
I20260709 13:11:52.666690 27229 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:52.638955 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:52.668622 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.611765 30943 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:52.716885 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 281748us
W20260709 13:11:52.719022 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 91295.1us
I20260709 13:11:52.726745 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:52.738629 30397 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
W20260709 13:11:52.739574 27832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.019s	sys 0.054s
W20260709 13:11:52.762420 27832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.019s	sys 0.054s
I20260709 13:11:52.631469 31009 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.743759 27232 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:52.758903 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:52.660815 31011 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:52.786741 27226 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:52.791316 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.793099 27223 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:52.718804 30880 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:52.739221 30821 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:52.733647 30971 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.795486 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.785180 31004 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.836946 27231 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:11:52.838402 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 227690us
W20260709 13:11:52.825800 31021 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:52.758193 30739 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:52.827021 30752 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.952s	user 0.007s	sys 0.013s
I20260709 13:11:52.848122 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:52.739830 30892 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.837857 30997 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:52.788084 30397 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.867280 27231 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:52.859486 27232 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
W20260709 13:11:52.842442 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 214145us
W20260709 13:11:52.842929 31014 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:11:52.839052 31012 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:52.792497 31009 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.828938 30324 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:11:52.844035 31004 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.898923 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:52.864795 30821 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:52.860347 30752 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.885317 30943 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:52.900734 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 60020.9us
I20260709 13:11:52.930279 27225 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:52.932616 27156 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
W20260709 13:11:52.934506 27224 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:11:52.935034 27224 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
W20260709 13:11:52.940089 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 181330us
I20260709 13:11:52.941416 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:52.942687 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:52.941742 27833 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:52.942132 30873 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:11:52.943275 27832 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:52.901842 30804 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:52.949690 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:52.887651 30986 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:11:52.938469 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:52.950387 27301 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:52.955495 30865 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.000s
I20260709 13:11:52.956143 30926 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:52.956019 30865 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:52.914799 30821 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:52.971316 30717 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.003s
I20260709 13:11:52.976739 31015 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.977392 31015 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.948767 31000 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:52.983135 31013 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:11:52.945631 30417 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.000s
I20260709 13:11:52.970986 31012 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.939162 30312 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:11:52.988775 27807 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.508s (SENT)
W20260709 13:11:52.972628 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 126957us
W20260709 13:11:52.987834 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47049.1us
I20260709 13:11:52.987998 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:52.989778 27832 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
W20260709 13:11:53.005478 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67110.4us
W20260709 13:11:52.977921 30866 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.001s
I20260709 13:11:52.977838 31025 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:53.020498 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.021423 27835 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:53.023665 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.025410 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:52.938419 30880 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:52.986622 30417 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.017310 31001 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:53.018077 31025 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:53.036005 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 516128us
I20260709 13:11:53.019515 31007 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:53.043593 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.031435 30892 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:53.046480 27301 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:53.046898 27305 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:53.048962 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60227.5us
W20260709 13:11:53.049702 27807 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.573s (SENT)
I20260709 13:11:53.050016 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.017975 30866 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:53.048592 31020 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:11:53.041819 31001 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.042093 30804 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:53.069947 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:53.070474 27153 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:53.052440 30717 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.076699 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:53.049050 30892 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.071357 31001 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:53.102854 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 151023us
I20260709 13:11:53.085597 30892 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.107538 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:53.087918 30815 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.091776 30863 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:53.122112 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 72098.9us
I20260709 13:11:53.075882 30804 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.125684 31039 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.126291 31040 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:53.137862 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85877.1us
I20260709 13:11:53.091141 30717 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:53.116750 31026 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:11:53.107627 30765 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:11:53.139223 31043 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:11:53.151571 30725 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.003s
I20260709 13:11:53.183656 30725 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.153487 31039 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.188535 31039 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.170855 31015 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.144232 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1094) took 1094 ms. Trace:
W20260709 13:11:53.175884 31046 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:53.120816 30815 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.182415 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.150462 31040 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:53.143211 31000 raft_consensus.cc:2764] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:53.111531 30712 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:11:53.201557 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:53.207002 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99632.9us
I20260709 13:11:53.208189 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:53.210244 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.205876 31035 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:53.218664 30866 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.218828 31009 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.211704 27839 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:53.189891 27837 rpcz_store.cc:276] 0709 13:11:52.050323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.052547 (+  2224us) service_pool.cc:224] Handling call
0709 13:11:52.067780 (+ 15233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.076088 (+  8308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.076136 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:52.091317 (+ 15181us) log.cc:844] Serialized 26 byte log entry
0709 13:11:52.502424 (+411107us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:52.502506 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.502608 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.143897 (+641289us) raft_consensus.cc:1685] finished
0709 13:11:53.143931 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.144147 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3643,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12394,"thread_start_us":351612,"threads_started":1,"wal-append.queue_time_us":533640}
W20260709 13:11:53.197975 30921 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.000s
I20260709 13:11:53.227417 30717 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.207882 30417 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.234321 27156 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:53.200703 30815 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:53.244289 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.245011 27154 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
W20260709 13:11:53.245198 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.739s (SENT)
I20260709 13:11:53.221050 31039 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:53.201063 31040 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.220525 30804 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:53.264904 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 175874us
I20260709 13:11:53.270450 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.282595 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:53.283483 30717 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:53.283975 30717 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:53.284956 30717 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.248005 30417 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.247370 30725 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.288362 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.269379 31039 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:53.276197 30921 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.331614 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61331.6us
W20260709 13:11:53.280763 30960 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.224s	user 0.016s	sys 0.000s
I20260709 13:11:53.303157 27154 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
W20260709 13:11:53.327255 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 102839us
W20260709 13:11:53.337610 27807 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.763s (SENT)
I20260709 13:11:53.237587 31001 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.335080 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.339459 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.341140 27157 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 5: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:53.333683 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.341734 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:53.338147 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.345768 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.348804 27156 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:53.277784 30986 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:11:53.334746 30866 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:53.380003 27197 connection.cc:256] RPC call timeout handler was delayed by -1.0904214019999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:11:53.385254 27197 connection.cc:256] RPC call timeout handler was delayed by -1.0904214019999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:11:53.343590 31015 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:53.386379 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.345564 30804 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:53.325807 30417 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:53.395100 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57551.7us
I20260709 13:11:53.395882 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:53.396373 27833 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.398747 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.391682 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:53.400730 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:53.401499 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69117.3us
I20260709 13:11:53.340269 30921 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.344755 30960 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.394649 31028 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:53.418337 27840 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:53.423640 27840 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:53.427158 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.436810 27157 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.437247 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.437973 27833 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.427489 27840 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.444756 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.449621 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.449847 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.450862 27833 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:53.450767 27155 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.455513 27840 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:53.420552 31028 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:53.462277 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 76320.2us
I20260709 13:11:53.471462 27157 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:53.475570 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.477232 30701 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.486696 30752 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.488093 31004 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.481283 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:53.521071 27197 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:53.521489 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.522378 27833 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:53.495824 31028 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.453765 31035 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:53.465837 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:53.494410 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:53.465306 31057 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:53.486021 31056 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:11:53.494508 31048 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:11:53.487967 31060 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:53.488989 31001 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.485509 30921 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.470079 31015 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:53.472702 31025 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.475857 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.492947 30865 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.468596 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.565200 27156 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:53.439472 30815 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:53.538321 30954 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:53.523965 27152 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.531459 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.575533 27834 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:53.575815 27838 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:53.534353 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:53.551149 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:53.552385 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:53.552964 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:53.577270 27230 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.499348 30739 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.580976 31003 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:53.581422 31003 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:53.581782 31003 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.582325 31038 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:53.582921 31038 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:53.585276 31038 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:53.586457 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:53.587158 27232 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:11:53.588317 31055 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:11:53.589505 31063 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:11:53.594662 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:53.558522 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:53.595815 27227 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.559028 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:53.596719 27231 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.558584 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:53.512161 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 82326.3us
I20260709 13:11:53.597393 27229 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:53.562523 30701 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:53.598317 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:53.579123 31053 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:53.619552 31053 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.579603 31033 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:53.601671 27840 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:53.606410 27224 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:53.630745 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.609465 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:53.615371 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 116787us
W20260709 13:11:53.615585 31048 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:53.616065 31068 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:53.617995 30960 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.561757 30752 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:53.622741 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 88504.1us
W20260709 13:11:53.624773 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73756.3us
I20260709 13:11:53.630962 27840 pending_rounds.cc:85] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 5
I20260709 13:11:53.643440 27840 pending_rounds.cc:107] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:53.643673 27840 raft_consensus.cc:2889] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.610394 31015 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:53.638433 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:53.654371 30882 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.659680 31015 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.665620 31015 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.671559 30417 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:53.672043 31039 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.673492 31039 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:53.632464 31038 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:53.674427 31038 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:53.675537 31038 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.622359 31056 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:53.682519 31056 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.684787 31056 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:53.687073 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.687744 27156 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.657709 30308 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:53.623364 30701 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:53.697584 30701 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.699028 30701 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:53.709474 27225 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:53.629089 31025 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.727991 27231 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:53.634503 30971 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:53.741536 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 92094us
W20260709 13:11:53.765244 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.741824 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 62918.6us
W20260709 13:11:53.742504 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.735950 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:53.784343 27225 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:11:53.739365 27228 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:53.731499 27230 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:53.783054 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:53.792865 27156 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:53.796491 27151 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:53.791117 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:53.789048 27804 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.830s (SENT) [suppressed 41 similar messages]
W20260709 13:11:53.719806 30892 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 13:11:53.802152 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:53.728278 31066 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:11:53.811750 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:53.824528 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:53.825740 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 191254us
W20260709 13:11:53.827816 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 436308us
I20260709 13:11:53.829730 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:53.756529 30752 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:53.782388 30863 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:53.793298 30397 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.792604 30865 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.836138 27272 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:53.841090 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.839915 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:53.846364 30717 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:53.761245 30960 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:11:53.648644 30954 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.827584 31004 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:53.851897 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:53.818746 30971 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:53.827363 30811 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.846748 30821 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:53.841214 31011 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.986s	user 0.010s	sys 0.003s
I20260709 13:11:53.864638 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:53.838140 31001 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:53.833652 31012 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:53.866437 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 268181us
I20260709 13:11:53.868887 27305 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:53.877559 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 96458us
I20260709 13:11:53.838126 30863 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:53.847409 30324 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:53.837184 30986 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:53.718044 31003 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.846792 30717 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.828157 30892 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.847151 30865 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.893051 31079 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:53.888863 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:53.896289 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 402012us
I20260709 13:11:53.922672 30921 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:53.922885 31024 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:11:53.907639 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:53.864886 31004 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.816327 31053 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:53.940333 31040 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.653s	user 0.003s	sys 0.008s
I20260709 13:11:53.943003 31040 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.945380 31040 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.945910 31004 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.946035 31080 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:53.946177 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.910275 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:53.887905 30821 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.949141 30821 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:53.898993 30811 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.952306 30811 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.919538 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:53.954119 31003 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:53.954414 27841 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:53.955629 30971 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:53.956749 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:53.956875 31058 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:11:53.957839 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:53.919584 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:53.923182 30921 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:53.899348 30397 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:53.903208 31001 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:53.912810 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 77866.9us
W20260709 13:11:54.025417 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 176458us
I20260709 13:11:53.899829 30324 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.900740 30863 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.899887 31012 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:53.959221 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 51665.6us
W20260709 13:11:53.963037 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52849.8us
I20260709 13:11:53.914108 30986 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:53.998858 30815 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:54.002250 31076 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:11:53.913880 30717 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.001802 31080 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:53.956786 31059 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.043046 27297 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:54.024781 30397 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.958135 31058 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:53.903841 31022 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.023401 27841 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:53.903438 31011 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.028649 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:54.027650 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:54.068994 27838 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:54.036201 27223 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:54.037390 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:54.038367 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 80601us
I20260709 13:11:54.033439 30815 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.005308 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.077524 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:54.040812 31080 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.078326 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.030370 31001 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.033907 30324 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:54.066496 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.033751 31012 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.039057 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.057750 31049 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.062556 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.103274 27301 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:54.006856 31040 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:54.078464 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45394.1us
W20260709 13:11:54.109758 27123 connection.cc:256] RPC call timeout handler was delayed by -1.3391544589999285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:11:54.081127 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50085.1us
I20260709 13:11:54.081259 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.085054 30739 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.063789 31059 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.080880 30815 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.034139 30804 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:11:54.029780 31068 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:11:54.090366 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.150840 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:54.151279 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60992.3us
I20260709 13:11:54.151666 27306 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:54.090545 31073 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.108s	user 0.000s	sys 0.005s
I20260709 13:11:54.090960 30882 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:54.091415 31085 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:54.092209 30954 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.095502 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.065706 30397 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:54.096415 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 68845.3us
I20260709 13:11:54.030169 31015 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:11:54.110209 27123 connection.cc:256] RPC call timeout handler was delayed by -1.1213544590000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:11:54.066200 31058 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:54.072826 31035 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.147037 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 106566us
I20260709 13:11:54.095841 31080 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.171584 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.152657 31040 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:54.151978 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:54.158900 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 127204us
I20260709 13:11:54.031984 30752 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.181350 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.160471 30882 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:54.163084 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67662.1us
I20260709 13:11:54.181994 27150 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:54.102903 31049 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.169323 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.171247 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.155534 31003 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.080308 31022 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.161665 30725 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.177832 27306 raft_consensus.cc:2410] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:54.182005 27157 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:54.112062 30926 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:54.183519 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.165920 30308 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:54.190542 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.191432 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.192313 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.193154 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.231639 27840 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:54.194453 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.194542 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.195401 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.196189 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.233482 27156 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:11:54.196920 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.196786 31040 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.196199 31059 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.094934 30921 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.198132 31089 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.199892 31074 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.205495 27151 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:54.146554 30739 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.247864 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.248071 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.248652 27305 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:54.226801 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.227665 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:54.235698 31090 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:11:54.205173 30882 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.231854 27299 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:54.239156 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.224131 30725 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.177222 31035 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.232188 27840 pending_rounds.cc:85] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:11:54.261170 27840 pending_rounds.cc:107] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:11:54.261461 27840 raft_consensus.cc:2889] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.249140 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.261562 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.219787 30804 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.251264 27156 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:54.214995 31049 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:54.264925 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86984us
I20260709 13:11:54.270327 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.270167 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.271207 27305 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.271332 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.272200 27302 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:54.276332 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.275231 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.279573 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.283453 27152 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:54.248685 31074 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.262396 30865 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.251890 30308 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:54.318521 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.241043 31004 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.285247 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.265807 30804 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.260322 30954 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.260740 30725 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:54.313472 27123 leader_election.cc:336] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.563s (SENT)
I20260709 13:11:54.315117 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.329523 27156 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.267026 31024 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.285917 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.332628 27302 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:54.333113 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.330260 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:54.334089 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 160613us
I20260709 13:11:54.336011 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:54.338627 27123 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.805s (SENT)
I20260709 13:11:54.339576 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.266744 30821 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.348606 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.316691 31059 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.341857 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.308812 31074 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:54.332968 31072 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.003s
I20260709 13:11:54.324441 30804 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.353456 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.356231 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.332357 31024 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.357781 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:54.368417 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.331400 30986 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.329803 31015 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:54.340507 30926 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:54.350922 31011 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.383808 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.244689 31058 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.380771 27156 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:54.377260 31024 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.352048 31084 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.396420 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:54.382242 27304 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
W20260709 13:11:54.374207 31072 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.009s	sys 0.003s
I20260709 13:11:54.334848 30954 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.354336 31059 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:54.394708 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.260692 31089 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.396469 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.407512 30986 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.383879 30712 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.411739 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73168.2us
W20260709 13:11:54.415724 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.419793 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:54.421356 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.425072 31059 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.425565 31003 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.426640 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.397320 31015 consensus_queue.cc:1243] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:54.434087 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.435932 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:54.437732 31096 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:11:54.440094 31099 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:11:54.384116 30308 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.457232 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.528366 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.452896 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:54.509418 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.454870 27305 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:54.459403 30921 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.443132 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.530045 27836 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:54.437830 31103 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:54.512671 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.535445 30918 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:54.535789 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.517726 30865 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.429621 30986 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.430657 31058 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.460819 27150 raft_consensus.cc:2410] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:54.461666 30712 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.448212 31004 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.441424 30324 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.446810 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.447345 30821 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.442293 31035 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.433028 31022 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.554461 30865 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:54.591665 30865 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.592530 31080 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:54.593719 31025 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.001s
I20260709 13:11:54.398595 31105 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:11:54.659924 31105 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:54.660403 31105 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:54.660984 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.533411 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.662359 27837 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.663952 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2913) took 1367 ms. Trace:
I20260709 13:11:54.664311 27149 rpcz_store.cc:276] 0709 13:11:53.296643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.296817 (+   174us) service_pool.cc:224] Handling call
0709 13:11:53.334452 (+ 37635us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:53.436933 (+102481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.436974 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:53.446657 (+  9683us) log.cc:844] Serialized 52 byte log entry
0709 13:11:53.816952 (+370295us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:54.067221 (+250269us) log.cc:844] Serialized 14 byte log entry
0709 13:11:54.174756 (+107535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.663497 (+488741us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b5400358754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:54.663547 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.663594 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:54.663691 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.663867 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17559,"prepare.queue_time_us":126673,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":34169,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":19262,"spinlock_wait_cycles":213631360,"thread_start_us":575016,"threads_started":3,"wal-append.queue_time_us":389821}
W20260709 13:11:54.533708 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.666923 30804 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:54.667645 30863 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:11:54.668073 30863 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.458566 30954 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.453974 30892 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.441627 31109 raft_consensus.cc:2764] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:11:54.672012 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 561380us
I20260709 13:11:54.672199 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.673540 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:54.673699 30815 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:11:54.670219 30863 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.675475 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.675837 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.674297 30815 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:54.676785 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.677239 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:54.482858 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.536972 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.540694 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.546821 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.539346 30926 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.661399 31105 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.678021 27305 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 6: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:54.542222 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.443773 30397 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.440623 30739 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.562911 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.563998 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.695210 27304 raft_consensus.cc:2368] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
W20260709 13:11:54.565112 31028 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.999s	user 0.006s	sys 0.016s
W20260709 13:11:54.571146 30717 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.003s
I20260709 13:11:54.699285 27299 raft_consensus.cc:2368] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9.
I20260709 13:11:54.572043 30725 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.579733 30324 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.580613 30882 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.678368 30765 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.594120 27840 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:54.555990 30986 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.684098 30701 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:54.597215 31113 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:54.603410 31089 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.604768 31080 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.531932 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:54.630903 31001 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
W20260709 13:11:54.635780 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.640034 31059 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.678601 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:54.680533 27298 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:54.681155 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 144255us
I20260709 13:11:54.729930 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.724251 31001 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.735715 30882 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.737046 30397 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.705417 30717 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.739513 30717 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.740417 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.741233 27298 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:54.742036 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:54.742304 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.742836 27298 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:54.743155 30725 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.743528 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.743661 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.743825 30863 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.744251 30863 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.744612 30863 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.568243 30712 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.683686 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:54.745139 27298 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:11:54.745585 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61999.8us
I20260709 13:11:54.681222 27155 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:54.746342 27303 raft_consensus.cc:2368] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:54.746898 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.748302 27155 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:54.684705 27149 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:54.675935 31012 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
W20260709 13:11:54.699471 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 136645us
W20260709 13:11:54.705351 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 273888us
I20260709 13:11:54.705757 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.706487 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.751679 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.752084 27302 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:54.707914 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.753407 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.754272 31109 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:54.754635 30397 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.755098 30397 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.755467 30397 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:54.708230 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.759285 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:54.759485 27228 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:54.759959 27833 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:54.760524 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.761372 27224 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:54.733767 31001 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.678571 30815 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.705904 31022 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:54.595745 31074 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.771229 31012 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.781993 31059 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:54.782132 31074 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.782308 31012 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:54.783169 27297 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:54.783075 31022 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:54.783968 27833 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.785295 31022 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.785996 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.786612 27832 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:54.790813 31049 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:11:54.791599 27300 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:54.791404 31049 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.714321 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.793701 27152 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.705613 31068 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.701793 31028 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:11:54.683873 30417 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:54.706552 31025 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.726197 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.709465 30765 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.714035 30701 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:54.727900 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:11:54.742523 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.799506 27832 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:54.744683 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.765388 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.800837 27227 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:54.695991 27837 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:54.720337 31089 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.773887 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.692001 30804 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.711437 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.794821 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.698818 31058 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:54.795873 27228 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:54.797420 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:54.811343 27229 raft_consensus.cc:2410] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:11:54.811728 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 100467us
I20260709 13:11:54.820226 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.821676 27833 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:54.824163 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:54.824816 27227 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.826687 27153 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:54.829651 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.831895 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:54.829284 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.795545 31068 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:54.836309 27224 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.807310 30765 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.838351 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.840408 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.816354 30308 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:54.869235 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.890007 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.871656 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:54.890142 27833 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.868783 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:54.890942 27229 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:54.838182 30821 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:54.893108 27832 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.834163 31093 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:54.816119 31025 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.810484 31089 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.839766 31012 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.901834 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.898277 31053 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.903115 31093 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.829188 30865 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.881513 31049 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:54.808200 31024 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.848321 30417 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:54.847728 30892 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:54.873310 31110 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:11:54.942437 27832 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
W20260709 13:11:54.944083 27807 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.548s (SENT)
I20260709 13:11:54.840483 31068 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.937932 27224 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:54.899856 30821 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:54.880213 31028 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:54.945448 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.886917 30939 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:11:54.947327 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.699s (SENT)
I20260709 13:11:54.845750 30308 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.946424 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.848631 30717 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:54.955448 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:54.924551 30971 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:11:54.943212 31116 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:11:54.970098 27833 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:54.873850 30701 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:54.921916 30880 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:54.983022 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:54.924887 31011 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:11:54.932997 30679 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:11:54.960407 30892 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.004074 27227 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
W20260709 13:11:55.004601 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 97966.8us
I20260709 13:11:54.968266 30308 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.005825 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:54.970961 30417 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.012401 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:54.985953 31074 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:55.016309 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.015630 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.015877 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.019181 27224 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:11:55.015951 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.021735 27300 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.021551 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:54.992177 30880 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:55.027127 27155 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:55.024364 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.023856 27229 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:55.024981 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.040102 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.041065 27229 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.044317 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:55.030237 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:55.047075 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.047492 27806 leader_election.cc:400] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.047780 27224 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.047945 27806 leader_election.cc:403] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:54.985726 30971 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.050594 27229 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:55.052793 27122 leader_election.cc:400] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9.
I20260709 13:11:55.054503 27122 leader_election.cc:403] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.055198 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.056155 27841 raft_consensus.cc:2410] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:55.056385 30739 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.056010 30417 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.056777 31080 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:55.057224 31080 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:55.058048 31080 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.059587 27230 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.061443 31088 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:55.062389 31088 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:55.062732 31088 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:55.050619 30954 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:55.063524 30954 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:55.063561 31088 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.064945 31088 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:55.066737 31119 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:55.066596 30739 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9.
I20260709 13:11:55.066838 30865 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.051223 31074 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.030131 30679 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:55.070214 31074 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.074396 30865 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.074764 31089 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.075093 30865 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.076719 30971 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.055137 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.077832 30865 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.078917 27227 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.080319 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.084098 30863 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.084950 30892 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.086774 31024 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.081954 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.156538 27227 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.070598 30679 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.163843 30679 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.165585 27841 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:55.122710 31122 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.167102 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.168120 27841 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:55.173247 31051 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.173913 31051 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.176424 31051 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:55.054303 30873 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:55.177320 30873 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.179394 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.179884 30873 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.180294 27835 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:55.180876 31025 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.090217 27152 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:55.090587 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:55.091449 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.092716 30986 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.094203 31093 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.094440 31125 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.089311 27224 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:55.198441 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.064565 30954 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:55.119711 27807 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.762s (SENT)
I20260709 13:11:55.085711 30397 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.123895 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:55.124032 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 94436.2us
W20260709 13:11:55.210741 27806 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.764s (SENT)
I20260709 13:11:55.212025 27806 leader_election.cc:400] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.212503 27806 leader_election.cc:403] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.125663 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.135504 30765 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:55.136515 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 134095us
I20260709 13:11:55.142313 30717 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.153561 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.158859 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:55.161418 30863 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.162664 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:55.150733 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 76277.5us
I20260709 13:11:55.195845 27837 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.199254 27836 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:55.200955 27152 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:55.157070 31124 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:11:55.204226 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.246627 27224 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:55.231168 27154 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2379) took 1896 ms (client timeout 1825 ms). Trace:
W20260709 13:11:55.205118 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85481.5us
I20260709 13:11:55.121511 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:55.247798 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.245518 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.236424 27151 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:55.248768 27231 raft_consensus.cc:2368] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
W20260709 13:11:55.247421 27807 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.764s (SENT)
I20260709 13:11:55.235342 27298 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.249648 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:55.213539 27229 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:55.244530 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.220074 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.236755 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.243606 27227 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.234901 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 860) took 1043 ms. Trace:
I20260709 13:11:55.253551 27223 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.254132 27150 rpcz_store.cc:276] 0709 13:11:54.191860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.340198 (+148338us) service_pool.cc:224] Handling call
0709 13:11:55.234605 (+894407us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54003e0654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:55.234774 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199007488}
W20260709 13:11:55.256626 27807 leader_election.cc:336] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.828s (SENT)
W20260709 13:11:55.247095 27154 rpcz_store.cc:269] 0709 13:11:53.334807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.801469 (+466662us) service_pool.cc:224] Handling call
0709 13:11:55.230909 (+1429440us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000de654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:55.231054 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310882560}
I20260709 13:11:55.257299 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:55.256732 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.260931 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.261770 27229 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:55.264676 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.266788 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.263996 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.265496 27840 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:11:55.270084 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 178700us
I20260709 13:11:55.270391 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.271200 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.270401 27227 raft_consensus.cc:2368] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:11:55.272787 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.273494 27224 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.278223 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.278462 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.279131 27156 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:55.221798 31109 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.234243 31122 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.282640 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.240826 30986 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.297169 27157 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:55.280380 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:55.299573 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.301923 27231 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.302223 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:55.303874 31035 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:55.304332 31035 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.304725 31035 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:55.307683 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.310297 31087 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.310545 27231 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:55.310859 31087 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.311306 31087 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.311635 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.311954 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.315243 27306 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:55.316613 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.263662 31049 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:55.331844 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60726.9us
I20260709 13:11:55.332223 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.334787 27231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.334925 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.336704 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.337390 27227 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.342641 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1951) took 1005 ms. Trace:
I20260709 13:11:55.345388 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.353008 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.354285 27306 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:55.355546 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:55.349897 27229 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:11:55.357630 27305 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.358348 27224 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:55.344686 27304 rpcz_store.cc:276] 0709 13:11:54.337045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.752050 (+415005us) service_pool.cc:224] Handling call
0709 13:11:54.752376 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.752663 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:54.827209 (+ 74546us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.341203 (+513994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.341279 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:55.341345 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.342373 (+  1028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.342541 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287653,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":28766,"raft.queue_time_us":37010,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":17600,"thread_start_us":587668,"threads_started":3,"wal-append.queue_time_us":339988}
I20260709 13:11:55.300037 30739 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.357519 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.379091 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.362104 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:55.363500 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.383230 27227 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:55.337112 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.208062 31125 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.387310 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:55.388167 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 53323.4us
I20260709 13:11:55.389006 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:55.389604 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.388188 27299 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:55.395939 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.396880 27227 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.333225 31102 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:55.380194 27229 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:55.278223 31093 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:11:55.404335 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:55.391405 31040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.011s
I20260709 13:11:55.407236 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.360062 31015 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:55.356842 31022 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.414762 27150 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:55.317306 30971 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:11:55.429636 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:55.404438 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.422116 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.423458 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 784) took 1237 ms. Trace:
I20260709 13:11:55.430706 27224 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.427211 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.429334 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.391620 30865 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.428298 27223 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.436897 27231 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.433561 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:55.430652 27297 rpcz_store.cc:276] 0709 13:11:54.185924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.191120 (+  5196us) service_pool.cc:224] Handling call
0709 13:11:55.423234 (+1232114us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54000e9054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:55.423388 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268755200}
I20260709 13:11:55.440419 27838 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:55.427789 31040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.011s	sys 0.011s
I20260709 13:11:55.416320 31109 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:55.446821 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.448199 27832 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:55.451988 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:55.456112 27836 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:55.456768 27299 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.457947 27227 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.450404 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.457116 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.437071 31102 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:55.466562 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 209967us
W20260709 13:11:55.469740 27807 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.085s (SENT)
I20260709 13:11:55.467331 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.439777 30765 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.474016 27197 leader_election.cc:400] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:55.454276 31109 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:55.471181 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 167999us
I20260709 13:11:55.486006 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.470711 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:11:55.474180 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.482656 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:55.466601 27224 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:55.406911 30717 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.461717 30863 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.442901 27229 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:55.491636 27224 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: [4.7-8.10]
I20260709 13:11:55.472920 30865 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:55.494189 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:55.507501 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.501889 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:55.508657 27224 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:11:55.547986 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46219.2us
I20260709 13:11:55.549507 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.550868 30739 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:55.551384 30739 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.551819 30739 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:55.552008 27299 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:55.555549 31125 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:55.473513 31012 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:11:55.559170 27229 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:55.470358 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 193939us
I20260709 13:11:55.478386 31068 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.515312 30397 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:55.525568 27836 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:55.496120 31109 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.526865 30954 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:55.528537 31138 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:55.497164 30863 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:55.541242 31015 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.590533 31148 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.591423 27834 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:55.558667 31147 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:11:55.577347 31088 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.513849 30308 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.608340 30308 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.609081 27303 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:55.598838 30397 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:55.613448 31068 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:55.542323 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 72602.6us
I20260709 13:11:55.517355 31035 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.589646 30863 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.499329 31024 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:55.485524 31135 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:11:55.579005 30865 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:55.559970 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.615727 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.535092 27223 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:11:55.697451 31035 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.698364 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1950) took 1391 ms. Trace:
I20260709 13:11:55.698834 27298 rpcz_store.cc:276] 0709 13:11:54.306877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.775733 (+468856us) service_pool.cc:224] Handling call
0709 13:11:54.817147 (+ 41414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.250288 (+433141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.698080 (+447792us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000ea454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:55.698295 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961150336}
I20260709 13:11:55.704871 30880 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.705457 30880 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:55.707612 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:11:55.712683 30873 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:11:55.621349 27807 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.145s (SENT)
I20260709 13:11:55.645066 31049 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:55.682766 30739 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.597585 31148 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.629739 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:55.717339 27836 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.649176 31125 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:55.619356 30971 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:55.653095 31087 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.688225 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:11:55.737743 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49642.2us
I20260709 13:11:55.738504 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.618696 31015 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:11:55.634075 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 126570us
I20260709 13:11:55.723330 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.725854 31148 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.726438 31049 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.726969 30739 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.728736 30873 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:55.730270 30880 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.732088 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:55.731184 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 109887us
W20260709 13:11:55.749082 27807 leader_election.cc:336] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.229s (SENT)
I20260709 13:11:55.749524 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:55.735759 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:55.742619 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:55.747381 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.751453 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.754426 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:55.743541 30882 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.755524 31132 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:55.755806 30882 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.756223 30882 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.756786 31087 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.748181 30873 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:55.758889 30873 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:55.760169 30873 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:55.762676 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.763569 31049 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.748059 31147 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.763917 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.765388 31102 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.766062 31102 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:55.741429 30892 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:11:55.741811 31051 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:11:55.768370 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.748402 31056 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.771289 27150 raft_consensus.cc:2368] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11.
I20260709 13:11:55.771399 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.772351 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:55.772966 31132 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.773424 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:55.748764 31015 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.779883 27269 leader_election.cc:400] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11.
I20260709 13:11:55.780555 27269 leader_election.cc:403] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.732039 30971 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:55.788785 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.789510 27836 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:11:55.794519 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.797868 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.736383 31035 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:11:55.830639 27299 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:55.748848 31083 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.774250 30765 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:55.832026 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.836644 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.832966 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.837361 27306 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.838758 27301 raft_consensus.cc:2368] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:55.837306 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.839546 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:55.834980 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 46317.7us
I20260709 13:11:55.840565 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:55.842010 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.782670 30918 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.842794 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.847447 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:55.847584 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.852123 27305 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.852281 27224 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.852312 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.854302 27224 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.855870 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.856159 27150 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:11:55.856674 27224 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.857414 27150 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:55.857999 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.858856 27224 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:11:55.859917 31155 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:11:55.860019 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.860884 27224 raft_consensus.cc:2368] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:11:55.832998 31102 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.862089 31102 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.862584 31102 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.863286 27230 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:55.862597 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.864707 27224 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.865269 31102 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:55.866158 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.866938 27231 raft_consensus.cc:2410] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:55.867638 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.868902 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.869623 27230 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:55.869776 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2938) took 1109 ms. Trace:
I20260709 13:11:55.870791 27225 rpcz_store.cc:276] 0709 13:11:54.759921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.760065 (+   144us) service_pool.cc:224] Handling call
0709 13:11:54.760337 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.760580 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.760604 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.761075 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:11:54.942464 (+181389us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:54.942506 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.942578 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.868230 (+925652us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b24003c7928. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ead09c4 00007f9a4eaceacb 00007f9a4ec89dc9 00007f9a4ec89a55 00007f9a4ec88fb0 00007f9a518ff488 00007f9a518ffbe8 00007f9a518d7398 00007f9a518d276a 00007f9a518d1bb6
0709 13:11:55.868883 (+   653us) raft_consensus.cc:1685] finished
0709 13:11:55.868905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.869716 (+   811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34815232,"thread_start_us":180988,"threads_started":1,"wal-append.queue_time_us":222827}
I20260709 13:11:55.871799 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.850011 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.790403 31049 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.812554 31122 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.873840 27229 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:55.874228 27224 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.879329 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.889086 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2931) took 1220 ms. Trace:
I20260709 13:11:55.878548 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.899719 27224 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:55.899573 27151 rpcz_store.cc:276] 0709 13:11:54.668434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.676555 (+  8121us) service_pool.cc:224] Handling call
0709 13:11:55.888845 (+1212290us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54003e0154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:55.889008 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251310976}
I20260709 13:11:55.900496 27231 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:55.829295 31152 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:11:55.831498 31135 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:55.738983 31125 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.832881 31056 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:55.903605 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 70711.2us
I20260709 13:11:55.790477 30739 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:11:55.844895 30765 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.854241 31089 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:55.911798 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.870582 31040 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:55.904655 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:55.891366 31105 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.909428 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:55.915203 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 80928.9us
I20260709 13:11:55.915548 27306 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.909685 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:11:55.893946 31156 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:11:55.910691 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 71247us
I20260709 13:11:55.919027 27304 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.918817 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.773972 31132 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.842067 31112 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:55.913808 30717 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:55.934422 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2007) took 1157 ms. Trace:
I20260709 13:11:55.916831 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:55.880299 31015 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:55.920275 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:55.920466 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.921727 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.923857 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.925283 30765 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.926852 31159 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.930104 27303 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.954933 27834 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:55.910320 31022 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.908753 31157 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:55.929999 27840 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:55.941686 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.942374 30717 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:55.934846 27226 rpcz_store.cc:276] 0709 13:11:54.763660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.763764 (+   104us) service_pool.cc:224] Handling call
0709 13:11:55.904498 (+1140734us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:11:55.921339 (+ 16841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10197248}
I20260709 13:11:55.953776 27302 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.915014 31040 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:55.963419 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 116072us
I20260709 13:11:55.969574 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:55.972795 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:55.880496 30821 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:55.974598 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:55.976115 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 134461us
I20260709 13:11:55.983428 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.984429 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:55.976541 31040 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.977618 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:55.977964 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:55.979486 31112 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:55.989419 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.986698 27227 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:55.954384 31122 raft_consensus.cc:2764] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:11:55.990121 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 73367.6us
I20260709 13:11:55.992154 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.949232 31160 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.918568 31089 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:55.980665 31150 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:11:56.004786 27232 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:56.005445 27807 leader_election.cc:400] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:11:55.961405 31157 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:56.006673 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:55.911263 30971 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:55.985359 31015 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.001828 31056 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.032931 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:55.989389 31159 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.004637 30960 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:56.002779 30821 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.009528 31087 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.979542 30882 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.004273 31035 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:56.043247 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:56.070722 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.012441 30739 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:56.024715 30873 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:56.127152 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.128300 27305 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:56.012076 31147 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:11:56.009987 31049 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:11:56.033455 31040 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.035684 31159 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:56.039069 30960 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.038486 31122 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:56.217063 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 173896us
I20260709 13:11:56.123813 31056 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.168159 31015 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:56.190204 31151 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.317s	user 0.001s	sys 0.001s
I20260709 13:11:56.221243 27123 leader_election.cc:400] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:11:56.036854 31160 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:11:56.224349 27123 leader_election.cc:403] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.225311 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2926) took 2761 ms. Trace:
I20260709 13:11:56.226639 27153 rpcz_store.cc:276] 0709 13:11:53.459255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.478946 (+ 19691us) service_pool.cc:224] Handling call
0709 13:11:53.479600 (+   654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.833879 (+1354279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.220635 (+1386756us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400138b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:56.220970 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3096886528}
I20260709 13:11:56.217311 30960 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.191983 30873 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:56.192344 31159 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.257763 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:56.258029 27155 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:56.259230 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:56.261179 31102 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.261739 31102 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.263811 31102 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:56.265293 31163 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:11:56.265825 30918 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:56.266386 30918 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.268358 30918 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.273422 31015 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.274523 31015 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:56.275506 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.278791 27836 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:56.283654 31056 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:56.265338 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.286758 31122 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.286897 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:56.287169 31122 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.288012 31122 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.289290 31122 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.290977 31089 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:56.292497 30882 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:56.124631 30717 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.218015 30921 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:56.167596 30739 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.216552 31174 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:56.235176 30863 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
I20260709 13:11:56.237233 31088 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:56.229270 31148 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.309942 31174 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:56.317209 31174 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.317389 31148 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.317948 31148 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.320042 31148 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.321127 31148 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:11:56.310142 31132 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:11:56.238413 31173 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:56.322362 31173 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.310292 30921 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.324632 31173 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.177093 31035 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.325938 31125 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.326787 31035 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:56.246759 30873 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.124167 31087 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.189077 31157 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.331627 31157 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.332758 31087 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:56.301244 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:56.333515 27150 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:56.334703 27155 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:56.308218 31167 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:56.315310 30939 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:56.315989 30863 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.339970 30863 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.340780 27231 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:56.341641 27153 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:11:56.316457 30739 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:56.316633 31088 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:56.345922 31088 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.347098 31088 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.351408 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:56.353763 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:56.351689 31164 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.457s	user 0.006s	sys 0.005s
I20260709 13:11:56.355697 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 874) took 1089 ms. Trace:
I20260709 13:11:56.356038 27154 rpcz_store.cc:276] 0709 13:11:55.266000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.390844 (+124844us) service_pool.cc:224] Handling call
0709 13:11:55.411768 (+ 20924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.425171 (+ 13403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.425219 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.757144 (+331925us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b2c000014c8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:55.757554 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.786528 (+ 28974us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:55.786564 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.786630 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.351052 (+564422us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:11:56.355470 (+  4418us) raft_consensus.cc:1685] finished
0709 13:11:56.355494 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.355637 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17491,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3997,"spinlock_wait_cycles":28642304,"thread_start_us":28628,"threads_started":1,"wal-append.queue_time_us":78886}
I20260709 13:11:56.358073 30863 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.358587 30863 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:56.359054 30863 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.362944 31159 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.367026 31167 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.367565 31167 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.369879 31167 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:56.371950 27223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 842) took 1358 ms (client timeout 1808 ms). Trace:
W20260709 13:11:56.372393 27223 rpcz_store.cc:269] 0709 13:11:55.013559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.301097 (+287538us) service_pool.cc:224] Handling call
0709 13:11:56.371762 (+1070665us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b540037a854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:56.371889 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95477120}
W20260709 13:11:56.374432 31162 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.480s	user 0.003s	sys 0.005s
I20260709 13:11:56.292956 30960 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.376823 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2011) took 1610 ms. Trace:
I20260709 13:11:56.377241 27150 raft_consensus.cc:2368] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:11:56.377250 27232 rpcz_store.cc:276] 0709 13:11:54.766413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.766629 (+   216us) service_pool.cc:224] Handling call
0709 13:11:55.993318 (+1226689us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:11:56.003020 (+  9702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.005223 (+  2203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.376610 (+371387us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b54000807d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:56.376762 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47280768}
I20260709 13:11:56.380795 30960 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.381729 30971 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.324810 30921 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:56.281981 30865 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.651s	user 0.003s	sys 0.007s
W20260709 13:11:56.434695 31105 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.511s	user 0.002s	sys 0.008s
I20260709 13:11:56.366508 31159 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:56.431910 31112 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.470152 30865 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.509217 27228 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:56.307389 30712 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.190s
W20260709 13:11:56.515794 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 530967us
I20260709 13:11:56.516784 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.522979 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.513266 31167 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:56.539166 31170 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:11:56.525795 31109 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.004s
I20260709 13:11:56.546779 31109 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.548125 27224 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:56.548458 27228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2016) took 1780 ms (client timeout 1611 ms). Trace:
W20260709 13:11:56.549039 27228 rpcz_store.cc:269] 0709 13:11:54.768334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.817594 (+ 49260us) service_pool.cc:224] Handling call
0709 13:11:56.548188 (+1730594us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540038d1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:56.548324 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840607616}
I20260709 13:11:56.523186 31159 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.536770 31168 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.563032 27195 leader_election.cc:400] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:11:56.563498 27195 leader_election.cc:403] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:11:56.565384 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.569023 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.570286 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:56.575587 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.582417 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.571346 27807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.027s
I20260709 13:11:56.570768 27300 raft_consensus.cc:2410] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:11:56.576186 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:56.583328 27807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.007s	sys 0.027s
W20260709 13:11:56.584239 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 577631us
I20260709 13:11:56.581557 27837 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:11:56.576496 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.014s	sys 0.010s
W20260709 13:11:56.585254 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.014s	sys 0.010s
W20260709 13:11:56.566556 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 523971us
I20260709 13:11:56.586906 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:11:56.581398 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 360333us
I20260709 13:11:56.588678 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:11:56.587736 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.592236 27834 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:56.529099 31167 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.578413 31168 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.614105 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:56.578552 31105 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.620007 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.609205 31176 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.622350 30804 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.622905 30804 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.623418 30804 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:56.632387 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.635540 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:56.640725 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:56.638705 27197 leader_election.cc:400] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:56.641707 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.642115 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:56.642354 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.643867 27301 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:11:56.633540 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57470.1us
I20260709 13:11:56.642671 27197 leader_election.cc:403] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.645222 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.651890 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.656740 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:56.656369 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:56.660324 27224 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:56.659299 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.662618 27229 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:56.658527 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:56.662341 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73773.2us
I20260709 13:11:56.670220 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.671097 30918 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.592921 31112 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:56.673374 31169 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.481s	user 0.004s	sys 0.000s
I20260709 13:11:56.646827 31125 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.675102 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:56.675495 31125 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:56.675945 27228 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:56.677062 27223 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:11:56.678459 27226 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:56.664453 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:56.679764 27224 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:56.681371 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.682202 27305 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:56.683290 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:56.684235 27156 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:56.688022 27148 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:56.704137 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:56.706453 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:56.704738 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.719586 27304 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:11:56.728284 27806 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.710505 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:56.612114 30717 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:11:56.732396 27224 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:56.656428 31159 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.733670 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.759850 27838 raft_consensus.cc:2368] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:56.760860 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.708671 31088 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:56.680912 31104 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.675957 31125 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.753432 27224 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:56.755208 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 103374us
W20260709 13:11:56.743369 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.707007 31049 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.662469 31102 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:56.771752 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.712376 31179 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.771265 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.776989 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.730670 31122 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:56.792476 27230 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:11:56.711618 31160 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:11:56.657027 30863 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:56.781921 27832 raft_consensus.cc:2410] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:11:56.781742 31162 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:56.725484 30939 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:56.764523 31159 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.734503 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.788301 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.829455 27839 raft_consensus.cc:2368] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:11:56.765388 31181 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.797091 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.797442 31175 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.798717 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.800961 31147 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:56.793020 30865 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.803989 27148 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:56.844849 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 116641us
I20260709 13:11:56.807050 30821 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:56.827772 31083 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.985s	user 0.011s	sys 0.002s
I20260709 13:11:56.808243 30717 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:56.814121 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.782518 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:56.879081 27833 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:56.828045 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.772850 31088 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:56.833875 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:56.780500 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.881822 27224 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:56.835685 31174 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.003s
I20260709 13:11:56.836997 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:56.883364 27229 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:56.838944 27232 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:56.807675 31166 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:56.826726 31155 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:56.875205 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:11:56.877240 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 78638.1us
I20260709 13:11:56.891827 27223 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:56.891965 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:56.843420 31089 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.898141 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.903148 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.812906 31122 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.909947 27224 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:56.886230 31088 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:56.884065 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 224840us
I20260709 13:11:56.885331 31083 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.914227 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:56.889187 31102 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.886008 31166 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:56.915153 27123 leader_election.cc:400] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:11:56.847339 31181 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.888928 30712 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:56.965867 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:56.844250 30939 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.967542 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.972244 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.896389 30821 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.932089 27833 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:56.971472 27195 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:56.978286 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.931808 27224 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:56.846451 30892 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:56.935300 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:56.899171 30739 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.912869 31171 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.975476 27838 raft_consensus.cc:2410] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:11:56.990247 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 201816us
I20260709 13:11:56.935940 31080 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:56.994940 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59733.6us
I20260709 13:11:56.963304 31015 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.889772 31174 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.930716 31179 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.996076 27224 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:11:56.963557 31147 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.983296 31011 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:11:56.986286 30821 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:56.910558 31186 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:11:57.016733 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:56.984710 30971 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:57.018668 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.984975 30960 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.989517 31089 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.993718 30892 consensus_queue.cc:1243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:56.970077 31012 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:11:56.934039 31102 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.036031 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:57.013803 30739 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.984164 31176 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:11:57.016580 30986 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:56.989253 31112 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:57.024808 31132 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.025454 31015 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:11:57.081689 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 45792.8us
I20260709 13:11:57.082782 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:57.056295 31189 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:11:57.042501 31180 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.982195 31159 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.093541 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:57.019402 31147 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.059634 30960 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:57.095582 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 104042us
I20260709 13:11:57.058252 30986 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:11:57.096495 31188 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:11:57.069290 30739 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:57.250018 31182 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.260301 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.268968 27841 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:57.201522 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108050us
I20260709 13:11:57.095772 31132 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:57.202517 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 183402us
I20260709 13:11:57.083741 30921 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:57.128085 27833 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:11:57.224086 31198 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:11:57.226815 31209 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:57.227197 31192 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260709 13:11:57.239269 31205 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:57.242619 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.242386 31011 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:57.244437 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.360402 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.361181 27839 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:57.255234 31191 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
W20260709 13:11:57.247067 31194 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:11:57.248279 31195 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:11:57.248420 31135 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.340s	user 0.012s	sys 0.000s
I20260709 13:11:57.249419 31122 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.105427 30863 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:57.249562 31174 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:57.107775 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 126292us
I20260709 13:11:57.381397 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:57.347487 30986 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:57.244458 31040 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.025s	user 0.013s	sys 0.000s
W20260709 13:11:57.253192 30804 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.001s
I20260709 13:11:57.260375 30701 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:57.424259 31125 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.003s
I20260709 13:11:57.424813 31125 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:57.427958 27300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2243) took 1597 ms (client timeout 2060 ms). Trace:
W20260709 13:11:57.428417 27300 rpcz_store.cc:269] 0709 13:11:55.830894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.831022 (+   128us) service_pool.cc:224] Handling call
0709 13:11:57.427705 (+1596683us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54000573d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:57.427891 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655351680}
I20260709 13:11:57.432386 30324 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:57.432888 30324 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:11:57.436738 31175 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.556s	user 0.005s	sys 0.004s
I20260709 13:11:57.437300 31175 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.298638 30921 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:57.429910 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.260717 31015 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.439893 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:57.447283 27832 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:57.446656 27300 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.451211 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:57.452067 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 352917us
I20260709 13:11:57.380242 31135 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11.
W20260709 13:11:57.293062 31157 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.948s	user 0.014s	sys 0.000s
I20260709 13:11:57.261561 31182 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.260075 30739 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:57.252040 31147 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.377985 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.103796 31180 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:57.414887 31176 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:57.399962 27841 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:57.401343 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.478490 27153 raft_consensus.cc:2410] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:57.402621 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.402835 31199 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:57.405017 30679 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.405572 30880 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:57.405857 31217 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:57.407258 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.407925 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.409591 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.468557 31179 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.410511 30986 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.410660 27301 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:57.402658 31214 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:57.411674 31220 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:57.412797 31216 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:57.363560 31011 consensus_queue.cc:1243] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:57.462903 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:57.511345 27155 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:11:57.465380 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.395206 30873 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:11:57.467536 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 194642us
W20260709 13:11:57.477949 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.480000 27302 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:11:57.515144 27302 pending_rounds.cc:85] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 6
I20260709 13:11:57.514781 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.515403 27302 pending_rounds.cc:107] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:11:57.438861 31167 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.438730 30971 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.484359 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:57.441823 30921 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:57.472993 31105 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 13:11:57.465927 31040 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:57.410168 30865 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.488067 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.486387 27837 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:57.488821 31183 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:57.531730 31222 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:57.418318 30804 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.486184 31199 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.496013 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.486512 31125 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:57.498488 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:57.498528 30308 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:57.499495 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 847) took 1626 ms. Trace:
I20260709 13:11:57.554503 27225 rpcz_store.cc:276] 0709 13:11:55.872845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.892555 (+ 19710us) service_pool.cc:224] Handling call
0709 13:11:55.892976 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.031081 (+138105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.031118 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.031160 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:56.031197 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.499245 (+1468048us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400218254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:57.499299 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.499431 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317094656}
I20260709 13:11:57.553996 30308 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:57.556847 30308 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.557855 30308 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.559619 31199 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.560338 27298 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:57.560600 27299 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:57.488401 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.501596 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1972) took 1484 ms. Trace:
I20260709 13:11:57.502684 27300 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:57.504750 27839 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:11:57.510512 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2412) took 1157 ms. Trace:
I20260709 13:11:57.512236 27157 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:57.566882 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.566038 27152 rpcz_store.cc:276] 0709 13:11:56.352768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.382642 (+ 29874us) service_pool.cc:224] Handling call
0709 13:11:56.467228 (+ 84586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.513552 (+ 46324us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:56.545067 (+ 31515us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18004b4180. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:11:56.708943 (+163876us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.053236 (+344293us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.083192 (+ 29956us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.083364 (+   172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:57.083401 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.083477 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.501659 (+418182us) raft_consensus.cc:1685] finished
0709 13:11:57.510210 (+  8551us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.510424 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12536,"prepare.queue_time_us":332637,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3093,"raft.queue_time_us":206406,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":4835,"spinlock_wait_cycles":3987840,"thread_start_us":440836,"threads_started":2,"wal-append.queue_time_us":676679}
I20260709 13:11:57.567611 27157 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:57.568291 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.516830 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.484918 30821 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.520313 27148 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.468938 31132 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:57.473704 31206 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.528887 31221 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:57.534868 27228 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:11:57.524037 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.485404 31176 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.539886 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:57.536413 30865 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:57.584353 27229 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:57.549314 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 87808.1us
I20260709 13:11:57.587556 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.553417 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.568337 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.515745 27302 raft_consensus.cc:2889] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.522516 30863 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.572001 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:57.568972 27152 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:57.576202 27841 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:57.563333 27297 rpcz_store.cc:276] 0709 13:11:56.016751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.016889 (+   138us) service_pool.cc:224] Handling call
0709 13:11:56.114445 (+ 97556us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:56.518892 (+404447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.518942 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:56.523848 (+  4906us) log.cc:844] Serialized 52 byte log entry
0709 13:11:56.735877 (+212029us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.735949 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.736054 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.501377 (+765323us) raft_consensus.cc:1685] finished
0709 13:11:57.501402 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.501539 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3690,"raft.queue_time_us":121393,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":593592,"threads_started":2,"wal-append.queue_time_us":454184}
I20260709 13:11:57.538167 31105 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
W20260709 13:11:57.579906 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.582795 27833 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.538756 31183 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:57.586373 27834 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.508574 31214 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.580336 31221 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:57.588487 31206 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.621260 31182 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.625133 30804 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.524971 30971 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:11:57.575268 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 101890us
I20260709 13:11:57.628363 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:57.663702 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:57.627978 27157 raft_consensus.cc:2410] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:57.615885 30865 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:57.622684 31080 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
W20260709 13:11:57.639648 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67765.1us
I20260709 13:11:57.651952 27152 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:11:57.667667 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.661659 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.640388 31125 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.667836 27148 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:57.668640 27834 raft_consensus.cc:2410] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:11:57.669045 27157 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:57.613597 27153 raft_consensus.cc:1217] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:11:57.669987 27153 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:57.671697 27305 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:57.651050 31183 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.673589 27835 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:57.680779 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.681627 27834 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:57.668579 31182 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:57.662652 31180 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.687049 27834 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:57.670333 31040 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:57.691077 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.693518 27834 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:57.650692 30863 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.693639 27297 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:57.677862 31056 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.698592 27225 pending_rounds.cc:85] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 2
I20260709 13:11:57.701017 27225 pending_rounds.cc:107] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:57.698814 27227 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:57.698947 27841 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:57.700215 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.700417 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:57.706614 31232 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.686223 31080 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:11:57.739934 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 47861us
I20260709 13:11:57.743857 27834 raft_consensus.cc:2376] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10. Re-sending same reply.
I20260709 13:11:57.665603 31132 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:57.701380 27225 raft_consensus.cc:2889] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.755245 27225 pending_rounds.cc:107] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:57.755582 27225 raft_consensus.cc:2889] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.711876 31056 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.740842 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2953) took 1085 ms. Trace:
I20260709 13:11:57.758924 27230 rpcz_store.cc:276] 0709 13:11:56.655408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.658303 (+  2895us) service_pool.cc:224] Handling call
0709 13:11:57.715686 (+1057383us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540038c7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:57.740760 (+ 25074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296457088}
I20260709 13:11:57.736547 27231 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:57.747326 27841 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:57.748663 31234 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:11:57.757874 27150 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:57.694996 31040 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:57.739707 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.688107 31015 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:57.756657 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:57.764050 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:57.738040 31182 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:57.761368 30873 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.793769 30873 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:57.796536 30873 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:57.766604 31040 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.799196 31214 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.800700 30971 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.748710 31232 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:57.807035 31227 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:11:57.699415 31221 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:57.801069 31236 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:57.816395 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.818288 30863 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.774537 31105 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.820080 31105 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.821318 31221 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.822831 27152 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:11:57.824203 27152 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:57.824994 31193 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.980s	user 0.000s	sys 0.003s
I20260709 13:11:57.825564 31176 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.826823 27300 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:57.828146 31088 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.005s
I20260709 13:11:57.828552 31088 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.830278 31068 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:57.832227 31166 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.833333 31166 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.835057 27154 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:57.838615 31105 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.839632 31232 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.840106 31182 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.842885 31206 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.843308 31109 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:57.843761 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.777323 31080 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:57.843257 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:57.844365 31080 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:57.844787 27227 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:11:57.845329 31080 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.848385 27232 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:57.853740 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:57.812256 31015 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.873682 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:57.880003 27232 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:11:57.882619 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.874729 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.896245 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:57.897083 27152 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:57.889123 31035 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.910159 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:57.891597 31015 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.902433 31035 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:57.929504 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.932639 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.911608 31088 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:57.934325 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.941784 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:57.941851 27297 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:11:57.946532 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 180597us
I20260709 13:11:57.960440 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:57.963848 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:57.973474 27152 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:57.962467 31035 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.990921 31035 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.999156 31015 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:57.959726 31180 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:11:57.962692 30308 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:11:58.012705 31183 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:57.977922 31242 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:11:57.957989 31232 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:58.016510 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:11:58.017501 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.018383 31088 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:58.022324 31206 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.022871 31206 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.026292 31181 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.026535 31206 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:58.029147 27835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1451) took 2297 ms (client timeout 2939 ms). Trace:
I20260709 13:11:58.031193 31125 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:58.032012 27833 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:58.034442 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:11:58.035694 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.036087 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:58.037470 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.038374 27148 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:11:58.039580 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2962) took 1250 ms. Trace:
I20260709 13:11:58.039960 27154 rpcz_store.cc:276] 0709 13:11:56.789356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.789508 (+   152us) service_pool.cc:224] Handling call
0709 13:11:56.796486 (+  6978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.835462 (+1038976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.039346 (+203884us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540037f5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:58.039521 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387936640}
W20260709 13:11:58.029708 27835 rpcz_store.cc:269] 0709 13:11:55.731650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.731809 (+   159us) service_pool.cc:224] Handling call
0709 13:11:58.028895 (+2297086us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400600254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.029039 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4426744192}
I20260709 13:11:58.042454 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:11:58.029959 30701 consensus_meta.cc:287] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.609s	user 0.002s	sys 0.007s
I20260709 13:11:58.049281 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:58.041446 30986 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.049993 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.052186 27157 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:58.052896 27229 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:58.055120 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:58.054435 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:58.056176 27836 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:11:58.056540 27836 pending_rounds.cc:85] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 6
I20260709 13:11:58.056793 27836 pending_rounds.cc:107] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:58.057065 27836 raft_consensus.cc:2889] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.058017 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.059438 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.042270 31109 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:58.061626 30971 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:58.063686 31182 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.050035 30739 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:58.051834 31232 consensus_queue.cc:1243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:11:58.065605 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.066241 27837 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:58.068954 30739 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:58.069084 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.077597 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:58.075629 31125 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.064985 31109 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.059552 31178 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.067947 30971 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.067883 30701 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.087113 31178 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.089239 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 2959) took 1453 ms. Trace:
I20260709 13:11:58.057466 30986 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.055677 31040 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.097117 27149 rpcz_store.cc:276] 0709 13:11:56.635795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.635967 (+   172us) service_pool.cc:224] Handling call
0709 13:11:56.973382 (+337415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.084358 (+110976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.084407 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.222712 (+138305us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.518031 (+295319us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:57.518098 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.518171 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.616686 (+ 98515us) raft_consensus.cc:1685] finished
0709 13:11:57.616720 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.088922 (+472202us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54001716d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.089154 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6471,"raft.queue_time_us":117499,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":11978,"spinlock_wait_cycles":709457792,"thread_start_us":263140,"threads_started":2,"wal-append.queue_time_us":238559}
I20260709 13:11:58.082602 31109 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:58.091038 31179 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:58.106094 31179 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:58.107069 31179 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.091540 30880 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:58.108125 30880 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:58.093538 30971 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.082646 31125 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.114331 30986 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.115897 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:58.116636 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.117101 31183 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.069617 31182 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.090772 30863 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.092046 30739 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.119186 30880 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.124733 27835 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:58.133266 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 55750.7us
I20260709 13:11:58.098862 30701 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.156036 31125 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.128428 30863 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.160152 30880 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:58.161031 31210 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.074s	user 0.001s	sys 0.015s
I20260709 13:11:58.186529 31056 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:58.178340 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 43574.3us
I20260709 13:11:58.132683 31182 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.187268 30863 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:58.206532 31246 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:11:58.202653 31229 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:58.218216 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50903.1us
I20260709 13:11:58.206902 30701 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.234714 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.237699 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:58.245659 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:58.229027 31229 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:58.246724 27229 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:11:58.247686 27835 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:58.236527 31040 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.260421 31102 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.260921 30939 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.261094 27149 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:11:58.285859 30971 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.263109 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 865) took 1383 ms. Trace:
I20260709 13:11:58.302809 27832 rpcz_store.cc:276] 0709 13:11:56.879702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.897726 (+ 18024us) service_pool.cc:224] Handling call
0709 13:11:58.262909 (+1365183us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54009f01d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.263049 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258514688}
I20260709 13:11:58.304008 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.304427 30971 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.305194 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:11:58.264537 27838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 861) took 1531 ms (client timeout 1923 ms). Trace:
I20260709 13:11:58.221881 30324 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:58.267597 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 1967) took 2471 ms (client timeout 1977 ms). Trace:
I20260709 13:11:58.268546 31109 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.271360 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:58.273634 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:58.274139 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:58.273659 27197 connection.cc:256] RPC call timeout handler was delayed by -1.0551596049999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:11:58.275267 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:58.275961 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:58.279549 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.280305 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.280714 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.281191 31080 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:58.281344 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.330775 27839 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:58.283273 31251 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.287045 27153 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:11:58.287514 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.302342 27149 pending_rounds.cc:85] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 9
I20260709 13:11:58.333845 27149 pending_rounds.cc:107] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:11:58.334240 27149 raft_consensus.cc:2889] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.264977 31229 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.306038 27832 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:11:58.310427 27838 rpcz_store.cc:269] 0709 13:11:56.733250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.780167 (+ 46917us) service_pool.cc:224] Handling call
0709 13:11:58.264325 (+1484158us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b5400882054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.264480 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213388160}
W20260709 13:11:58.315380 27298 rpcz_store.cc:269] 0709 13:11:55.796013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.796275 (+   262us) service_pool.cc:224] Handling call
0709 13:11:58.267401 (+2471126us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400057dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.267503 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3776079232}
I20260709 13:11:58.317379 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:58.338297 27304 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.339502 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:58.340687 31221 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:58.326712 27833 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:58.342240 30815 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:58.342648 30815 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:58.343587 30815 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.344766 30815 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.346323 31102 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.346175 31182 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.346902 31102 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.347306 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:58.348776 31135 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.349258 31102 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.351414 31109 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.353690 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:58.354362 27306 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.361004 27304 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:58.362666 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:58.363551 30971 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:58.364257 30971 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:58.368076 27306 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:11:58.373683 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.375376 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:58.384840 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.336335 31012 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:58.337733 31219 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:58.372936 30324 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.337545 31251 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.393899 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:58.391943 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.383287 31040 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:58.382297 31089 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.396952 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:58.365139 30971 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:58.407014 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75983.8us
I20260709 13:11:58.403417 31040 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:58.422292 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:58.422953 27833 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:58.466957 31254 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:58.403741 31089 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.473289 31089 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.488476 31257 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.489138 31257 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.491413 31257 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.407877 31182 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.421142 31251 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:58.497895 31259 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.498644 31259 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:58.501297 31259 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:58.502657 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.506901 27838 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:58.421011 31040 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.510996 27306 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:58.513150 31182 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.513710 31182 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.516479 31182 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:58.518769 31231 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.757s	user 0.002s	sys 0.004s
I20260709 13:11:58.519562 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.520946 30863 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.523438 30863 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:58.526113 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 123407us
I20260709 13:11:58.433512 27833 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:11:58.559581 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.568487 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:58.617870 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.674695 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 864) took 1848 ms. Trace:
I20260709 13:11:58.675254 27836 rpcz_store.cc:276] 0709 13:11:56.826107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.844856 (+ 18749us) service_pool.cc:224] Handling call
0709 13:11:56.889954 (+ 45098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.057541 (+1167587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.674345 (+616804us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400661a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:58.674615 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681132800}
I20260709 13:11:58.680557 27836 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:58.683984 31080 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:58.684639 31080 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.670027 30701 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:58.687145 30701 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.688414 31080 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:11:58.692986 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.701655 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.697002 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:58.702873 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.689728 30701 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:58.703533 27841 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:58.710763 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:11:58.711566 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.714794 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.530129 31182 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:11:58.719858 27154 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:58.721092 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:58.723120 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.725790 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.726488 27148 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:11:58.727588 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.670753 31109 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.727732 27271 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:58.727963 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1138) took 1287 ms. Trace:
I20260709 13:11:58.729090 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.745087 27837 rpcz_store.cc:276] 0709 13:11:57.440141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.631638 (+191497us) service_pool.cc:224] Handling call
0709 13:11:57.649401 (+ 17763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.073850 (+424449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.727719 (+653869us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54005a1c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:58.727908 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957142784}
W20260709 13:11:58.744122 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 336319us
I20260709 13:11:58.747406 27197 leader_election.cc:400] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:58.747761 27197 leader_election.cc:403] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.749204 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.751292 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:11:58.722155 30986 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.729660 31035 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:58.743803 31182 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:58.772410 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.776643 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.780135 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.752992 30308 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.781221 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:58.781787 27197 leader_election.cc:400] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:11:58.752079 31259 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:11:58.756976 30918 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.790813 30918 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.792483 31089 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.778478 31177 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:58.793574 31177 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.793928 31177 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.802877 27301 raft_consensus.cc:606] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.803484 27301 raft_consensus.cc:614] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.782305 27156 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:58.785977 27197 leader_election.cc:403] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.775264 30921 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:58.805022 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.758117 30986 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.804222 31178 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:58.807787 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:58.808440 31089 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.809674 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.753185 31056 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:11:58.752115 31109 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.811945 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.781773 31105 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.782218 31251 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.785571 30308 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.824506 30308 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:58.825350 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.782859 31035 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:58.830421 31182 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:58.830646 30918 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:58.830971 31182 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.822523 31266 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.810042 30986 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.833235 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:58.840422 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.815443 31257 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:11:58.834558 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.843773 27151 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:11:58.818105 31219 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.835561 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.840807 27150 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.847252 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.845858 27148 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:58.841079 31251 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:58.854609 31251 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.866406 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.868480 27156 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:58.831398 31035 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:58.833724 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:58.841734 30918 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.815367 31089 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:58.883685 27150 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:58.882591 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:11:58.820885 30892 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:11:58.857010 31251 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:58.880885 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 47243.1us
I20260709 13:11:58.901585 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.899438 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:58.903436 27156 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:58.879103 31221 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.906592 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2255) took 2891 ms. Trace:
I20260709 13:11:58.907048 27302 rpcz_store.cc:276] 0709 13:11:56.015669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.020316 (+  4647us) service_pool.cc:224] Handling call
0709 13:11:57.431446 (+1411130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.635462 (+204016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.010026 (+374564us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b54000573d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:58.906362 (+896336us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000573d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:58.906501 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306800896}
I20260709 13:11:58.907661 30765 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.883788 31105 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.884682 31266 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:58.971626 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.973140 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.974671 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 247140us
I20260709 13:11:58.913987 31135 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:58.978876 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 77433.7us
I20260709 13:11:58.986244 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.976719 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.962249 31125 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.991425 31268 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:11:58.965366 31056 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.999092 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:58.985018 31223 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.984969 31266 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:58.988909 30918 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.006922 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.000429 31272 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.021607 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 139127us
I20260709 13:11:58.997498 31269 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:59.024827 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 139098us
I20260709 13:11:59.004045 31040 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:58.979315 31105 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.044138 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2961) took 1516 ms. Trace:
I20260709 13:11:59.044710 27231 rpcz_store.cc:276] 0709 13:11:57.527993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.528842 (+   849us) service_pool.cc:224] Handling call
0709 13:11:57.529199 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.760115 (+230916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.043746 (+1283631us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002274d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:11:59.044045 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423708032}
W20260709 13:11:59.046406 27155 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 879) took 1644 ms (client timeout 1544 ms). Trace:
W20260709 13:11:59.047003 27155 rpcz_store.cc:269] 0709 13:11:57.402201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.402345 (+   144us) service_pool.cc:224] Handling call
0709 13:11:59.046145 (+1643800us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54002e7cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:59.046295 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73344384}
I20260709 13:11:59.062239 31080 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:59.062968 31080 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:11:59.064260 31080 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.068253 31168 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:59.069183 31168 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.074491 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42282 (request call id 27) took 1058 ms. Trace:
W20260709 13:11:59.087873 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 88880.9us
I20260709 13:11:59.089221 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.103609 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.065765 31080 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:59.112197 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 105354us
I20260709 13:11:59.004861 31056 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.114878 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.019132 31223 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.123974 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:59.126425 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 99459.9us
I20260709 13:11:59.134734 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.075115 27301 rpcz_store.cc:276] 0709 13:11:58.016040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.016283 (+   243us) service_pool.cc:224] Handling call
0709 13:11:59.074166 (+1057883us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54000a4954. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d31853 00007f9a56cff60a 00007f9a502857d4 00007f9a50285762 00007f9a50285691 00007f9a5028560c 00007f9a502848c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:11:59.074353 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806537088}
I20260709 13:11:59.134799 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.002261 31125 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.040278 31109 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.093319 31269 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:59.140763 31274 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:11:59.141389 31273 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:59.143896 31125 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.115033 31147 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:59.148509 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:59.114197 31287 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.127857 31270 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:59.122023 31182 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.177659 27299 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:59.167872 27148 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:11:59.137392 30971 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:59.182561 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47831.4us
I20260709 13:11:59.138891 31251 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.146415 31102 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.121809 31276 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:59.029145 31272 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:59.211673 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.512s (SENT) [suppressed 17 similar messages]
I20260709 13:11:59.180984 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:59.188810 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.213454 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.136346 30921 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:59.194929 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:11:59.202337 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.194273 27303 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:59.203272 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:11:59.222242 27297 raft_consensus.cc:606] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.198433 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:59.223649 31287 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.224071 31287 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.224413 31287 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.225986 31040 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:59.230943 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:11:59.238548 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.154884 31109 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:11:59.198503 30939 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.248993 30939 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.249445 30939 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.263201 30892 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.266610 30892 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.267038 30892 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.189251 31266 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.265183 31293 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.273092 31293 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.273530 31293 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.263319 31285 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:59.275800 31285 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:59.276173 31285 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:59.182267 30971 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:59.276825 30971 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.277110 31285 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.284305 31056 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:59.154613 30308 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.243000 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.173534 31089 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.180011 31147 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:11:59.193614 31022 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:59.248334 31105 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:11:59.309696 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66826.3us
I20260709 13:11:59.312939 31263 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.313493 27226 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:59.313581 31263 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.314283 31022 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:59.318387 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 92708.8us
I20260709 13:11:59.320036 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.320722 27297 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
W20260709 13:11:59.322490 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 90428.9us
I20260709 13:11:59.323381 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:59.340322 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.353715 27148 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:59.326036 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:59.334720 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:59.355832 27155 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.329588 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.331039 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.328867 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:59.366410 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 229723us
I20260709 13:11:59.368498 27226 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:59.371623 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.372270 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.374768 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.375443 27227 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:59.375206 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49345.8us
I20260709 13:11:59.377108 27224 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:59.378764 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.371055 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.321075 31056 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.317921 31219 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:59.386765 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:11:59.323678 31285 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.388760 27226 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:59.388790 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.323817 31179 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.398445 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:59.399389 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.387619 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.246134 30986 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.391758 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.393405 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.313751 31147 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.401140 27224 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:59.317991 31089 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.363175 31105 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.403537 27227 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:11:59.321755 30821 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.369859 31178 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.406417 27229 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:59.407486 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.421540 27226 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.393906 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.407691 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:11:59.370601 31125 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:59.369738 31276 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.322418 31282 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:11:59.389362 31269 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:59.414873 31270 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:59.417691 31105 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.325954 30679 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:11:59.393393 31291 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.419461 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.419904 27157 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:59.405005 31263 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.399098 31056 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.435068 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.416138 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.438874 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:11:59.451009 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88768.8us
I20260709 13:11:59.421111 31178 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.467958 31178 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.427467 31272 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.443416 31105 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.442616 27226 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:59.469134 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.466992 27223 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:59.449743 27228 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:11:59.471596 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.474951 27226 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:11:59.473556 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:11:59.473647 27299 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:59.418987 31012 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:59.433378 31223 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.475836 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.439893 31270 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.418844 31089 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.480105 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.482805 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.423208 30821 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.444079 31269 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:11:59.489046 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.476722 31270 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.449430 30308 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.491300 27229 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:59.432719 31125 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.495890 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.500449 27229 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:59.501956 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.503777 27229 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:11:59.506822 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.509160 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.435899 31276 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.509711 27223 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:59.511569 30918 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.514159 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.515484 27229 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:59.508538 31177 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.007s
I20260709 13:11:59.528096 27232 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:59.529399 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.515272 31102 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:59.530314 31294 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:11:59.534469 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.535530 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.538581 27227 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:11:59.538766 30765 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.001s
I20260709 13:11:59.539582 31204 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.540211 31204 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.542258 31056 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:59.510836 30939 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.470897 31291 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.547173 30939 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.548750 31291 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.550566 31125 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.550771 27229 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:59.551884 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:11:59.552493 27229 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:11:59.552577 30892 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:59.555411 31290 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:59.557370 27303 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:59.558346 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:59.558745 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.559742 27228 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:11:59.571889 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:59.574278 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.574345 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.575112 31296 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.575646 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.575765 31296 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.576823 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.577387 27298 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:11:59.578095 27197 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:11:59.578842 30918 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:59.579442 31296 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:59.579823 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.581043 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.527521 31080 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.582435 31080 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.583047 27232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b"
dest_uuid: "9bc1278c649846e998b312b374274d08"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:33920
I20260709 13:11:59.583617 27232 raft_consensus.cc:606] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:59.583938 27232 raft_consensus.cc:614] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:59.584604 31080 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.587626 27155 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:59.589118 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.589638 27298 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:11:59.589797 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.585819 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:59.594805 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:11:59.599689 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.601341 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.601372 31287 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:11:59.602474 27306 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:11:59.602825 27231 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:11:59.607393 27226 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:59.567514 31291 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:59.556788 31177 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.612665 31177 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.615968 31229 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.618964 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.619746 30821 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.622545 31183 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.622975 31183 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.623360 31183 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.624181 31105 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.598531 31269 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.563984 31125 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.627751 31125 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.629174 31089 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.630183 30739 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.630784 30739 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.632894 30739 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.634423 31276 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.630388 27297 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:59.636202 30986 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:11:59.640652 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.646258 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:11:59.650612 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.654964 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.658878 27306 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:11:59.660853 31125 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.664896 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.690577 31105 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.716717 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:11:59.649544 31270 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.776736 30892 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.778721 31178 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.779508 31270 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.744208 27306 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:59.656898 31219 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:11:59.781685 31178 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.781605 31219 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.783455 31287 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.787147 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.804003 27838 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:59.791080 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.805220 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.787848 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.789602 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.807036 27832 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.791440 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.808149 27833 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:59.809120 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.789273 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:11:59.795507 30971 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.007s
I20260709 13:11:59.795533 27834 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:59.796355 31299 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:11:59.796649 31183 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:11:59.802205 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.805393 27836 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:59.818668 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.818827 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.807219 27840 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:11:59.819792 27836 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.820308 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.820915 27840 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:59.821486 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.776389 27302 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:11:59.822501 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:11:59.830458 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.834718 27299 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:59.835402 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 1992) took 1771 ms. Trace:
I20260709 13:11:59.835764 27305 rpcz_store.cc:276] 0709 13:11:58.063617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.063758 (+   141us) service_pool.cc:224] Handling call
0709 13:11:58.064134 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.064498 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.064530 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.743689 (+679159us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800415fc0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a
0709 13:11:59.783542 (+1039853us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:11:59.794810 (+ 11268us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.828360 (+ 33550us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:59.828384 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.828439 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.830029 (+  1590us) raft_consensus.cc:1685] finished
0709 13:11:59.830084 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.835331 (+  5247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5188,"raft.queue_time_us":225,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6342,"spinlock_wait_cycles":8317184,"thread_start_us":33155,"threads_started":1,"wal-append.queue_time_us":33512}
I20260709 13:11:59.839706 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.838692 31178 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.842924 31178 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.844086 31012 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.844580 31012 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.845434 31178 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.845836 30892 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:59.846263 31229 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:59.846453 30892 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.846838 31012 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.846753 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.848287 27833 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.848737 31183 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:11:59.802640 31080 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:11:59.831111 31287 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.854545 31287 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.854976 31287 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.866539 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.861618 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.869978 27838 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:11:59.888190 27836 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:59.889391 27833 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:59.824352 31147 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:59.899796 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.900768 27306 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.902732 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:11:59.903569 27841 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.835018 31220 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.840178 31295 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.913566 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.837627 31272 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:11:59.919407 27832 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:11:59.824605 31276 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:11:59.841168 30739 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.859194 31080 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:11:59.878716 31293 consensus_meta.cc:287] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.599s	user 0.017s	sys 0.007s
I20260709 13:11:59.907804 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.923396 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.939051 27832 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:11:59.867662 31183 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.924113 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.927995 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:11:59.869395 30892 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.908427 31180 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.930297 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:11:59.930822 31308 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:59.824061 30971 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.909168 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:11:59.952093 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.960775 27841 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:11:59.947937 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 114843us
I20260709 13:11:59.965755 27833 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:11:59.965711 27299 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:59.962987 27298 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:59.961452 27306 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:11:59.831699 31299 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.973402 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:11:59.969172 27271 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.980751 27156 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:59.988763 27305 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:11:59.949291 30986 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.965099 31183 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.993665 31233 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:59.999348 31147 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.012483 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:11:59.978797 30892 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.018409 31168 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:11:59.922524 31295 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:11:59.955335 30739 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.024207 30971 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:11:59.955161 31293 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:11:59.995743 31282 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:59.968864 31180 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.035604 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:00.025333 30892 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.036567 30308 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:00.037235 31233 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:11:59.934091 31272 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.001580 31287 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:00.035931 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56637.1us
I20260709 13:12:00.013933 30986 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.062423 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:00.064054 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:00.064857 27837 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:00.066335 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 854614us
I20260709 13:12:00.067584 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.066347 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.068588 27841 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:12:00.074740 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.049693 30324 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.049507 30892 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:00.088284 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.088279 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.057627 30739 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.063068 30308 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:00.074652 31168 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.076107 31125 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.105964 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.098289 31168 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.087541 31178 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.112301 27837 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:00.095525 30324 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.113240 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.112248 31056 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.116972 27301 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:00.102934 31289 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.104748 30739 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:00.112433 31299 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:00.116107 30324 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.143925 31289 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:00.126134 27305 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:00.110597 31125 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.134598 31295 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:00.160773 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52635.1us
I20260709 13:12:00.141203 31080 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.116979 31178 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.117533 31233 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:00.229975 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 128285us
I20260709 13:12:00.248546 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.249477 27832 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:00.160132 30308 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.172655 30986 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.254161 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.255406 27832 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:00.255937 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:00.274533 27841 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:00.253618 31287 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.225436 31080 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:12:00.285589 31125 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:00.283005 31328 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:00.255462 31180 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.310318 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.316922 27832 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:00.258673 31293 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:00.279491 31326 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:00.228443 31331 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:12:00.274070 30986 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.331748 31182 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.334373 31334 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:00.352721 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:00.369028 31182 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.345394 31022 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.353794 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.390230 27155 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.272961 31183 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.371876 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:00.284503 31204 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.409032 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2433) took 1575 ms. Trace:
I20260709 13:12:00.409982 27152 rpcz_store.cc:276] 0709 13:11:58.834044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.836000 (+  1956us) service_pool.cc:224] Handling call
0709 13:11:58.836285 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.836485 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:59.111163 (+274678us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.361500 (+1250337us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b180014c5c0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a
0709 13:12:00.408630 (+ 47130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.408700 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:00.408749 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.408828 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.408968 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46866,"prepare.queue_time_us":332761,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":5670,"spinlock_wait_cycles":13915520,"thread_start_us":367584,"threads_started":2,"wal-append.queue_time_us":289613}
I20260709 13:12:00.422417 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.423893 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:00.426800 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:00.428144 27154 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:00.430907 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:00.393635 30986 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:00.432547 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:00.434690 27156 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:00.429344 27155 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:00.420598 30739 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:00.440356 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 275872us
I20260709 13:12:00.443717 30739 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:00.445335 27152 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:12:00.439329 31330 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:12:00.448875 31282 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.432296 31333 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.449401 31282 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.449666 31333 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.453025 30739 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.456615 31182 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.456895 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.458096 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.458604 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2061) took 1082 ms. Trace:
I20260709 13:12:00.431345 31272 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.458974 27224 rpcz_store.cc:276] 0709 13:11:59.376180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.473254 (+ 97074us) service_pool.cc:224] Handling call
0709 13:12:00.458407 (+985153us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b540038d1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:00.458542 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459045248}
I20260709 13:12:00.462497 30986 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.468768 30892 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.388532 27043 maintenance_manager.cc:643] P b1a1bf33a5434d58a8638deed0153f03: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.276s	user 0.220s	sys 0.092s Metrics: {"bytes_written":30602,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":178052,"dirs.run_cpu_time_us":450,"dirs.run_wall_time_us":15493,"drs_written":1,"lbm_read_time_us":58715,"lbm_reads_10-100_ms":4,"lbm_write_time_us":186418,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":150391,"threads_started":2,"update_count":9,"wal-append.queue_time_us":110722}
I20260709 13:12:00.473378 27044 maintenance_manager.cc:419] P b1a1bf33a5434d58a8638deed0153f03: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10397 bytes on disk
I20260709 13:12:00.473282 31147 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.475498 30892 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.481727 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.483006 31331 raft_consensus.cc:2764] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:00.483704 31331 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:00.484450 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.484215 31331 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.484874 31272 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:00.487861 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.488759 27832 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:00.453766 31333 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.490659 31178 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.492681 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:00.493494 27839 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.496112 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.503470 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.505522 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.505827 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.506456 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.506599 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:00.507822 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:00.508473 27837 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:00.509402 27151 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:00.510998 27043 maintenance_manager.cc:643] P b1a1bf33a5434d58a8638deed0153f03: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.009s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":455,"lbm_reads_lt_1ms":4}
I20260709 13:12:00.513226 31282 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.532675 27839 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:00.509536 30892 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.625363 30892 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.627929 30892 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:00.551440 27123 connection.cc:256] RPC call timeout handler was delayed by -1.5848805030000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:12:00.569438 30717 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:00.628595 27123 connection.cc:256] RPC call timeout handler was delayed by -1.5830805030000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 13:12:00.573256 30939 raft_consensus.cc:993] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:00.574862 31204 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:00.578475 30863 raft_consensus.cc:2764] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:12:00.578871 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 739199us
I20260709 13:12:00.637164 31282 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.579989 31259 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.585840 30865 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.640216 30865 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.642433 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:00.644317 27837 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:00.586239 27149 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:00.588039 31168 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.588503 31263 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.655326 31263 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.656482 31259 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:00.657586 31263 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.590410 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.658358 27225 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:00.659380 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:00.660080 27225 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:00.655071 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:00.660867 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.661567 27225 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:00.591228 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:00.592056 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:00.662568 27231 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.664132 31331 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:00.592716 27055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 244) took 24468 ms (client timeout 15000 ms). Trace:
I20260709 13:12:00.667884 30939 raft_consensus.cc:1081] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:00.592873 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:00.669842 27226 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:00.594126 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.594169 27228 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:00.596346 31265 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:00.598644 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.598816 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.677744 27232 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:00.677930 27229 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:00.599321 31251 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.601823 27051 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:00.606729 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.608637 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.612789 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:00.616273 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:00.678761 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.618521 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:00.629091 27123 connection.cc:256] RPC call timeout handler was delayed by -1.465180503000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:12:00.646476 30865 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.678785 27155 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.669281 31204 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:00.598706 31220 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:00.677023 31263 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.658352 31125 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:12:00.683864 31251 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:00.684499 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:00.684592 27123 connection.cc:256] RPC call timeout handler was delayed by -1.3886805029999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:12:00.685398 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 66982.1us
I20260709 13:12:00.710618 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:00.688870 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72691.1us
I20260709 13:12:00.711654 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:00.712545 27123 connection.cc:256] RPC call timeout handler was delayed by -1.2653805029999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 13:12:00.704841 27051 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 5 to 6, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:00.713042 27123 connection.cc:256] RPC call timeout handler was delayed by -1.1627805030000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:12:00.713378 27123 connection.cc:256] RPC call timeout handler was delayed by -1.1411805029999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 13:12:00.713662 27123 connection.cc:256] RPC call timeout handler was delayed by -1.0722626079998463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:12:00.713927 27123 connection.cc:256] RPC call timeout handler was delayed by -1.0242731219998404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:12:00.714216 27123 connection.cc:256] RPC call timeout handler was delayed by -1.0101626079999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:12:00.701946 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:00.666229 27055 rpcz_store.cc:269] 0709 13:11:36.124324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.124599 (+   275us) service_pool.cc:224] Handling call
0709 13:12:00.592618 (+24468019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:52.875023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:52.875743 (+   720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:52.875816 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:11:52.875835 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:52.876924 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:52.877028 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:52.877054 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:53.032676 (+155622us) tablet.cc:701] Row locks acquired
0709 13:11:53.043789 (+ 11113us) write_op.cc:260] PREPARE: finished
0709 13:11:53.060540 (+ 16751us) write_op.cc:270] Start()
0709 13:11:53.075653 (+ 15113us) write_op.cc:276] Timestamp: P: 1783602713050924 usec, L: 0
0709 13:11:53.084776 (+  9123us) op_driver.cc:348] REPLICATION: starting
0709 13:11:53.201102 (+116326us) log.cc:844] Serialized 3947 byte log entry
0709 13:11:53.661090 (+459988us) op_driver.cc:464] REPLICATION: finished
0709 13:11:53.810825 (+149735us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a5576def0
0709 13:11:54.283786 (+472961us) write_op.cc:301] APPLY: starting
0709 13:11:54.319157 (+ 35371us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:54.426817 (+107660us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:54.426867 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:54.437378 (+ 10511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:54.437799 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:11:54.437867 (+    68us) write_op.cc:312] APPLY: finished
0709 13:11:54.438326 (+   459us) log.cc:844] Serialized 71 byte log entry
0709 13:11:54.438571 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:54.438712 (+   141us) write_op.cc:454] Released schema lock
0709 13:11:54.438789 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:54.439290 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:54.439327 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":231458,"reported_tablets":37,"spinlock_wait_cycles":7040,"child_traces":[["op",{"apply.queue_time_us":583747,"apply.run_cpu_time_us":4865,"apply.run_wall_time_us":178037,"num_ops":9,"prepare.queue_time_us":421699,"prepare.run_cpu_time_us":25030,"prepare.run_wall_time_us":499209,"raft.queue_time_us":185879,"raft.run_cpu_time_us":17192,"raft.run_wall_time_us":758176,"replication_time_us":576127,"spinlock_wait_cycles":142259456,"thread_start_us":1242594,"threads_started":4,"wal-append.queue_time_us":188664,"wal-append.run_cpu_time_us":25397,"wal-append.run_wall_time_us":2043056}]]}
I20260709 13:12:00.706763 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.708581 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.717972 27837 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:00.718084 27228 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:00.719161 27225 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:00.720170 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.708312 30865 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:00.725625 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.724210 31291 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:00.727052 30712 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:00.727887 31147 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:00.706343 31339 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:12:00.729182 31219 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.729660 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.730454 27228 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:00.731158 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.708665 30717 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:00.702874 31221 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:12:00.731824 27228 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:00.715981 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:00.795508 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 80174us
I20260709 13:12:00.687198 31204 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:00.700346 31276 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:00.809383 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.739663 27051 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.724232 30865 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:00.704603 31220 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:00.821539 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 144945us
I20260709 13:12:00.732182 27227 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.732197 30717 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:00.849164 30324 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.016s
I20260709 13:12:00.929322 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:00.824208 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 98657.3us
W20260709 13:12:00.828619 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 81488.1us
I20260709 13:12:00.933013 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.936257 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.823307 31259 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.837191 31147 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.857455 27228 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:00.857944 27229 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.859855 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:00.715341 27231 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:00.919278 27225 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:00.919075 27272 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.693153 27155 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:00.941342 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:00.962864 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.926783 31216 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:00.943022 27051 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 5 to 6, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.827881 31291 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:00.970815 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.723567 27226 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:00.837013 30712 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:00.974185 30712 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.975782 31257 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.976382 31257 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.976864 31257 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.836658 31263 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.978379 31263 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:00.980746 31263 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:00.982242 31291 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:00.982908 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63924.5us
I20260709 13:12:00.983817 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:00.985373 31232 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.964403 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:00.986299 31233 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.986785 31233 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.986908 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:00.987243 31233 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.988195 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:00.989436 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:00.837152 31321 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.990898 31109 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:00.991393 31109 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:00.991770 31109 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:00.992280 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 86626.8us
I20260709 13:12:00.938736 30717 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:00.994236 31269 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.995050 31269 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.995713 31269 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.943791 31296 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.996198 31269 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:00.945380 31293 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.946270 31219 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:00.990577 31242 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:00.926607 30863 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:00.997608 31219 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:00.998256 31242 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:00.996210 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:00.998679 31293 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:00.998564 31219 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:00.999162 30821 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:00.999290 31293 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.999701 30821 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:01.000248 30821 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:00.997936 30863 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.001008 31251 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:01.001606 31293 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.972874 31287 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.998674 31242 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:00.968465 27225 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:01.002902 31216 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.003415 31242 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:00.916496 30739 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:01.004630 31242 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.990512 31321 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.005338 31216 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:01.002462 30863 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:00.947300 30971 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.997233 31269 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:01.019217 27226 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:01.019301 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:01.000135 31219 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.027693 27231 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:00.949584 31259 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:01.037108 31259 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:01.038115 30821 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:01.037928 30865 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:00.944741 30324 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.043694 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:01.046502 30739 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:01.051841 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:01.051841 30739 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:01.053150 30739 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.054510 30739 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.016028 31147 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:01.058629 31147 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:01.059387 30324 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:01.059893 31147 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.060738 27304 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:01.007156 31321 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:01.048498 27232 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:01.075486 27231 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:01.050261 30308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.012s
W20260709 13:12:01.080189 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.073385 31272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.007s
I20260709 13:12:01.076220 31335 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:01.022346 31035 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:12:01.065035 31232 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:01.064087 30821 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:01.081446 30308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.012s
I20260709 13:12:01.041942 30939 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:12:01.083586 30397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.029s
W20260709 13:12:01.167506 30397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.031s
W20260709 13:12:01.208132 31343 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:01.145188 31335 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:01.215842 31204 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:01.240700 30880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.026s	sys 0.072s
W20260709 13:12:01.263384 30880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.027s	sys 0.072s
I20260709 13:12:01.072279 30815 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:01.085630 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.207386 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3012) took 1143 ms. Trace:
I20260709 13:12:02.207856 27232 rpcz_store.cc:276] 0709 13:12:01.063897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.073133 (+  9236us) service_pool.cc:224] Handling call
0709 13:12:02.207099 (+1133966us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:01.083953 27806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.021s
W20260709 13:12:02.210669 27806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.013s	sys 0.021s
W20260709 13:12:02.211138 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 1.71536e+06us
I20260709 13:12:02.213229 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:01.670809 27839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.006s	sys 0.011s
W20260709 13:12:02.214461 27839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.011s	sys 0.013s
W20260709 13:12:01.661958 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.217666 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3009) took 1170 ms. Trace:
I20260709 13:12:02.218232 27232 rpcz_store.cc:276] 0709 13:12:01.047688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.209203 (+1161515us) service_pool.cc:224] Handling call
0709 13:12:02.209733 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.217233 (+  7500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.217268 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.217322 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:02.217367 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.217445 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.217583 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:01.670148 27836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.004s	sys 0.013s
I20260709 13:12:01.683679 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:02.219681 27836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.011s	sys 0.013s
I20260709 13:12:02.220261 27301 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:02.220476 27151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 2993) took 1798 ms (client timeout 2306 ms). Trace:
W20260709 13:12:01.610277 27223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.008s	sys 0.025s
W20260709 13:12:02.221448 27223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.014s	sys 0.034s
W20260709 13:12:02.220983 27151 rpcz_store.cc:269] 0709 13:12:00.421903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.422054 (+   151us) service_pool.cc:224] Handling call
0709 13:12:02.219980 (+1797926us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b5400171454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:02.220165 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118576000}
W20260709 13:12:01.619750 27224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.018s	sys 0.015s
W20260709 13:12:02.222873 27224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.022s	sys 0.027s
W20260709 13:12:01.140904 31178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.033s
I20260709 13:12:02.223572 30865 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:02.224120 31178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.007s	sys 0.033s
I20260709 13:12:01.115229 31180 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:01.078495 31183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.013s
W20260709 13:12:01.118208 31272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.009s	sys 0.007s
W20260709 13:12:01.278266 31316 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.004s	sys 0.005s
I20260709 13:12:02.249449 31180 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:01.596203 27149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.000s	sys 0.002s
I20260709 13:12:01.579144 27051 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 7, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 7 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:01.596292 27154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.016s	sys 0.018s
I20260709 13:12:01.689373 30324 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.659262 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:01.696509 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:01.753284 30712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.001s	sys 0.005s
W20260709 13:12:02.093616 27229 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.118s	user 0.017s	sys 0.038s
W20260709 13:12:02.108224 27227 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.155s	user 0.026s	sys 0.027s
I20260709 13:12:02.110316 31221 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.111445 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:02.113095 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 1.091e+06us
W20260709 13:12:02.113651 31356 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.335s	user 0.007s	sys 0.004s
W20260709 13:12:02.263164 27154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.732s	user 0.020s	sys 0.032s
W20260709 13:12:02.093551 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 382748us
I20260709 13:12:02.120389 31206 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:02.121464 31225 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.121681 31321 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.123255 27300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.020s	sys 0.041s
I20260709 13:12:02.124334 30821 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.126777 31232 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.125195 31289 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.127437 31269 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:02.264207 30712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.005s	sys 0.010s
I20260709 13:12:02.131094 31299 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:02.134614 31350 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:02.298379 27300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.021s	sys 0.042s
I20260709 13:12:02.133612 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3001) took 1529 ms. Trace:
I20260709 13:12:02.144590 31204 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:02.133623 31242 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.128s	user 0.025s	sys 0.033s
W20260709 13:12:02.145962 31233 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.158s	user 0.031s	sys 0.016s
I20260709 13:12:02.149241 31331 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.153261 31335 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:02.154215 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.014s	sys 0.015s
W20260709 13:12:02.163231 31358 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:12:02.168725 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2995) took 1571 ms. Trace:
I20260709 13:12:02.169422 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1175) took 1559 ms. Trace:
W20260709 13:12:02.155699 31257 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.178s	user 0.012s	sys 0.026s
I20260709 13:12:02.170542 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2287) took 1126 ms. Trace:
I20260709 13:12:02.304459 27232 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:02.308012 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.014s	sys 0.015s
I20260709 13:12:02.174602 31357 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.128535 31341 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:02.178311 27120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.016s	sys 0.004s
W20260709 13:12:02.178572 27123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.129s	user 0.024s	sys 0.055s
I20260709 13:12:02.178470 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:02.118178 31109 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.125s	user 0.026s	sys 0.006s
W20260709 13:12:02.187172 30739 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.132s	user 0.014s	sys 0.019s
W20260709 13:12:02.188979 30717 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.194s	user 0.021s	sys 0.006s
I20260709 13:12:02.298626 31299 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:02.205327 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:02.206307 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.162648 31337 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.477s	user 0.000s	sys 0.003s
W20260709 13:12:02.256768 31316 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.734s	user 0.004s	sys 0.019s
I20260709 13:12:02.343578 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.266363 27305 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:02.345674 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2020) took 1248 ms. Trace:
I20260709 13:12:02.346092 27305 rpcz_store.cc:276] 0709 13:12:01.097679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.100173 (+  2494us) service_pool.cc:224] Handling call
0709 13:12:02.345564 (+1245391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.347569 31232 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.347374 31299 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.349596 31299 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.267748 31225 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.264871 31206 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:02.268447 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1172) took 1895 ms. Trace:
I20260709 13:12:02.267769 27227 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:02.270171 27229 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:02.270776 30324 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.275684 31377 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.280393 31180 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:02.283203 27149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.548s	user 0.002s	sys 0.017s
I20260709 13:12:02.123461 31332 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:02.360644 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 1.37115e+06us
I20260709 13:12:02.299031 27228 rpcz_store.cc:276] 0709 13:12:00.603676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.957728 (+354052us) service_pool.cc:224] Handling call
0709 13:12:00.958018 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.049083 (+ 91065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.049120 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:01.049175 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:01.049217 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.132979 (+1083762us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b54001257d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:02.133066 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.133330 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208885120}
I20260709 13:12:02.277024 30815 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.306188 27230 rpcz_store.cc:276] 0709 13:12:00.597134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.597269 (+   135us) service_pool.cc:224] Handling call
0709 13:12:00.597535 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.673666 (+ 76131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.673698 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:00.673743 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:00.673784 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.167999 (+1494215us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b54001da6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:02.168099 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.168418 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174606080}
W20260709 13:12:02.315341 27120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.016s	sys 0.004s
W20260709 13:12:02.304167 31183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.741s	user 0.003s	sys 0.018s
W20260709 13:12:02.189311 31219 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.129s	user 0.019s	sys 0.013s
I20260709 13:12:02.317538 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3010) took 1266 ms. Trace:
W20260709 13:12:02.317716 27123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.025s	sys 0.055s
I20260709 13:12:02.308197 27304 rpcz_store.cc:276] 0709 13:12:01.043924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.052922 (+  8998us) service_pool.cc:224] Handling call
0709 13:12:01.053240 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.061449 (+  8209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.169856 (+1108407us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b54001ca2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:02.170312 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16733568}
I20260709 13:12:02.306315 27834 rpcz_store.cc:276] 0709 13:12:00.609928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.610135 (+   207us) service_pool.cc:224] Handling call
0709 13:12:00.610439 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.658989 (+ 48550us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:00.659304 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.139559 (+480255us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.141967 (+  2408us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.142149 (+   182us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:01.670556 (+528407us) log.cc:844] Serialized 14 byte log entry
0709 13:12:01.683150 (+ 12594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.683380 (+   230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.168957 (+485577us) raft_consensus.cc:1685] finished
0709 13:12:02.168989 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.169142 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48098,"prepare.queue_time_us":970658,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":110,"raft.queue_time_us":85674,"raft.run_cpu_time_us":9873,"raft.run_wall_time_us":349348,"thread_start_us":478872,"threads_started":1,"wal-append.queue_time_us":1505663}
I20260709 13:12:02.324906 30717 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.325088 27051 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 5 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:02.378088 27232 rpcz_store.cc:276] 0709 13:12:01.048038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.248608 (+1200570us) service_pool.cc:224] Handling call
0709 13:12:02.261136 (+ 12528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.309381 (+ 48245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.314494 (+  5113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.316463 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.324059 31335 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.337656 31269 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.317850 31257 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.351297 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.266798 31221 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:02.338304 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49130.4us
I20260709 13:12:02.347426 31089 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:02.304261 31289 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:02.377163 27229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3003) took 1685 ms (client timeout 1561 ms). Trace:
I20260709 13:12:02.326285 30821 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.360738 27841 rpcz_store.cc:276] 0709 13:12:00.372464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.372780 (+   316us) service_pool.cc:224] Handling call
0709 13:12:00.380194 (+  7414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.553445 (+173251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:00.553495 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.554217 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.075995 (+521778us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:01.076051 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.076166 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.267887 (+1191721us) raft_consensus.cc:1685] finished
0709 13:12:02.267930 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.268184 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":667,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":641187,"threads_started":2,"wal-append.queue_time_us":646481}
I20260709 13:12:02.316295 31321 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.390017 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 2994) took 1795 ms. Trace:
W20260709 13:12:02.399094 27229 rpcz_store.cc:269] 0709 13:12:00.687719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.715706 (+ 27987us) service_pool.cc:224] Handling call
0709 13:12:02.365711 (+1650005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:02.395051 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3002) took 1882 ms. Trace:
I20260709 13:12:02.412366 31269 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.415266 30815 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:02.417953 31380 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.418754 31380 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.380415 31341 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:02.413672 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 210153us
W20260709 13:12:02.421572 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.365502 31080 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:12:02.424155 31080 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.424908 31080 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.425259 31289 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.374384 31357 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.365554 31331 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.412622 31109 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.412851 31368 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.370596 31233 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.360879 31350 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.413046 31251 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.433357 31368 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.465150 31368 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:02.434966 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.46411e+06us
I20260709 13:12:02.467690 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:02.469419 31147 raft_consensus.cc:2764] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:02.436223 31233 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.436348 30717 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.436452 31332 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.437399 31206 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.437961 27231 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.438793 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.439467 31335 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.431509 27051 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.481745 31335 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.482324 31335 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.483017 31335 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.436529 27301 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:02.475538 31206 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.426010 31289 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.428574 31357 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.490428 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2452) took 1831 ms. Trace:
I20260709 13:12:02.487579 31089 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.437335 31251 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.488346 31109 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.436800 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 882) took 1798 ms. Trace:
I20260709 13:12:02.437564 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:02.436697 31350 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.494598 27151 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:12:02.484424 27051 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 5 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:02.431061 31220 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.488s	user 0.012s	sys 0.014s
I20260709 13:12:02.503515 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:02.509025 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 70602.1us
I20260709 13:12:02.429103 31225 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:02.407318 27154 rpcz_store.cc:276] 0709 13:12:00.499169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.499298 (+   129us) service_pool.cc:224] Handling call
0709 13:12:00.523938 (+ 24640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.524205 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:00.530647 (+  6442us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.314980 (+1784333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.323916 (+  8936us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:02.360771 (+ 36855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.373719 (+ 12948us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.381383 (+  7664us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138114,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":4693,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":44559,"thread_start_us":1752881,"threads_started":1,"wal-append.queue_time_us":1608030}
I20260709 13:12:02.515970 27155 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:02.475477 31332 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.514418 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1527) took 2030 ms. Trace:
I20260709 13:12:02.407434 27224 rpcz_store.cc:276] 0709 13:12:00.594496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.594674 (+   178us) service_pool.cc:224] Handling call
0709 13:12:00.594987 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.595298 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.595325 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.595870 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.362767 (+1766897us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54003f0320. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51cae6b8 00007f9a51d3792b 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c
0709 13:12:02.374423 (+ 11656us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:02.374515 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.378158 (+  3643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.378206 (+    48us) raft_consensus.cc:1685] finished
0709 13:12:02.378223 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.389928 (+ 11705us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4153,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":79,"spinlock_wait_cycles":132515072,"thread_start_us":1627098,"threads_started":1,"wal-append.queue_time_us":1543600}
I20260709 13:12:02.493649 27149 rpcz_store.cc:276] 0709 13:12:00.658667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.672907 (+ 14240us) service_pool.cc:224] Handling call
0709 13:12:00.673335 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.682072 (+  8737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.682120 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.682731 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.400562 (+1717831us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:02.405045 (+  4483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.476335 (+ 71290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.476391 (+    56us) raft_consensus.cc:1685] finished
0709 13:12:02.476403 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.490359 (+ 13956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8244,"raft.queue_time_us":9223,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16936,"thread_start_us":1629732,"threads_started":1,"wal-append.queue_time_us":1564695}
I20260709 13:12:02.538952 27305 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:02.546989 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:02.547951 30324 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:02.495951 27839 rpcz_store.cc:276] 0709 13:12:00.638877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.660907 (+ 22030us) service_pool.cc:224] Handling call
0709 13:12:00.661249 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.661591 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.661623 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:00.663078 (+  1455us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.215182 (+1552104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:02.215785 (+   603us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.242736 (+ 26951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.248586 (+  5850us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.436460 (+187874us) raft_consensus.cc:1685] finished
0709 13:12:02.436484 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.436728 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14583,"prepare.queue_time_us":1180,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":99005,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":24103,"thread_start_us":1551417,"threads_started":1,"wal-append.queue_time_us":1612405}
I20260709 13:12:02.554920 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.559221 31377 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:02.534684 31357 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.563318 27229 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:12:02.563638 31357 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.538371 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:02.566481 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 139182us
I20260709 13:12:02.574502 27153 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:02.574949 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.576148 27228 raft_consensus.cc:2410] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:02.577150 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3004) took 1831 ms. Trace:
W20260709 13:12:02.578647 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 111289us
I20260709 13:12:02.578935 31321 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.577620 27225 rpcz_store.cc:276] 0709 13:12:00.745999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.003547 (+257548us) service_pool.cc:224] Handling call
0709 13:12:01.003922 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.023215 (+ 19293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.023268 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.124764 (+1101496us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b2c00010828. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:02.150695 (+ 25931us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.383949 (+233254us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:02.486267 (+102318us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.508277 (+ 22010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.533042 (+ 24765us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.576689 (+ 43647us) raft_consensus.cc:1685] finished
0709 13:12:02.576793 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.576978 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29161,"prepare.queue_time_us":94026,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":6305,"raft.queue_time_us":34128,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":25554,"spinlock_wait_cycles":8861184,"thread_start_us":228067,"threads_started":1,"wal-append.queue_time_us":363979}
I20260709 13:12:02.580101 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.580806 27225 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:02.532619 27841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:12:02.582912 27841 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.583271 27841 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.534802 31350 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:02.585920 31350 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:02.534103 31289 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.587073 31350 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.588551 31350 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.588579 31289 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.538516 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.581826 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.592545 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.577105 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.591063 27840 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:02.564766 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.596984 31221 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.599049 27835 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:02.597282 27148 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:02.600607 31080 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.601231 31232 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.598922 27224 raft_consensus.cc:2376] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7. Re-sending same reply.
I20260709 13:12:02.603236 31089 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.606438 27229 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:12:02.607554 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.608021 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.609072 27232 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:02.594515 31109 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.608302 27229 raft_consensus.cc:2368] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:02.602485 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.566037 31357 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.525588 27836 rpcz_store.cc:276] 0709 13:12:00.484425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.491724 (+  7299us) service_pool.cc:224] Handling call
0709 13:12:00.491999 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.492210 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:00.790352 (+298142us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.508164 (+1717812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.513855 (+  5691us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:02.514024 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.514174 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.514343 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27607,"prepare.queue_time_us":27457,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":196917,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":201,"thread_start_us":1911463,"threads_started":3,"wal-append.queue_time_us":1294445}
I20260709 13:12:02.610044 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.623401 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:02.624588 27227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 2991) took 2036 ms (client timeout 1567 ms). Trace:
W20260709 13:12:02.625068 27227 rpcz_store.cc:269] 0709 13:12:00.587902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.590965 (+  3063us) service_pool.cc:224] Handling call
0709 13:12:02.624295 (+2033330us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b5400217d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:02.624490 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160546560}
I20260709 13:12:02.625912 31251 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.626864 27226 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:02.628532 31257 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.612661 31109 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.630311 31380 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:02.610317 31221 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.634531 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3007) took 1634 ms. Trace:
I20260709 13:12:02.542548 31332 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.634981 27226 rpcz_store.cc:276] 0709 13:12:01.000146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.020530 (+ 20384us) service_pool.cc:224] Handling call
0709 13:12:02.626248 (+1605718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.627263 (+  1015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.634248 (+  6985us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400217d50. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:02.634448 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3691633920}
I20260709 13:12:02.635553 31332 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.636049 31341 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.620424 27230 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:02.615610 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.639284 27148 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:02.641438 31225 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:02.645020 27153 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:12:02.645715 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 87452.6us
I20260709 13:12:02.646525 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:02.647555 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.628561 31331 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.666985 27154 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:02.615150 30324 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:02.534251 31269 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.650005 31332 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.589787 30863 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.515188 31220 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.682622 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:02.654948 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.613691 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.621651 27224 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:12:02.634985 27156 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:02.545929 27051 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:02.684623 27229 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:02.681790 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:02.631847 31221 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:02.689774 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:02.692670 27304 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:02.693287 30324 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.694376 31269 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.696871 31269 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:02.697721 27807 leader_election.cc:336] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.512s (SENT)
I20260709 13:12:02.698249 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:02.699734 30821 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.699867 31353 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:02.701182 27297 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:02.701637 31220 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:02.699867 27807 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.651s (SENT)
I20260709 13:12:02.677006 31335 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.706437 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:02.717945 31331 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.719048 27195 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:02.721405 27231 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:02.729001 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:02.733771 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.734555 27840 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:02.735513 31183 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:02.740108 30324 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:02.734320 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48087.9us
I20260709 13:12:02.731308 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2022) took 1627 ms. Trace:
I20260709 13:12:02.717135 27051 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 reported cstate change: config changed from index 4 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:02.741496 30324 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.748603 30324 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.721338 31332 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.745843 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:02.562044 31377 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.728070 31368 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.749626 30865 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.525s	user 0.018s	sys 0.000s
I20260709 13:12:02.705993 30863 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.732136 31269 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:02.771298 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.742527 27300 rpcz_store.cc:276] 0709 13:12:01.103588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.103728 (+   140us) service_pool.cc:224] Handling call
0709 13:12:01.104088 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:01.104335 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:02.309613 (+1205278us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.554856 (+245243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:02.594385 (+ 39529us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:02.686487 (+ 92102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.721353 (+ 34866us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.731237 (+  9884us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":656534,"prepare.run_cpu_time_us":404,"prepare.run_wall_time_us":18298,"raft.queue_time_us":8686,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"thread_start_us":1385423,"threads_started":2}
I20260709 13:12:02.770301 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.776470 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:02.774013 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 869) took 3283 ms. Trace:
I20260709 13:12:02.774721 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.777989 27226 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:02.784456 30324 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:02.786898 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.787385 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.789127 27230 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:02.768997 31269 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:02.791903 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 92103.7us
W20260709 13:12:02.793116 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 131463us
I20260709 13:12:02.794948 27225 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.790324 27051 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 5 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } }
I20260709 13:12:02.777772 31109 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.798007 27227 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:02.796113 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.793825 30939 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:02.806967 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 124160us
I20260709 13:12:02.791704 31257 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:12:02.809862 27804 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.710s (SENT)
I20260709 13:12:02.796618 31269 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:02.815338 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.777343 27223 rpcz_store.cc:276] 0709 13:11:59.490354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.514371 (+ 24017us) service_pool.cc:224] Handling call
0709 13:11:59.514818 (+   447us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:11:59.567048 (+ 52230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.567092 (+    44us) raft_consensus.cc:1539] Triggering prepare for 5 ops
0709 13:11:59.578994 (+ 11902us) log.cc:844] Serialized 130 byte log entry
0709 13:11:59.750315 (+171321us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:59.824074 (+ 73759us) log.cc:844] Serialized 14 byte log entry
0709 13:12:00.575172 (+751098us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b180011e3c0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:12:02.221938 (+1646766us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.747777 (+525839us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.760418 (+ 12641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.767798 (+  7380us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.767851 (+    53us) raft_consensus.cc:1685] finished
0709 13:12:02.767863 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.773893 (+  6030us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8996,"prepare.queue_time_us":724602,"prepare.run_cpu_time_us":29157,"prepare.run_wall_time_us":517399,"raft.queue_time_us":877702,"raft.run_cpu_time_us":794,"raft.run_wall_time_us":61811,"spinlock_wait_cycles":10774784,"thread_start_us":2257424,"threads_started":5,"wal-append.queue_time_us":198386,"wal-append.run_cpu_time_us":4014,"wal-append.run_wall_time_us":1196216}
I20260709 13:12:02.804359 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.793251 31221 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:02.816546 27232 raft_consensus.cc:2376] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11. Re-sending same reply.
I20260709 13:12:02.823722 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:02.828747 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:02.829339 31391 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:12:02.829548 27833 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:02.832723 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 83418.5us
I20260709 13:12:02.834810 27051 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 4 to 5, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:02.836007 31272 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:02.836691 31272 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.826968 31220 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:02.840408 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.841061 30717 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:02.841192 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 68165.8us
I20260709 13:12:02.841723 30717 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:02.843232 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:02.828924 31389 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:02.844074 31220 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:02.788097 31332 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.845220 31220 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:02.846896 31204 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.007s
I20260709 13:12:02.850677 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2019) took 1757 ms. Trace:
I20260709 13:12:02.851114 27297 rpcz_store.cc:276] 0709 13:12:01.093791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.096504 (+  2713us) service_pool.cc:224] Handling call
0709 13:12:01.096993 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:02.701780 (+1604787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.850358 (+148578us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001cb6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:02.850608 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3687955200}
I20260709 13:12:02.841081 27230 raft_consensus.cc:2376] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9. Re-sending same reply.
I20260709 13:12:02.853053 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.853932 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.827332 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.801918 30939 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.877404 30939 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:02.877562 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67753.9us
I20260709 13:12:02.798085 31368 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.884243 31368 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:02.885673 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.886309 27229 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:02.886448 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:02.887109 27223 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:02.887329 31390 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:12:02.894205 31389 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:02.895337 27834 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:02.894374 31395 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.102s	user 0.005s	sys 0.000s
W20260709 13:12:02.898658 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 73765.1us
W20260709 13:12:02.899401 27807 leader_election.cc:336] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.924s (SENT)
I20260709 13:12:02.899789 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:02.901162 27807 leader_election.cc:336] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.964s (SENT)
W20260709 13:12:02.901520 27231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3011) took 1842 ms (client timeout 2124 ms). Trace:
I20260709 13:12:02.902099 31321 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:02.901973 27231 rpcz_store.cc:269] 0709 13:12:01.059205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.633293 (+574088us) service_pool.cc:224] Handling call
0709 13:12:02.178079 (+544786us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:02.901347 (+723268us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400218c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:02.901460 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329516672}
I20260709 13:12:02.902623 31321 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:02.903043 31321 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.841280 27227 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:02.905225 31251 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.905827 31251 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:02.907274 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 83628.1us
I20260709 13:12:02.907919 27225 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:02.909968 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.911150 27230 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:02.871431 30324 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.843109 30717 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.901556 27807 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:02.876093 27841 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:02.915668 27833 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:12:02.918224 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.919590 27224 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:02.920634 30324 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:02.921293 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.928260 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.932729 27223 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:02.940435 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:02.908906 31251 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.944346 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.953032 27232 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:02.897907 30863 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:02.925729 31389 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:02.960865 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.956714 27152 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:02.943637 31180 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:02.960207 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.964424 27231 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:02.962241 27841 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.963182 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.961158 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:02.966321 27834 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:02.966627 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.933218 31394 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:02.959168 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 172438us
I20260709 13:12:02.972049 27226 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:02.974418 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.974679 31332 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:02.976202 31183 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:02.978206 31388 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:02.978653 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:02.972117 31180 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:02.978264 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:02.979382 27229 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
W20260709 13:12:02.972100 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 129027us
I20260709 13:12:02.984218 31204 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:02.985210 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.989296 31204 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.999370 31204 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.001600 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.002612 27226 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:03.003850 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.005064 27226 raft_consensus.cc:2410] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:02.992882 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.006982 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.007444 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.008081 27229 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:03.008491 27232 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:02.993036 31232 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.010032 31232 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.010411 31232 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.993129 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:02.993212 31299 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:02.993587 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.017714 30717 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.994921 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:02.998306 27230 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:03.042524 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47775.9us
I20260709 13:12:03.042654 31257 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:02.998231 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.043963 27195 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.044358 31257 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:03.044808 31257 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.047108 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.047819 27155 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:03.048285 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.049001 27224 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:03.049036 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:03.022235 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 121086us
I20260709 13:12:03.024677 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.025477 31272 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.018217 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.034071 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.051434 27836 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:03.035204 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.053565 27835 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:03.053906 27149 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:03.055197 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.055919 27156 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:12:03.058290 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:03.060945 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 70934us
I20260709 13:12:03.062753 31394 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.064196 31299 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:03.064993 31299 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.065368 31394 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.066330 31299 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.068760 31183 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.069342 31183 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.071322 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.072265 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:02.992491 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:03.072938 27839 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:03.073446 31332 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:03.073698 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 81359us
I20260709 13:12:03.074258 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.074431 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.074731 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.074970 27832 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:03.075717 31147 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:03.075814 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.076622 27841 raft_consensus.cc:2376] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11. Re-sending same reply.
I20260709 13:12:03.076690 27837 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:03.073894 31332 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:03.077625 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.078804 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.079279 31147 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:03.079540 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:02.982858 30939 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.082181 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.083029 27835 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:03.063591 27272 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:02.999394 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.084821 27231 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:03.077978 31332 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.075068 31232 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.085587 31233 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:03.086131 31233 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:03.086571 31233 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.091805 31396 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:03.093497 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.095088 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.121927 31216 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:03.122638 31216 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.122758 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.123490 27150 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:03.095266 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.123703 31216 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.124629 27835 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:12:03.125269 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.097244 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.098129 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.126246 27154 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:12:03.098599 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:03.098860 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.098170 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.099437 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.129170 27149 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:03.130245 27156 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:12:03.100174 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.130645 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.071599 31183 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.103621 31257 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:03.111094 31402 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:12:03.134543 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.135717 31353 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:03.135551 31321 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.136313 31353 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.136795 31353 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:03.039183 31206 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:12:03.150214 30939 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.152232 31353 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.153743 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.156198 31180 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.159931 30324 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.160547 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:03.161108 27152 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
W20260709 13:12:03.117468 31350 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.007s
I20260709 13:12:03.119102 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.164527 31232 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.167052 31147 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:03.168620 27300 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:03.120685 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:03.096894 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.131677 31396 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.133836 31257 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.168515 31183 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:03.169889 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.120508 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.171240 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.172078 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.176632 27836 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
W20260709 13:12:03.184958 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53168.1us
I20260709 13:12:03.171060 27305 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:12:03.189160 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.189419 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.190758 31396 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.191226 31396 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.194474 27299 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:03.190656 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.186843 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.197522 27837 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:03.187552 27298 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:03.195930 31183 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:03.205343 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.207696 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.239418 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.243860 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.245725 31206 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:03.246440 31206 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.247049 31206 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.250326 31251 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.251075 31251 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.255213 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.209308 30821 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:03.272564 31353 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.238260 31232 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:03.259228 31180 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.263765 31401 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:03.264318 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.264245 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:03.221518 31257 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:03.185415 31233 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.253895 31251 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.282653 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.283756 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:03.285997 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 165645us
I20260709 13:12:03.292904 27230 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.276678 30821 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.278692 31180 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.278589 31183 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.287485 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:03.289678 27228 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:03.294117 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.286309 31232 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.301167 31232 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.304576 30821 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.306823 31321 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.239473 31220 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:03.256582 31221 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:03.319614 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:03.282006 31257 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.324908 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.209616 30863 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:12:03.312397 31377 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:03.325802 27226 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:03.308141 31180 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.318321 31316 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.344430 27833 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:03.329169 31257 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:03.333457 31377 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:03.316056 31206 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:03.343061 31251 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.364666 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52413.9us
I20260709 13:12:03.329279 31225 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:12:03.368079 31206 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.370419 31183 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.372000 31401 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:03.392320 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.361056 31377 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:03.394934 31405 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:03.407173 31401 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.406947 31251 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.354713 31204 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.445627 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:03.435603 31269 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:12:03.416836 30717 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.451627 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:03.460232 27833 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
W20260709 13:12:03.464824 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56320.3us
I20260709 13:12:03.479992 30324 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:03.455492 30717 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:03.484951 30324 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.461933 30939 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:03.465946 31251 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.459079 31269 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.489112 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.490513 31332 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.495587 31204 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:03.502688 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51163.2us
I20260709 13:12:03.498550 30939 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.498723 30717 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.507422 30324 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.487751 31233 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.508888 31216 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:03.525408 27833 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:03.526449 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:03.527747 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.526127 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.506448 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.540431 31350 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.509347 30939 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.568739 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:03.570806 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 398647us
I20260709 13:12:03.544971 27838 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 4.
I20260709 13:12:03.576485 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.541258 31350 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.586452 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:03.573308 31216 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:03.605286 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.606616 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 121035us
I20260709 13:12:03.607788 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.624729 27230 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:03.625933 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:03.626273 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:03.597548 31216 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:03.600003 31204 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:03.627282 31299 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:03.627607 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:03.626693 27226 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.585891 31180 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.627255 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:03.618453 31269 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.639820 31204 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:03.648782 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:03.644408 27228 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.643158 27224 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.635354 27148 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:03.632406 27227 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:03.652065 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 327694us
W20260709 13:12:03.673539 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 87211.1us
I20260709 13:12:03.674409 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.639739 31233 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:03.636782 31216 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:03.648825 31204 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:03.649482 31299 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.675123 31316 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:03.728063 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.679785 31413 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.736970 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.744560 27837 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:03.739167 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.759675 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:03.760433 27148 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:03.754778 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.762564 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:03.763605 27123 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:03.765985 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 185523us
I20260709 13:12:03.732623 31332 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.735942 31206 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:03.721550 31401 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.779801 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.775104 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.780997 27833 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:03.793850 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.794854 27841 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.799338 27840 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:03.780031 30821 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:03.804101 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:03.777927 31414 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:03.811122 30324 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:03.814939 27835 raft_consensus.cc:2368] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
W20260709 13:12:03.816215 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88807.3us
I20260709 13:12:03.796916 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:03.821900 30324 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:03.822525 30324 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:03.838219 30324 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:03.789327 31206 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:03.800158 31180 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.763401 31377 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:03.859117 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57488.4us
W20260709 13:12:03.863085 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 82111.6us
I20260709 13:12:03.864148 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:03.866441 31414 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:03.884047 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:03.883062 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:03.889966 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 114927us
I20260709 13:12:03.892616 27841 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:03.855131 31350 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:03.899044 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:03.868722 31147 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:03.891094 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.905689 27227 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:12:03.891862 31409 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:12:03.885506 31321 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:03.882079 31424 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.853928 31417 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:03.919581 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.927238 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:03.930449 31420 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:12:03.932605 31412 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
W20260709 13:12:03.930665 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69241.8us
W20260709 13:12:03.918551 31411 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:12:03.898949 31423 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:03.916654 31332 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:03.858547 31299 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.940039 31206 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.940670 31225 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.936164 31408 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:12:03.952039 31377 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.937052 31430 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:03.955981 31396 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.003s
W20260709 13:12:03.956790 31183 consensus_meta.cc:287] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.002s
I20260709 13:12:03.937515 31220 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:03.916779 31109 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:03.966207 31401 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.988760 27300 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:03.992848 31257 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.002s
I20260709 13:12:03.992554 31109 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.993319 31257 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.995085 31109 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:03.995522 31257 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.965935 31225 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:03.996977 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3033) took 1043 ms. Trace:
I20260709 13:12:03.997351 27223 rpcz_store.cc:276] 0709 13:12:02.953423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.033261 (+ 79838us) service_pool.cc:224] Handling call
0709 13:12:03.033919 (+   658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:03.038502 (+  4583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.038534 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:03.039952 (+  1418us) log.cc:844] Serialized 598 byte log entry
0709 13:12:03.320144 (+280192us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:03.320188 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.320255 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.996724 (+676469us) raft_consensus.cc:1685] finished
0709 13:12:03.996747 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.996914 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3754,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":279783,"threads_started":1,"wal-append.queue_time_us":563185}
I20260709 13:12:03.983384 31396 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:03.969990 31425 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:03.939329 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:03.960615 27226 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:03.946676 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:03.965126 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45654.8us
W20260709 13:12:04.000577 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61355.7us
W20260709 13:12:03.976636 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88792.7us
I20260709 13:12:03.969415 27224 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:03.918641 31321 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.938277 31423 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.003520 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:03.985140 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:04.000023 27231 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:04.001312 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:03.971410 31430 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.975942 27228 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:04.004266 27225 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:04.000173 31377 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.929215 31424 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.012457 31396 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:03.989897 31220 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.026752 31183 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.027328 31435 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:04.003376 31233 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:04.006493 31321 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.062873 30324 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.042332 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:04.068431 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 157685us
W20260709 13:12:04.066988 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61015.1us
W20260709 13:12:04.067473 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 82410.2us
W20260709 13:12:04.068657 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67642.4us
I20260709 13:12:04.077566 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:04.081019 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.082067 27156 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:04.061138 30717 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:12:04.041617 31332 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.086333 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:04.013219 31430 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:04.087345 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 140802us
I20260709 13:12:04.069938 31180 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.029628 31216 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.091986 30324 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:04.091852 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49666.6us
I20260709 13:12:04.092622 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.090391 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.062230 31225 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.101224 27156 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.095245 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:04.099361 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.073598 31422 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:04.091145 27197 connection.cc:256] RPC call timeout handler was delayed by -1.0428523299999597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:12:04.102789 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.043159 31377 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.102597 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:04.112557 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.101265 27157 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.102810 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.113806 27300 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:04.112314 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.111836 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.086164 31350 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.119802 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.087189 31233 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.118319 30324 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:04.097687 31427 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.118045 27272 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:04.124191 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.124881 30324 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.118412 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.121291 27305 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:04.102484 31316 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:04.130232 31316 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:04.130744 31316 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.130563 30324 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.133008 31332 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:04.134356 31417 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.134398 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.135517 31401 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.135891 31220 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.137879 31216 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.136148 31401 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.127801 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.142707 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.118257 31423 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.123395 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:04.114712 31422 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:04.123927 31441 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:04.115183 31425 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:04.090512 30717 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.122113 31439 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.155195 31438 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:04.155721 31433 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:04.124010 31434 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.199422 27297 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:04.198256 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:04.205199 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61716.5us
I20260709 13:12:04.122512 31414 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:04.202953 27804 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.510s (SENT)
W20260709 13:12:04.195170 31421 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.306s	user 0.003s	sys 0.000s
I20260709 13:12:04.211498 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.212153 31299 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:04.212850 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.235021 27156 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
W20260709 13:12:04.237322 31419 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.426s	user 0.002s	sys 0.000s
I20260709 13:12:04.242643 27157 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:04.247336 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.233706 31183 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:04.276787 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 73888.6us
W20260709 13:12:04.252599 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.158478 31435 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:04.288166 27841 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:04.271672 31454 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:04.271608 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 128978us
I20260709 13:12:04.281072 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.289595 27839 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:12:04.291815 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 174041us
I20260709 13:12:04.297088 31425 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.274462 31434 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.298003 27834 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:04.298460 31434 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.299427 31433 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.300443 31433 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.301450 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.298544 27298 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:04.288719 27841 pending_rounds.cc:85] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 8
I20260709 13:12:04.125439 31350 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.258458 31439 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.259526 31423 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:04.304689 31180 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:04.305469 27841 pending_rounds.cc:107] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:04.313990 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.322744 27841 raft_consensus.cc:2889] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:04.313993 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 211262us
I20260709 13:12:04.215530 31422 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.275286 31414 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.257822 31441 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:04.276480 31251 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.215094 31204 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.328482 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.331570 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:04.331575 27228 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:04.306615 31147 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:04.288635 31435 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:04.291502 31454 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.343720 27231 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:04.345130 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:04.343150 31414 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.358286 27300 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:04.359939 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 220055us
I20260709 13:12:04.371754 27225 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.371847 27300 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:04.310671 31427 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:04.313313 31410 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.331374 31180 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.319000 31439 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:04.332995 30939 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.002s
I20260709 13:12:04.374204 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.374836 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.375689 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:04.382465 27229 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:04.388125 27303 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:04.362566 31147 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:04.298194 31425 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:04.375958 31435 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.441018 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.417200 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.389622 27300 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.443449 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.420109 27298 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.410666 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.437243 27231 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:04.418514 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.419691 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.447623 27149 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.419999 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.418663 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.448719 27156 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:04.420660 27151 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:04.399785 27195 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:04.450285 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50607.9us
I20260709 13:12:04.387257 31180 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.459965 27157 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:04.461261 27225 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:04.465371 27154 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:04.377004 31454 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.358682 31441 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.469551 27300 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.470999 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:04.414577 31449 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:12:04.473311 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75378.2us
I20260709 13:12:04.475576 27301 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.475941 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.402141 31109 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:04.479835 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 93533.2us
I20260709 13:12:04.398012 31424 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.443876 31251 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:04.472707 31413 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.003s
W20260709 13:12:04.488112 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 186739us
I20260709 13:12:04.323832 31233 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.466552 31257 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:04.494925 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 143648us
I20260709 13:12:04.391603 30939 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.433676 31316 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.505352 27298 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:04.405169 31430 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.391291 31410 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.428169 31422 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.489809 31377 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.492774 31109 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:04.434127 31434 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.496737 31413 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:04.484082 31183 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:12:04.358831 30821 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:04.467161 31450 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:12:04.516408 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.517614 27305 raft_consensus.cc:2368] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:04.509311 31441 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.507323 31257 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:04.504071 31423 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:12:04.498034 31438 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:12:04.534557 27837 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:04.535809 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.536764 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.537496 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.544610 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.545526 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.546418 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.506388 31444 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:04.540297 27153 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.508808 31299 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:12:04.510381 31332 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:12:04.549820 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.558768 27299 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:04.558657 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.552000 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.559846 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.562211 27297 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:04.542347 31416 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.515966 31451 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:12:04.563446 27832 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:04.575002 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.576385 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.577085 27297 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:04.514477 31147 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.542186 31433 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:12:04.565264 31204 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.546705 31353 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:04.586251 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.588034 31460 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.589303 31410 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.589627 31422 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:04.591825 31458 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:12:04.593928 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.578455 31377 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.597172 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.598445 27298 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:12:04.603402 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 162487us
I20260709 13:12:04.605398 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:04.606844 27835 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:04.608079 27832 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:04.610035 27832 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:04.596755 31427 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:04.633589 27804 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.968s (SENT) [suppressed 40 similar messages]
I20260709 13:12:04.646662 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.647475 27298 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.611093 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.611680 30939 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.586422 31109 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.648921 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.598403 31460 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:04.650139 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.650377 31460 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.651202 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.652230 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.586300 31424 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:12:04.614730 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.615527 31316 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.616171 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.617034 27302 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:04.655242 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.579213 31451 consensus_queue.cc:1243] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:04.618155 31401 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.618889 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.656365 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.657191 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.657473 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.621196 31430 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:04.621578 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.578516 31257 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.658741 31451 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:04.659215 31451 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.659618 31451 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.622718 31425 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:04.622946 31377 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:04.618165 31459 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:04.576957 31416 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.624357 27153 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:12:04.625183 31321 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.001s
I20260709 13:12:04.591846 31418 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:04.663309 31418 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:04.663288 31321 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.664521 31418 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.666002 31418 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.666627 31377 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:04.665858 31321 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.668061 27151 raft_consensus.cc:2368] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:04.626269 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:04.610519 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 114867us
I20260709 13:12:04.664525 31416 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:04.670584 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.631721 27148 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:04.671396 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.580015 31350 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.631961 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.602205 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.642594 27300 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:04.658038 27838 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:12:04.677644 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45743.8us
I20260709 13:12:04.678493 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.660936 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.673625 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.682426 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:04.683743 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57559.4us
I20260709 13:12:04.675621 27832 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.687178 27832 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.692890 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.643676 31427 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:04.685114 31350 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.677917 31401 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.700625 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.700661 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.706663 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:04.685520 31220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:12:04.688963 31377 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.711984 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.713152 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.670301 31451 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.717387 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:04.688791 31422 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.690650 31221 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.642256 31180 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.691519 31430 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:04.695407 31321 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:04.670171 31460 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.728091 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.739179 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:04.756152 27227 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.742749 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:04.757091 27228 raft_consensus.cc:2368] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:04.726388 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.742357 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.741897 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.771885 27298 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
W20260709 13:12:04.781339 27807 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.728s (SENT)
I20260709 13:12:04.782136 27807 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.794442 27149 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:04.796814 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.800134 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.803824 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.804657 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.805325 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.809224 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.812808 27232 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.743131 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.751844 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.813951 27224 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:04.814313 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.814862 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:04.815537 27302 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:04.815946 27297 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 7: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:04.817260 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:04.820533 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:04.821398 27229 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:04.812371 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.753997 31457 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:04.770254 31430 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:04.824699 27156 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:04.727528 31401 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.833031 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.834882 27298 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:04.835929 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:04.831285 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:04.824648 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 191084us
W20260709 13:12:04.848112 27804 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.676s (SENT)
I20260709 13:12:04.848706 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:04.828805 31417 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.000s
I20260709 13:12:04.848999 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.850158 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.851018 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.851233 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:04.851890 27835 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:04.853188 27227 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:04.853806 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.736958 31414 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.875411 31147 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:04.854911 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.876364 27156 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:04.877441 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.878618 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.855566 31466 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:04.857090 31460 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.861287 31461 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:12:04.733551 31427 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.881734 31427 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.863122 27835 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:04.863770 31451 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.871721 31439 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.853354 31417 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.873498 30717 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.862118 31463 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.835489 31401 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.849527 31416 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:04.888105 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.889026 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.899699 27156 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:04.894351 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 46269.9us
W20260709 13:12:04.901081 27804 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.706s (SENT)
I20260709 13:12:04.904383 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.877959 31414 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.908819 27841 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:04.908278 27152 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:04.909567 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.889673 31422 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:04.910979 27804 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.728s (SENT)
I20260709 13:12:04.897106 31401 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.898644 31416 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.916887 27807 leader_election.cc:400] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:04.918284 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.919220 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:04.923938 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.925607 31484 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.929759 27804 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.946s (SENT)
I20260709 13:12:04.932077 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.935588 31434 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.935758 31251 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:04.936143 31251 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:04.936862 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.937631 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.938434 31180 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:04.917394 31416 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.943217 31474 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:04.943629 31474 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:04.944581 31474 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.949097 31463 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.950381 31484 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.950930 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:04.951589 27155 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:04.953058 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:04.937045 31251 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:04.930565 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:04.964411 27832 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:12:04.965744 27832 pending_rounds.cc:85] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:12:04.966208 27832 pending_rounds.cc:107] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:04.966605 27832 raft_consensus.cc:2889] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:04.962991 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:04.974910 31454 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.976275 27836 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:04.977466 31454 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:04.945931 31474 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:04.986851 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57114.4us
I20260709 13:12:04.989138 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.930824 31466 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:04.992130 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.993160 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:04.994241 31466 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:04.997931 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:04.998780 27841 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:12:05.006138 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.006922 27148 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:05.010308 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:05.010777 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:05.012001 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.017764 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:04.985100 31454 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:05.019266 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 88752us
I20260709 13:12:04.985865 31204 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:05.024132 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:04.979439 31233 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:12:05.001199 31414 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:04.994243 31451 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.039918 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.043274 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:05.044127 31464 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
I20260709 13:12:05.045112 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:05.046442 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.048677 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.049944 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.050760 27148 raft_consensus.cc:2368] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:05.051684 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.052757 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:05.053329 27148 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.054847 31434 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.053747 31401 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.061158 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2043) took 1124 ms. Trace:
I20260709 13:12:05.061542 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.062673 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.063757 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.063875 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.064725 31439 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:05.064913 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.065932 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2047) took 1074 ms. Trace:
I20260709 13:12:05.066469 27151 raft_consensus.cc:2368] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:05.067291 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.069357 27151 raft_consensus.cc:2368] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:05.065030 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.068550 27155 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:05.063540 31401 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:05.066385 27301 rpcz_store.cc:276] 0709 13:12:03.991635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.991775 (+   140us) service_pool.cc:224] Handling call
0709 13:12:03.996400 (+  4625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.478823 (+482423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.065681 (+586858us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54001ca7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:05.065862 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101417728}
I20260709 13:12:05.072527 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.061594 27303 rpcz_store.cc:276] 0709 13:12:03.936698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.936881 (+   183us) service_pool.cc:224] Handling call
0709 13:12:03.940167 (+  3286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.389260 (+449093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.060913 (+671653us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400057dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:05.061093 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022864640}
I20260709 13:12:05.078105 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:05.078868 27151 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:05.082219 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61556us
I20260709 13:12:05.084288 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.086258 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.087713 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.082480 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.015307 31418 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:12:05.098753 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:05.099655 27155 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:05.100165 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.100705 27148 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:05.092995 27154 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:12:05.009163 31465 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:12:05.040733 31487 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:05.104650 27154 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:05.117678 27154 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:12:05.118295 27154 pending_rounds.cc:85] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 5
I20260709 13:12:05.118897 27154 pending_rounds.cc:107] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:05.119302 27154 raft_consensus.cc:2889] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.127369 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.106374 27155 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:05.041414 31204 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:05.107507 31434 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.107932 27150 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:05.108786 31484 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:05.077335 31414 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.109572 30717 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Committing config change with OpId 7.7: config changed from index 3 to 7, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:05.024649 31460 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:05.154038 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2488) took 1026 ms. Trace:
I20260709 13:12:05.154668 27152 rpcz_store.cc:276] 0709 13:12:04.127395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.133936 (+  6541us) service_pool.cc:224] Handling call
0709 13:12:04.138271 (+  4335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:04.909766 (+771495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.153678 (+243912us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:05.153947 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770343168}
I20260709 13:12:05.105427 27151 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.133476 27154 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:05.157966 31413 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:05.158587 31413 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.156985 27154 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.159664 31413 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.162583 27151 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:05.136842 27150 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:05.166747 31491 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:12:05.167301 27150 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.167768 31414 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.169113 27150 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.115820 31439 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:05.170358 31439 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.114992 31487 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:05.176117 31441 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:12:05.176301 31487 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.176815 31441 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:05.142829 31435 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.001s
I20260709 13:12:05.170851 31439 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:05.160183 27154 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:05.103858 31454 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:05.144522 31486 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:12:05.184218 27152 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:05.153404 31416 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:05.188056 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.186849 27151 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:05.184262 31417 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:05.207806 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 80540.4us
I20260709 13:12:05.209311 27232 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.210652 27804 leader_election.cc:400] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:05.210992 27804 leader_election.cc:403] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.212034 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.210695 27229 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:05.221475 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.232458 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:05.233361 27225 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:05.238018 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.234710 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.238339 27150 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:05.239014 27836 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.236104 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:05.212208 27228 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:05.244024 27806 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.241278 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:05.207258 31413 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.247709 31396 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:12:05.263316 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.170766 31204 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:05.265069 27841 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:05.266999 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.268127 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.264545 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.187939 31435 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.275741 27806 leader_election.cc:400] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
W20260709 13:12:05.277969 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 47527us
I20260709 13:12:05.279569 27838 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:05.235445 31454 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:05.288224 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.289417 27840 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:05.244664 31481 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:05.279212 27806 leader_election.cc:403] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:12:05.274848 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 62879.6us
I20260709 13:12:05.342898 27804 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:05.344460 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 68865.7us
W20260709 13:12:05.344724 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 108751us
I20260709 13:12:05.269160 31460 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:05.323370 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.348419 27834 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.348670 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:05.296147 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:05.350943 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.351938 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.357554 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.352530 27836 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:05.266465 31487 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.267690 31424 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:05.362942 27297 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:05.363381 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75211us
I20260709 13:12:05.364059 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.234611 31417 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.367630 27841 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:12:05.281852 31441 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.371322 27838 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:05.371806 27225 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:05.371320 27841 pending_rounds.cc:85] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:12:05.372537 27841 pending_rounds.cc:107] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:05.372844 27841 raft_consensus.cc:2889] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.372960 27837 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:05.376777 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.378223 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.379031 27306 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:05.380393 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.384927 27839 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:12:05.386807 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 229467us
I20260709 13:12:05.355926 31466 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:05.282614 31414 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
W20260709 13:12:05.391247 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48507us
I20260709 13:12:05.396802 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:05.368043 31422 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.405596 27804 leader_election.cc:400] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:05.405923 27804 leader_election.cc:403] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.377789 30863 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.382437 31269 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.423602 27225 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:05.424896 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 79203.1us
W20260709 13:12:05.425616 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 159950us
W20260709 13:12:05.426916 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46602.6us
I20260709 13:12:05.356056 31481 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.438763 27223 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:05.438866 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:05.439245 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:05.448550 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.468317 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.388803 31299 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:05.471233 27807 leader_election.cc:336] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.400s (SENT)
I20260709 13:12:05.471932 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.476910 27227 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:05.426397 31460 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.419373 27303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:05.488230 31471 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.496562 27303 raft_consensus.cc:606] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.388273 31457 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:12:05.491470 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.434007 31269 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:05.438139 31446 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:05.501125 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 62361us
I20260709 13:12:05.388031 31444 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:12:05.406137 31233 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:12:05.463371 31377 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.489923 31454 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:05.492450 31473 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:05.476600 31484 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.498399 31466 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.523819 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.531903 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:05.532011 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 96358.7us
I20260709 13:12:05.503063 31269 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.495354 31206 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:05.504577 31424 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.510746 31299 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:05.540026 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 99457.4us
I20260709 13:12:05.494237 31503 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:12:05.543541 27197 leader_election.cc:400] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
I20260709 13:12:05.528976 31416 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:05.548543 27197 leader_election.cc:403] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.528653 31484 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:05.556176 27228 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:12:05.557004 31496 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:12:05.558634 31490 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:12:05.534693 31446 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:05.553759 31493 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:12:05.586589 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 118663us
W20260709 13:12:05.594436 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51114.9us
W20260709 13:12:05.556478 31495 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:12:05.599114 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.554478 31498 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.567888 31484 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:05.602486 31509 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:12:05.604274 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.605057 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.606634 31454 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:05.608783 27840 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:05.542222 31220 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:12:05.618943 31488 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:05.596087 31449 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:05.610358 31511 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:12:05.572619 31435 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:05.633999 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.632452 31498 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:05.641448 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 43496.6us
I20260709 13:12:05.611099 31257 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
I20260709 13:12:05.640877 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:05.645874 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59755.3us
I20260709 13:12:05.619577 31507 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:12:05.647877 31497 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:12:05.643625 31460 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:05.652618 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:05.677364 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2486) took 1587 ms. Trace:
I20260709 13:12:05.677722 27836 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:05.677811 27153 rpcz_store.cc:276] 0709 13:12:04.090224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.091724 (+  1500us) service_pool.cc:224] Handling call
0709 13:12:05.677184 (+1585460us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:05.677304 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970730880}
I20260709 13:12:05.639242 31487 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:05.625186 31416 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:12:05.687146 31460 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.688704 31510 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:05.690420 31251 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.691982 31463 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:05.692407 31463 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:05.693286 31434 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.002s
I20260709 13:12:05.695452 31441 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:05.695789 31147 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.002s
I20260709 13:12:05.695911 31441 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:05.696480 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.696936 31481 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:05.698582 31233 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:05.693815 31434 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.699697 31233 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:05.700093 31233 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:05.700172 27833 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.701027 31233 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:05.702896 31418 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:05.703276 31418 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.704169 31418 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:05.704778 31474 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.714s	user 0.001s	sys 0.009s
I20260709 13:12:05.705435 31418 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.667704 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:05.654963 31500 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:05.672775 31503 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:12:05.686964 31494 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:12:05.710333 27833 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:05.663645 31417 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:05.715672 27306 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:05.623421 31466 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:12:05.718459 27305 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
W20260709 13:12:05.720276 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 107184us
I20260709 13:12:05.696869 31441 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.736097 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:05.737079 27232 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:05.741159 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73573.4us
I20260709 13:12:05.638654 31424 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:05.741786 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:05.742762 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 101969us
W20260709 13:12:05.719852 31427 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.000s
W20260709 13:12:05.748939 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.742772 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.745944 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.750034 31435 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:05.750898 31435 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:05.752144 31435 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.693369 31463 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.719743 31423 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.755342 27149 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
W20260709 13:12:05.779724 27807 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.706s (SENT)
I20260709 13:12:05.748824 31416 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:12:05.761612 31437 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.762661 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:05.764850 31221 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:05.782569 31460 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:05.790511 31413 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
W20260709 13:12:05.794117 31439 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 13:12:05.794529 31439 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.742827 31251 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.767566 31206 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:05.762686 31457 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:12:05.754452 31451 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:12:05.755916 31425 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:12:05.811142 27832 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:05.758239 31463 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.781116 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.740962 31510 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.795795 31446 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:05.783457 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:05.828320 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44995.3us
I20260709 13:12:05.829427 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.785612 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:05.812096 27835 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:05.779595 31233 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.781661 27232 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:05.671761 31299 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.801769 31511 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:05.800190 31206 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:05.833022 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.833643 27836 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.825156 31460 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:05.845665 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 81152.4us
I20260709 13:12:05.827183 31441 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.848950 27154 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.832587 31221 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:12:05.850617 31516 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.855921 31269 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.856256 31206 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.871346 31439 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:05.871858 31206 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:05.859400 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 73859us
I20260709 13:12:05.864840 31251 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:05.882684 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:05.883713 27153 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:05.863653 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.845479 31507 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.832350 31433 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:12:05.879549 27157 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.890625 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 901) took 1266 ms. Trace:
I20260709 13:12:05.862414 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.886298 27155 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:05.870514 31511 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:05.880412 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:05.888504 27153 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:05.892311 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:05.896122 27156 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:05.865752 31446 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.865317 31221 consensus_queue.cc:1243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:05.890942 27157 rpcz_store.cc:276] 0709 13:12:04.624227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.073506 (+449279us) service_pool.cc:224] Handling call
0709 13:12:05.073836 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.879375 (+805539us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54001827a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:12:05.890327 (+ 10952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.890561 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93473152}
I20260709 13:12:05.900398 27297 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:05.902354 27298 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:05.902676 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:05.904276 27301 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:05.906559 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:05.865103 31510 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:05.890483 31450 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:05.912758 27300 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:05.896286 31516 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.893525 31251 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:05.898605 31396 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.911665 27227 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:05.912758 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:05.909454 31515 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:12:05.933557 27836 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:05.937539 27224 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:05.912832 31423 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:05.915364 31450 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:05.950758 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:05.952600 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:05.960698 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:05.961357 27226 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.961558 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:05.919545 31425 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:05.965700 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:05.919348 31507 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:05.962184 27228 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:12:05.969501 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71200.1us
I20260709 13:12:05.979698 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:05.986636 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:05.987424 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.987552 27224 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:05.991443 31514 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:06.002331 31450 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.003854 31450 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:05.962015 31515 consensus_queue.cc:1243] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:05.962571 31424 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:06.006660 31424 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.009068 31424 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:06.009809 31482 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
I20260709 13:12:05.994115 31520 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:12:06.010947 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:06.033799 27299 raft_consensus.cc:2393] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:05.972427 31425 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.012102 31487 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:05.973307 31511 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:05.972841 31423 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:06.014618 31269 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.016467 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:05.997336 31251 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.018896 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.017609 27832 pending_rounds.cc:85] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 7
I20260709 13:12:06.097111 27836 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:06.097404 27832 pending_rounds.cc:107] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:06.097872 27832 raft_consensus.cc:2889] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:06.022055 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51fed810b66a4d09868add1d38749c15"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:06.098708 27302 raft_consensus.cc:606] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:06.099172 27302 raft_consensus.cc:614] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:06.026137 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.028015 27226 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
W20260709 13:12:06.045719 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.046206 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.048197 27154 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:06.070261 31484 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.071419 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:06.106173 31438 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:12:06.107306 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.108234 27224 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.112198 27232 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:06.113968 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:06.075714 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.077299 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.080202 31416 raft_consensus.cc:993] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:06.080695 31425 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.039664 31487 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:06.001820 31439 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.002429 31180 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:06.095860 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:06.103655 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3063) took 1173 ms. Trace:
I20260709 13:12:06.115132 27227 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:06.116870 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.115602 27230 raft_consensus.cc:2376] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8. Re-sending same reply.
I20260709 13:12:06.126327 27154 rpcz_store.cc:276] 0709 13:12:04.930634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.132900 (+202266us) service_pool.cc:224] Handling call
0709 13:12:05.133279 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.848524 (+715245us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b580069d7d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51c930aa 00007f9a51d15447 00007f9a51d2dfe7 00007f9a51d2f7de 00007f9a51d39b49 00007f9a51d3a416 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4
0709 13:12:06.103270 (+254746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.103578 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097213312}
I20260709 13:12:06.128141 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.128777 27225 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.130656 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:06.131938 27232 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:06.134367 27231 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 5: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:06.127560 31505 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.170858 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:06.118453 31316 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:06.127777 31180 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:06.174940 27227 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:06.141031 31416 raft_consensus.cc:1081] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
W20260709 13:12:06.166240 31377 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.006s
I20260709 13:12:06.178188 27305 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:06.140440 31446 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:06.178334 31516 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.181438 31423 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:06.197484 31528 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:12:06.179601 31505 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.181908 31514 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:06.189929 31377 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12.
I20260709 13:12:06.193161 31446 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:06.188894 31433 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:12:06.183907 31316 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.228669 27225 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:06.243202 31316 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.243640 31498 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:06.244129 31498 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:06.248076 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1589) took 1010 ms. Trace:
I20260709 13:12:06.248499 27837 rpcz_store.cc:276] 0709 13:12:05.237426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.237606 (+   180us) service_pool.cc:224] Handling call
0709 13:12:05.237928 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.373324 (+135396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.247813 (+874489us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540059fe54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:06.248010 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309726592}
I20260709 13:12:06.250259 31484 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.255367 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.257229 31505 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:06.249976 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:06.261649 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:06.194626 31487 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.272215 27841 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:06.277207 27154 raft_consensus.cc:1217] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:12:06.277809 27154 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:06.279747 31537 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:06.280632 31537 consensus_queue.cc:1243] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:06.284602 27838 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.289359 31506 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:06.289793 31506 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:06.290994 31506 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.292446 31506 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:06.239154 31180 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:06.318885 27149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 924) took 1689 ms (client timeout 2150 ms). Trace:
W20260709 13:12:06.319554 27149 rpcz_store.cc:269] 0709 13:12:04.629823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.887916 (+258093us) service_pool.cc:224] Handling call
0709 13:12:06.318633 (+1430717us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54000dff54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:06.318787 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968508160}
I20260709 13:12:06.330430 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1599) took 1086 ms. Trace:
I20260709 13:12:06.330988 27833 rpcz_store.cc:276] 0709 13:12:05.243456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.268657 (+ 25201us) service_pool.cc:224] Handling call
0709 13:12:06.330203 (+1061546us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540051ead4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:06.330325 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788398976}
I20260709 13:12:06.339867 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1193) took 1956 ms. Trace:
I20260709 13:12:06.340394 27834 rpcz_store.cc:276] 0709 13:12:04.383579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.383732 (+   153us) service_pool.cc:224] Handling call
0709 13:12:04.400296 (+ 16564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.362657 (+962361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.339575 (+976918us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b5400342954. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:06.339792 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179926912}
I20260709 13:12:06.344147 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:06.350916 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:06.354351 27297 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:12:06.360533 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.364038 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.367105 31418 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:06.369601 31519 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.570s	user 0.000s	sys 0.004s
I20260709 13:12:06.370406 27297 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:06.371325 31316 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:06.362238 31505 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:06.375491 31505 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:06.375936 31505 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:06.377082 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.269091 31446 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:06.384456 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.399730 27838 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:06.394990 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:06.391168 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:06.403582 27149 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:06.412070 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.413383 27149 raft_consensus.cc:2410] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:06.424482 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.426383 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.433679 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:06.436436 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.437089 27155 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:06.438884 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 308296us
I20260709 13:12:06.428455 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:06.485297 27157 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
W20260709 13:12:06.486980 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46035.1us
I20260709 13:12:06.489862 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:06.526288 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.540604 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 150514us
W20260709 13:12:06.541664 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51920.1us
W20260709 13:12:06.487614 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74554.1us
I20260709 13:12:06.389647 31451 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.560254 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:06.415244 31425 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:06.395663 31501 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.169s
I20260709 13:12:06.412360 31422 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 13:12:06.393569 31299 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:12:06.412228 31377 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.157s
I20260709 13:12:06.586195 30821 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:06.586719 30821 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:06.557142 31469 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:06.587775 30821 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.589694 30821 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.584662 27231 raft_consensus.cc:1217] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:12:06.590777 27231 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:06.580986 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:06.593612 31441 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:06.594101 31441 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:06.594527 31441 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:06.595038 31511 consensus_queue.cc:1175] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1010256288ec4502b330749e2e3d7c85" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:12:06.552307 31251 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:12:06.567688 31451 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.604952 31451 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:06.570523 31516 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:06.575909 31233 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:12:06.593166 31424 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:06.641099 27223 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:06.641088 27155 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:06.678867 27224 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:12:06.683332 27223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:12:06.684260 27223 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.684731 27223 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.722369 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:06.690450 31516 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.669907 31424 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.707958 31451 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:06.793980 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.818432 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.815300 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 255140us
I20260709 13:12:06.823527 27155 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:12:06.815111 31541 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:12:06.831110 27227 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:06.843298 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:06.814670 31451 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:06.832520 27223 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.850838 27232 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:06.852169 27223 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:06.854523 27223 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:06.856487 31507 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:06.857241 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.858198 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:06.858855 27155 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.869444 27155 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:06.873257 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:06.734913 31516 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:06.826771 31418 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:06.911115 27120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.026s	sys 0.005s
I20260709 13:12:06.828094 31550 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:06.890398 31535 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:12:06.926823 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53644.4us
I20260709 13:12:07.103725 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:06.921034 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:07.071673 31556 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.924613 31439 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:06.992452 27122 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.022s	sys 0.029s
W20260709 13:12:06.962736 31506 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.670s	user 0.016s	sys 0.000s
W20260709 13:12:06.960731 31529 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.841s	user 0.005s	sys 0.006s
I20260709 13:12:07.113413 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:06.967566 31450 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.958974 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1614) took 1008 ms. Trace:
W20260709 13:12:06.977890 31538 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:12:06.915406 31481 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:06.943027 31542 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:12:06.965807 31505 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260709 13:12:06.962845 31516 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:06.929876 31451 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.971246 31424 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:06.951231 27227 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:07.130643 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:07.130702 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.131441 27225 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:06.976734 31438 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.048431 31510 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.055941 27838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1204) took 1451 ms (client timeout 1593 ms). Trace:
W20260709 13:12:07.133201 27839 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.005s
W20260709 13:12:07.133888 27839 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.005s	sys 0.005s
W20260709 13:12:07.059404 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.067682 31543 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.324s	user 0.004s	sys 0.000s
I20260709 13:12:07.069749 31554 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:06.977533 31418 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.075873 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:07.085554 31180 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:07.096274 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.937300 27120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.027s	sys 0.005s
W20260709 13:12:06.899016 31517 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:12:07.110579 27122 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.025s	sys 0.030s
I20260709 13:12:07.124504 31506 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.953665 27836 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:07.115618 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:07.114295 27832 rpcz_store.cc:276] 0709 13:12:05.950694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.017045 (+ 66351us) service_pool.cc:224] Handling call
0709 13:12:06.017375 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:06.137130 (+119755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.137162 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:06.141884 (+  4722us) log.cc:844] Serialized 52 byte log entry
0709 13:12:06.551989 (+410105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:06.552058 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.552160 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.958631 (+406471us) raft_consensus.cc:1685] finished
0709 13:12:06.958666 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.958885 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":544,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":22950,"thread_start_us":357729,"threads_started":1,"wal-append.queue_time_us":641730}
I20260709 13:12:07.128182 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:07.132664 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 410887us
W20260709 13:12:07.133148 27838 rpcz_store.cc:269] 0709 13:12:05.604153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.604784 (+   631us) service_pool.cc:224] Handling call
0709 13:12:07.055680 (+1450896us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b540076d254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:07.055857 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526946560}
I20260709 13:12:07.124979 30863 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.125914 31454 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:07.132261 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1616) took 1113 ms. Trace:
I20260709 13:12:07.199230 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.239866 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:07.243326 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.243363 31503 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.244144 31503 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.244948 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:07.246367 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:07.247550 31503 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:07.250905 27155 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:12:07.251415 27155 pending_rounds.cc:85] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 3
I20260709 13:12:07.251680 27155 pending_rounds.cc:107] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:07.251959 27155 raft_consensus.cc:2889] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.252319 27155 pending_rounds.cc:107] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:07.252594 27155 raft_consensus.cc:2889] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:07.254772 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 867102us
W20260709 13:12:07.258698 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.166100 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:07.261188 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 95246.4us
I20260709 13:12:07.241336 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.265805 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:07.274907 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.127094 31481 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:07.124461 31450 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:12:07.313474 27302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.020s
W20260709 13:12:07.313866 27302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.010s	sys 0.020s
W20260709 13:12:07.313802 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 198254us
I20260709 13:12:07.314436 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:07.315001 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.315486 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.317003 27229 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.317880 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:07.318572 27154 raft_consensus.cc:1217] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:12:07.119140 31439 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.319128 27154 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:12:07.322922 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 57213.8us
I20260709 13:12:07.240628 27840 rpcz_store.cc:276] 0709 13:12:06.019255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.274276 (+255021us) service_pool.cc:224] Handling call
0709 13:12:06.274661 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.275059 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.275093 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.275615 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.701206 (+425591us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:07.107919 (+406713us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.131942 (+ 24023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.132025 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.132069 (+    44us) raft_consensus.cc:1685] finished
0709 13:12:07.132081 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.132204 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23534,"raft.queue_time_us":24915,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":10162,"thread_start_us":803158,"threads_started":2,"wal-append.queue_time_us":644281}
I20260709 13:12:07.327708 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:07.346894 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:07.351620 27155 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:07.352252 27225 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 13:12:07.129519 31505 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:07.354943 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 279185us
I20260709 13:12:07.347740 27156 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:12:07.323062 30821 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.003s
I20260709 13:12:07.311053 31451 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.316992 31507 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:07.317746 31529 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:12:07.361326 27148 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 13:12:07.249801 31560 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.240468 31454 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:07.359582 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:07.385456 27306 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:07.385793 27306 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:07.348999 31446 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:07.369351 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:07.345844 31543 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:12:07.347625 31514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.023s	sys 0.048s
I20260709 13:12:07.318929 31556 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.376969 27303 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:07.311383 31555 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.325040 31553 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.116497 31550 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:07.384598 31441 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.788s	user 0.014s	sys 0.000s
I20260709 13:12:07.365132 31544 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:07.143067 31510 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.143641 31438 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.424319 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:07.425396 27148 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:12:07.318702 31506 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.386617 27306 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.479034 27306 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.480047 31506 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.480630 31506 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.316735 30863 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.483350 30863 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.480495 31377 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:07.486299 31556 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.486577 31377 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:07.486905 31556 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.487623 31377 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.497562 31561 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.498286 31561 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.499475 27231 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.500494 31561 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.502813 31567 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.503774 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.389725 31454 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.379081 31507 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.431353 31316 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:07.436368 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 909) took 1532 ms. Trace:
I20260709 13:12:07.441202 31550 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.396927 31511 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.512183 27156 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:07.513236 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:07.509863 27839 rpcz_store.cc:276] 0709 13:12:05.903833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.004851 (+101018us) service_pool.cc:224] Handling call
0709 13:12:06.005223 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.171159 (+165936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.171193 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.184910 (+ 13717us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.571304 (+386394us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:07.134447 (+563143us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.134738 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.435839 (+301101us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54005e6854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:07.435904 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.435963 (+    59us) raft_consensus.cc:1685] finished
0709 13:12:07.436077 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.436288 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":776529,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":35568,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":75794,"spinlock_wait_cycles":316890368,"thread_start_us":852209,"threads_started":2,"wal-append.queue_time_us":534718}
I20260709 13:12:07.445117 27837 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [5.7-11.10]
I20260709 13:12:07.447099 31450 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:07.450387 31299 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.454188 31505 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.456064 31510 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:07.457067 31557 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:12:07.458717 31206 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.461536 30717 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.535768 30717 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:07.536674 30717 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.389940 31560 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:07.463152 31551 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:12:07.463617 31516 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.511371 31507 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:07.413138 31441 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.464788 31269 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.413334 31553 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.465399 27228 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:07.600733 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 918) took 1619 ms. Trace:
I20260709 13:12:07.601090 27228 rpcz_store.cc:276] 0709 13:12:05.981186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.981342 (+   156us) service_pool.cc:224] Handling call
0709 13:12:05.981720 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.465161 (+1483441us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b5400290a20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51caedc0 00007f9a51d391c0 00007f9a51d3a231 00007f9a51d36d8f 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c
0709 13:12:07.600398 (+135237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.600666 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131827072}
I20260709 13:12:07.465875 31537 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.604050 31537 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.466416 31544 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:07.413795 31484 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:07.470182 31418 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.607522 31544 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.608144 31418 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:07.470283 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3095) took 1348 ms. Trace:
I20260709 13:12:07.609356 27230 rpcz_store.cc:276] 0709 13:12:06.121420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.133160 (+ 11740us) service_pool.cc:224] Handling call
0709 13:12:06.162624 (+ 29464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.571555 (+408931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.571608 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.640683 (+ 69075us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.094137 (+453454us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:07.094198 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.097827 (+  3629us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.469958 (+372131us) raft_consensus.cc:1685] finished
0709 13:12:07.469992 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.470203 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7390,"raft.queue_time_us":50374,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6720,"thread_start_us":792739,"threads_started":2,"wal-append.queue_time_us":700986}
I20260709 13:12:07.471899 31439 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:07.611981 31439 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:07.612063 31269 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.612591 31439 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.475871 31463 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:07.312122 31554 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.382597 31451 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.629091 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:07.477655 31481 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:07.414870 31555 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.633059 31555 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:07.397650 31514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.023s	sys 0.048s
I20260709 13:12:07.504423 27225 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:07.497601 27232 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:07.390097 31423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.036s	sys 0.100s
W20260709 13:12:07.636070 31423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.036s	sys 0.100s
I20260709 13:12:07.637410 31269 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.509861 27229 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:12:07.444269 27841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1203) took 1840 ms (client timeout 1514 ms). Trace:
I20260709 13:12:07.640149 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:07.641091 27833 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
W20260709 13:12:07.515095 27835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.024s	sys 0.016s
I20260709 13:12:07.503343 31567 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.481204 31506 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:07.518283 27149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.024s	sys 0.053s
I20260709 13:12:07.519378 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.531443 27306 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:07.537956 30717 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.489938 31556 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:07.523540 31542 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:12:07.575917 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:07.514845 27806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.029s
W20260709 13:12:07.583407 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48510.6us
I20260709 13:12:07.514087 31316 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:07.533671 31511 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.599572 27156 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:07.616369 27301 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:07.625435 27838 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:07.578195 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 331886us
I20260709 13:12:07.581684 31206 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.574743 31450 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.597018 31516 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.393198 31446 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:07.569903 31550 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:07.639770 27841 rpcz_store.cc:269] 0709 13:12:05.603816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.603961 (+   145us) service_pool.cc:224] Handling call
0709 13:12:07.443996 (+1840035us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54005820d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:07.444142 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424439168}
W20260709 13:12:07.643323 27149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.025s	sys 0.053s
I20260709 13:12:07.646579 27840 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:07.642302 27835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.024s	sys 0.016s
W20260709 13:12:07.706857 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.656723 27155 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:07.588501 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:07.698685 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:07.708093 27839 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.626626 31463 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:07.665052 27153 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
W20260709 13:12:07.647142 27806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.013s	sys 0.029s
I20260709 13:12:07.712311 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:07.713007 27841 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:07.661757 31484 consensus_queue.cc:1243] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:07.683259 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:07.629153 31554 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.699954 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3094) took 1606 ms. Trace:
I20260709 13:12:07.720846 27833 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:07.751672 31567 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:07.752394 31501 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:07.753647 31560 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:07.702790 31537 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:07.755053 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:07.763283 31572 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:07.701464 31446 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.540938 31299 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.662519 31556 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.659955 31565 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:07.725346 27226 rpcz_store.cc:276] 0709 13:12:06.094028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.118504 (+ 24476us) service_pool.cc:224] Handling call
0709 13:12:06.137234 (+ 18730us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:06.401794 (+264560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.401835 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:06.405449 (+  3614us) log.cc:844] Serialized 52 byte log entry
0709 13:12:06.897139 (+491690us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:06.897197 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.897307 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:07.699691 (+802384us) raft_consensus.cc:1685] finished
0709 13:12:07.699717 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.699883 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4779,"raft.queue_time_us":45980,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5535,"thread_start_us":558886,"threads_started":2,"wal-append.queue_time_us":583277}
W20260709 13:12:07.774330 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44875.3us
I20260709 13:12:07.786954 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:07.788599 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:07.789557 27231 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:07.697178 31450 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.724418 31425 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 13:12:07.803996 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 437393us
I20260709 13:12:07.710569 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:07.713512 31550 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:07.724924 31463 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.718977 31570 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.797572 31481 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:07.794735 31269 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.816534 27148 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:07.797909 31439 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:07.808691 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:07.821197 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1615) took 1804 ms. Trace:
I20260709 13:12:07.821573 27837 rpcz_store.cc:276] 0709 13:12:06.017195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.269318 (+252123us) service_pool.cc:224] Handling call
0709 13:12:07.444745 (+1175427us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:12:07.517783 (+ 73038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.820971 (+303188us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005820d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:07.821130 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702294912}
I20260709 13:12:07.822551 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:07.823874 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.827145 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 450158us
I20260709 13:12:07.771740 31316 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.844197 27148 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:07.849380 27148 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.835373 27123 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:07.817368 31561 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.794612 31556 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.799656 31515 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:07.814743 31570 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.792330 31565 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:07.907179 27120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.038s
I20260709 13:12:07.817229 31481 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:07.913591 27157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.018s
W20260709 13:12:07.919235 27120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.039s
W20260709 13:12:07.920605 27270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.019s
I20260709 13:12:07.852296 31487 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.852499 31554 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.853507 31534 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.934024 27270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.015s	sys 0.019s
I20260709 13:12:07.833207 31444 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.953717 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:07.905261 31441 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:07.913625 31316 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.953758 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1619) took 1073 ms. Trace:
W20260709 13:12:07.955148 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.833767 31269 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:07.843011 31520 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.960721 27148 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:07.920706 31570 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.935114 31481 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:07.934407 27157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.008s	sys 0.018s
I20260709 13:12:07.843317 31439 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:12:07.979208 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:07.988444 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:07.996129 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 285671us
I20260709 13:12:07.997036 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:08.000849 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:07.948566 31583 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:07.953076 31581 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:07.952965 31573 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:08.026319 27224 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 11. Ops: []
I20260709 13:12:07.973505 31584 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.920003 31561 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.020509 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:07.966969 31580 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.027887 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:08.029844 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:07.969978 31560 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:07.977856 31520 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.985415 31567 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.036093 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.039296 27306 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:07.984704 31451 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.043655 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.041052 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:07.992389 31377 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.003670 31441 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:08.054410 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.059158 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.063632 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.012881 31590 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.071101 27148 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:08.031610 31571 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.962949 31444 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:08.077293 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.035127 31516 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.077839 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.058423 31520 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.089560 27839 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:12:08.083931 27298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:07.968223 31534 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.055248 31554 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:08.083492 31180 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.888s	user 0.003s	sys 0.010s
I20260709 13:12:08.078992 31555 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:08.101024 31206 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.082263 31550 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.111688 27298 raft_consensus.cc:606] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:08.103590 31507 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.000s
I20260709 13:12:08.091645 31299 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.112838 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.114290 27304 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:08.171334 31422 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.027148 31583 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.172003 31422 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.122000 31576 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.057547 31560 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.174355 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2516) took 1303 ms. Trace:
I20260709 13:12:08.174499 31576 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.175335 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 849) took 1543 ms. Trace:
I20260709 13:12:08.176435 31560 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.175741 27302 rpcz_store.cc:276] 0709 13:12:06.632192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.632803 (+   611us) service_pool.cc:224] Handling call
0709 13:12:06.671056 (+ 38253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.314450 (+643394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.314483 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.371444 (+ 56961us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.855220 (+483776us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:07.855286 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.855399 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.175114 (+319715us) raft_consensus.cc:1685] finished
0709 13:12:08.175139 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.175278 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15342,"raft.queue_time_us":62817,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":57328,"thread_start_us":1054010,"threads_started":2,"wal-append.queue_time_us":773386}
I20260709 13:12:08.030156 31581 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.178246 31550 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.179070 31581 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.178963 31550 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.097339 31506 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.091913 31438 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.181187 31269 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.129019 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.148747 30821 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:08.078562 31441 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:08.182534 30821 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.174816 27149 rpcz_store.cc:276] 0709 13:12:06.871056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.871193 (+   137us) service_pool.cc:224] Handling call
0709 13:12:06.871584 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.705822 (+834238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.705901 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.720063 (+ 14162us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.032469 (+312406us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:08.032513 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.032581 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.174123 (+141542us) raft_consensus.cc:1685] finished
0709 13:12:08.174151 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.174291 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2012,"raft.queue_time_us":237922,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7743,"thread_start_us":1141687,"threads_started":2,"wal-append.queue_time_us":452183}
I20260709 13:12:08.183748 31441 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.184500 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.185719 30821 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.060634 31580 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.137076 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.083345 31590 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.143869 31534 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:08.144896 31587 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:12:08.101153 31450 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:08.147318 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 74263.5us
I20260709 13:12:08.254580 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.042876 31584 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.181936 31550 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.122521 31588 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:12:08.090096 31571 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.138698 31554 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.157323 31565 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.158972 31561 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.159308 31556 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.112852 31463 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.161124 31444 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.162386 31606 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.043663 31573 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.163981 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:08.139695 31555 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.145788 31233 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.166917 27840 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:12:08.284097 31180 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:08.149004 31511 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.176921 31576 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.075678 31377 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.186614 31583 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.194296 27230 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:08.194160 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:08.314371 31437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.009s
I20260709 13:12:08.195868 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:08.334086 27840 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:08.196664 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:08.199752 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.255021 31520 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.120054 31439 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.234875 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:07.967339 27835 rpcz_store.cc:276] 0709 13:12:06.880428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.882532 (+  2104us) service_pool.cc:224] Handling call
0709 13:12:06.882893 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.883166 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:07.707194 (+824028us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.953350 (+246156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.953423 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:07.953490 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.953563 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.953696 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":598650,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"thread_start_us":1052956,"threads_started":2}
I20260709 13:12:08.108080 31603 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.286437 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:08.326288 31555 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:08.348513 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 62175.1us
W20260709 13:12:08.299650 27156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.002s
W20260709 13:12:08.319512 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 291733us
I20260709 13:12:08.214085 31507 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.325018 27838 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:08.114902 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.325152 27832 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.194953 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:08.355360 27226 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:08.319572 31422 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.334307 27232 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:08.355967 27834 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:08.309935 27303 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:08.312204 31591 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:08.350891 27156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.008s	sys 0.002s
W20260709 13:12:08.351635 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 236779us
W20260709 13:12:08.360610 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.362232 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.350805 31437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.001s	sys 0.010s
I20260709 13:12:08.365288 31439 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:08.331408 31180 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.439769 31439 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.441190 31180 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.357753 31576 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.378271 31594 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:08.382218 31481 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.445238 31481 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.445770 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.387188 31450 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.446427 31450 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:08.388928 31554 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.447433 31450 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.448845 31450 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.448598 31570 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.387372 31590 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:08.451241 31454 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.918s	user 0.012s	sys 0.002s
I20260709 13:12:08.388886 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2321) took 1049 ms. Trace:
I20260709 13:12:08.390929 31571 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.393970 31580 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.396245 31507 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.398253 31444 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.455408 31444 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.457178 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.457551 31444 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.399753 31520 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.458551 31520 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.459474 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.460120 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.357599 31581 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.477383 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.477669 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.478194 27304 raft_consensus.cc:2368] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:08.478713 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.402825 31584 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.353663 31582 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.505265 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.451716 31454 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.354171 31603 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.414829 31591 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.414685 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.435997 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3079) took 1112 ms. Trace:
I20260709 13:12:08.523641 27150 rpcz_store.cc:276] 0709 13:12:07.323064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.323179 (+   115us) service_pool.cc:224] Handling call
0709 13:12:07.363618 (+ 40439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.822276 (+458658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.822309 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.822856 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.285555 (+462699us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:08.285609 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.285701 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.435657 (+149956us) raft_consensus.cc:1685] finished
0709 13:12:08.435691 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.435902 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":243634,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":825791,"threads_started":2,"wal-append.queue_time_us":577168}
I20260709 13:12:08.330626 31233 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.528031 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.529284 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.462365 27300 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:08.448220 31573 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.463528 27305 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:08.465384 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3086) took 1108 ms. Trace:
I20260709 13:12:08.468811 31553 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.472721 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3082) took 1148 ms. Trace:
I20260709 13:12:08.543335 27154 rpcz_store.cc:276] 0709 13:12:07.323932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.329141 (+  5209us) service_pool.cc:224] Handling call
0709 13:12:07.329506 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.817650 (+488144us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:07.817687 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.818222 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.214662 (+396440us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:08.214719 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.472144 (+257425us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b54002e77d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:08.472219 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.472288 (+    69us) raft_consensus.cc:1685] finished
0709 13:12:08.472309 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.472638 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242647,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":81296128,"thread_start_us":794548,"threads_started":2,"wal-append.queue_time_us":522027}
I20260709 13:12:08.479799 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.476724 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:08.482452 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 131108us
I20260709 13:12:08.404948 31377 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.323989 31606 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:08.507977 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.510250 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:08.550943 31606 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.517982 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.551508 27122 leader_election.cc:400] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:08.551823 27122 leader_election.cc:403] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:08.520048 27841 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:08.521380 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.552821 27299 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:08.552939 31573 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.454254 27301 rpcz_store.cc:276] 0709 13:12:07.339398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.339540 (+   142us) service_pool.cc:224] Handling call
0709 13:12:08.388642 (+1049102us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001ca2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:08.388808 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520655744}
I20260709 13:12:08.553685 31573 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.538780 27156 rpcz_store.cc:276] 0709 13:12:07.356733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.756522 (+399789us) service_pool.cc:224] Handling call
0709 13:12:07.757005 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.757471 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.757511 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.771049 (+ 13538us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.360014 (+588965us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:08.464789 (+104775us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.465057 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.465136 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.465183 (+    47us) raft_consensus.cc:1685] finished
0709 13:12:08.465195 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.465325 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105116,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":14539,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":7966,"thread_start_us":690153,"threads_started":2,"wal-append.queue_time_us":607052}
I20260709 13:12:08.541579 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.531927 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.459005 31520 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.524789 31582 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:08.572067 31316 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.000s
I20260709 13:12:08.564327 31503 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:12:08.586258 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.587826 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:08.588490 27804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.066s	sys 0.156s
W20260709 13:12:08.591614 27804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.066s	sys 0.156s
W20260709 13:12:08.588423 31353 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.014s
I20260709 13:12:08.593137 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:08.594861 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:08.595849 27839 raft_consensus.cc:2376] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12. Re-sending same reply.
I20260709 13:12:08.564054 31606 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.597407 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.597353 31606 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.595887 27836 raft_consensus.cc:2376] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
I20260709 13:12:08.542548 31584 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:12:08.596758 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:08.605604 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:08.600373 27157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.108s	sys 0.234s
W20260709 13:12:08.606393 27157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.108s	sys 0.235s
I20260709 13:12:08.606662 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.607951 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:08.609450 31614 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.487s	user 0.003s	sys 0.000s
I20260709 13:12:08.610776 31520 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.611547 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.613214 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2082) took 1919 ms. Trace:
I20260709 13:12:08.614286 31424 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.601037 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.615154 27839 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:08.616000 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:08.616606 27051 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 337) took 21636 ms (client timeout 15000 ms). Trace:
I20260709 13:12:08.617086 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.617970 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.618320 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.607613 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2513) took 1776 ms. Trace:
I20260709 13:12:08.601734 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.618752 27836 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:08.618996 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.619174 27835 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:12:08.595607 31353 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.008s	sys 0.014s
I20260709 13:12:08.619922 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.603304 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.561697 31510 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:08.595292 31590 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:08.617272 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:08.604430 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:08.614388 27838 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:08.600795 31430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.014s	sys 0.010s
I20260709 13:12:08.621832 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.537241 31591 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.613590 27224 rpcz_store.cc:276] 0709 13:12:06.693865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.699931 (+  6066us) service_pool.cc:224] Handling call
0709 13:12:07.476260 (+776329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.026908 (+550648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.297378 (+270470us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54002279d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:08.613010 (+315632us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54002279d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:08.613150 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002979840}
I20260709 13:12:08.630506 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:08.624028 27151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.013s	sys 0.014s
I20260709 13:12:08.566336 31299 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:12:08.618933 27157 rpcz_store.cc:276] 0709 13:12:06.831790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.831942 (+   152us) service_pool.cc:224] Handling call
0709 13:12:06.832320 (+   378us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:07.139751 (+307431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.139801 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:07.253716 (+113915us) log.cc:844] Serialized 78 byte log entry
0709 13:12:07.994415 (+740699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:08.607027 (+612612us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.607258 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.607350 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.607396 (+    46us) raft_consensus.cc:1685] finished
0709 13:12:08.607409 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.607555 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4422,"prepare.queue_time_us":470279,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":247468,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3225,"thread_start_us":1496696,"threads_started":3,"wal-append.queue_time_us":949375}
I20260709 13:12:08.626125 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.635008 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.629226 27156 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:08.635645 27157 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:08.629843 27839 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:08.629065 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:08.631222 27151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.014s	sys 0.014s
I20260709 13:12:08.631541 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:08.631911 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:08.632385 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:08.628836 31430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.014s	sys 0.011s
I20260709 13:12:08.626812 31590 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.638727 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:08.625633 31316 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.627562 31570 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.647222 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:08.644371 31574 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.635391 31510 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:08.655638 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:08.656424 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.658721 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.660249 31606 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.661701 31591 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.717238 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3077) took 1394 ms. Trace:
I20260709 13:12:08.645078 31590 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:08.616993 27051 rpcz_store.cc:269] 0709 13:11:46.979949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.980234 (+   285us) service_pool.cc:224] Handling call
0709 13:12:08.616496 (+21636262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:03.617076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:03.844014 (+226938us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:03.855803 (+ 11789us) write_op.cc:435] Acquired schema lock
0709 13:12:03.882828 (+ 27025us) tablet.cc:662] Decoding operations
0709 13:12:03.992924 (+110096us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:03.993047 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:03.993075 (+    28us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:12:03.994442 (+  1367us) tablet.cc:701] Row locks acquired
0709 13:12:03.994495 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:12:03.994718 (+   223us) write_op.cc:270] Start()
0709 13:12:03.994898 (+   180us) write_op.cc:276] Timestamp: P: 1783602723994652 usec, L: 0
0709 13:12:03.994943 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:12:03.998319 (+  3376us) log.cc:844] Serialized 4876 byte log entry
0709 13:12:04.490369 (+492050us) op_driver.cc:464] REPLICATION: finished
0709 13:12:04.885230 (+394861us) write_op.cc:301] APPLY: starting
0709 13:12:04.902392 (+ 17162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.229955 (+327563us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.230108 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:06.053615 (+823507us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b1800384400. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a51a760ec 00007f9a51a78af7 00007f9a51a79fb0 00007f9a5578e1bb 00007f9a557d55d4 00007f9a556818da 00007f9a556843cb 00007f9a55683fd3 00007f9a55782e34
0709 13:12:06.245265 (+191650us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:06.245727 (+   462us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:12:06.245820 (+    93us) write_op.cc:312] APPLY: finished
0709 13:12:06.246433 (+   613us) log.cc:844] Serialized 113 byte log entry
0709 13:12:06.246750 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.246982 (+   232us) write_op.cc:454] Released schema lock
0709 13:12:06.247078 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:06.247697 (+   619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.247742 (+    45us) write_op.cc:454] Released schema lock
0709 13:12:06.954673 (+706931us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800384400. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
Metrics: {"mutex_wait_us":187634,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":340162,"apply.run_cpu_time_us":32325,"apply.run_wall_time_us":1395677,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48001,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":107920,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":8,"num_ops":12,"prepare.queue_time_us":618605,"prepare.run_cpu_time_us":43557,"prepare.run_wall_time_us":508696,"raft.queue_time_us":184093,"raft.run_cpu_time_us":27825,"raft.run_wall_time_us":325771,"replication_time_us":460593,"spinlock_wait_cycles":16575104,"thread_start_us":871014,"threads_started":4,"wal-append.queue_time_us":910031,"wal-append.run_cpu_time_us":38373,"wal-append.run_wall_time_us":2156946}]]}
I20260709 13:12:08.665762 31594 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:08.741828 31594 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:08.742882 31594 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:08.753422 27153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2518) took 1436 ms (client timeout 1901 ms). Trace:
W20260709 13:12:08.753911 27153 rpcz_store.cc:269] 0709 13:12:07.317504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.317633 (+   129us) service_pool.cc:224] Handling call
0709 13:12:08.753195 (+1435562us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:08.753348 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796616960}
I20260709 13:12:08.759167 31584 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:08.760329 31584 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:08.649125 31498 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.760747 31584 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:08.761157 31498 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.752633 31430 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:12:08.650004 31316 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.764914 31603 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.766443 31316 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:08.769724 31446 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.977s	user 0.007s	sys 0.005s
I20260709 13:12:08.680663 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3085) took 1355 ms. Trace:
I20260709 13:12:08.777226 27155 rpcz_store.cc:276] 0709 13:12:07.324820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.353770 (+ 28950us) service_pool.cc:224] Handling call
0709 13:12:07.354437 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.707600 (+353163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.680361 (+972761us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54000de654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:08.680578 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693842816}
I20260709 13:12:08.778596 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:08.779194 27155 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.779663 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.780948 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.781636 27153 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:08.782442 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.783387 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.783521 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:08.783979 27153 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:08.784155 27227 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.678025 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:08.640344 31553 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.691452 31451 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.707633 31574 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.690507 31619 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.796598 31619 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.784834 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:08.798764 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:08.799059 31619 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.717736 27151 rpcz_store.cc:276] 0709 13:12:07.322452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.345232 (+ 22780us) service_pool.cc:224] Handling call
0709 13:12:07.345712 (+   480us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:07.855673 (+509961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.855705 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:07.908119 (+ 52414us) log.cc:844] Serialized 52 byte log entry
0709 13:12:08.050083 (+141964us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:08.608765 (+558682us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:08.641526 (+ 32761us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.641846 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.641949 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.679985 (+ 38036us) raft_consensus.cc:1685] finished
0709 13:12:08.716900 (+ 36915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.717135 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414870,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":261297,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":218,"spinlock_wait_cycles":19318528,"thread_start_us":1156702,"threads_started":3,"wal-append.queue_time_us":145185}
I20260709 13:12:08.799381 27226 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:08.800114 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.790941 27150 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:08.801095 31619 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.801206 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.720863 31555 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.801654 31619 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.802868 27157 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:08.803717 31555 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.804807 31450 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:08.805365 31450 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.805848 31450 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.806843 31619 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.726675 31454 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:08.730589 31608 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:08.731267 31625 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:08.732512 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49586.4us
I20260709 13:12:08.828130 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:08.829521 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:08.734177 31423 raft_consensus.cc:993] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:12:08.755776 31560 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:08.772969 31233 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.775767 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:08.835850 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:08.786234 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108316us
I20260709 13:12:08.837306 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.786514 27223 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:08.643733 27806 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:08.790875 27230 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:08.791709 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:08.792670 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:08.794423 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:08.840344 27228 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:08.840951 27225 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.816973 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:08.824988 27272 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:08.824996 30717 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:08.826272 31608 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.849852 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.852487 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1214) took 1171 ms. Trace:
I20260709 13:12:08.853068 27832 rpcz_store.cc:276] 0709 13:12:07.680870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.694747 (+ 13877us) service_pool.cc:224] Handling call
0709 13:12:08.324972 (+630225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.354870 (+ 29898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.852267 (+497397us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400882050. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:08.852419 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448412928}
I20260709 13:12:08.855443 27155 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:08.860625 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:08.862192 27227 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:08.867672 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:08.875308 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:08.875823 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50921.2us
W20260709 13:12:08.877326 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.877728 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:08.823978 31451 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:08.892987 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.761731 31584 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.907123 30717 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.909190 30717 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.848562 31484 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.850751 31570 raft_consensus.cc:1081] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:12:08.851814 31423 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.851974 31555 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:08.821439 31446 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.900259 31418 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.908972 31233 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:08.848304 31501 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:12:08.851152 31503 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:08.922088 30717 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:08.920073 31416 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.908753 31586 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:08.899909 31498 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:12:08.932060 31233 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.915042 31507 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:08.952308 31608 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:08.936970 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.885140 31316 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:08.938896 30717 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:08.956370 30717 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.923970 31444 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.916237 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:08.935444 27225 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:08.919828 31430 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:08.923906 31553 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.835994 31625 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.930907 31484 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.947896 31586 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.952535 31507 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.932050 31418 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:08.954632 31584 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.938599 31515 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:12:08.968961 30717 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:08.954888 31233 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.957574 31416 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:08.972203 31586 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.007997 31625 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.018558 31444 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:09.025743 31416 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.028115 31418 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.032398 31582 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:09.038286 31573 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:08.978433 31451 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:08.968524 31430 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.039621 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.042814 31446 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.047547 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.070327 27157 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:09.050494 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 3092) took 1084 ms. Trace:
W20260709 13:12:09.056571 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 412913us
I20260709 13:12:09.057305 31463 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.057524 31487 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:09.057322 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 196749us
W20260709 13:12:09.059597 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 141795us
I20260709 13:12:09.073905 27804 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.074882 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.075695 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.060704 31444 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:09.071484 27148 rpcz_store.cc:276] 0709 13:12:07.965697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.978889 (+ 13192us) service_pool.cc:224] Handling call
0709 13:12:09.050256 (+1071367us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400356bd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:09.050403 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176641280}
I20260709 13:12:09.079169 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.080098 27148 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:09.080885 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.088059 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.088124 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:09.093504 30717 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:09.094331 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.094627 30717 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.096257 30717 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:09.096694 30717 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.094334 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:09.101569 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.103283 31608 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.103366 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.104760 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.105312 27148 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 5.
I20260709 13:12:09.106321 31520 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:09.107259 31520 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:09.107566 31520 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:09.108350 31520 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.108891 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:09.110296 31433 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.110807 31433 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.111263 31433 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.112895 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.081548 31487 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:09.116461 31487 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.116999 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.117329 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:09.117832 27305 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:09.118021 27302 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:09.121738 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.122545 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.122606 27832 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:09.125011 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.082665 31603 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:09.126937 31603 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.127153 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.128130 27832 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:09.082554 31439 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:09.127404 31603 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.129043 31439 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.129555 31439 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:09.093892 31510 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.131937 31510 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.132366 31510 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.135082 31585 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:09.135632 31585 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:09.136718 31585 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.138155 31423 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:09.138728 31423 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.138787 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.139370 31423 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.139793 27832 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:09.142154 31441 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.142747 31441 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.143191 31441 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.146657 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.084856 31582 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.150162 27148 raft_consensus.cc:1217] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:12:09.150930 27148 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:09.151216 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:09.153463 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52007.3us
I20260709 13:12:09.154897 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.156026 31584 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:09.079016 31444 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.157686 31584 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:09.158443 31582 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:09.159088 31584 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.159513 31582 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.165123 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:09.157954 31635 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 13:12:09.166982 31511 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:09.167397 31511 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:09.168215 31511 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.169503 31511 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.172583 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.173429 27841 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:09.175731 31574 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:09.183362 31636 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 13:12:09.184955 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:09.181915 31603 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.190168 31603 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:09.202535 31580 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.203169 31580 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.206020 31580 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:09.202594 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 286398us
I20260709 13:12:09.208930 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:09.210314 31555 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.214000 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:09.216274 31574 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:09.219391 31484 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.219998 31484 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.220458 31484 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.223569 31585 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.223896 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:09.225086 27155 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:09.193873 31450 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.196244 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:09.199009 31619 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:09.228008 27149 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.231796 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.109802 31520 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.233815 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.235599 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:09.054499 31590 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.242944 27155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:12:09.243356 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.253058 27155 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:09.246711 27148 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:09.254240 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:09.254920 27838 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.253522 27155 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.257632 27157 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:09.269053 27153 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:12:09.269753 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 392070us
I20260709 13:12:09.274011 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:09.233243 31625 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:09.238119 31507 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.291585 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.291345 31510 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.267122 31316 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.297937 27149 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:09.300209 30717 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.303131 27154 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:12:09.274262 31377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.012s
I20260709 13:12:09.304666 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.285144 31555 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.267366 31180 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.318584 31484 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.314596 27838 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:09.319501 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.353967 30717 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.326357 31498 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:09.328660 27149 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:09.329300 27804 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.336201 27297 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:09.337085 27225 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:12:09.474588 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 145387us
I20260709 13:12:09.476735 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:09.477507 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:09.478338 27231 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.480526 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.484473 27149 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:12:09.485291 27149 pending_rounds.cc:85] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 8
I20260709 13:12:09.485634 27149 pending_rounds.cc:107] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:12:09.463967 27840 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
W20260709 13:12:09.452459 27270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.034s
W20260709 13:12:09.321153 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47208.7us
W20260709 13:12:09.488451 27270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.017s	sys 0.034s
W20260709 13:12:09.339634 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 452914us
I20260709 13:12:09.486320 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.319410 31446 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:09.492720 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.416450 31614 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:09.500100 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.347545 31570 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.508809 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.359194 31590 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.500830 27149 raft_consensus.cc:2889] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.458542 31553 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:09.409050 31574 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.509708 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:09.514571 27223 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:09.384645 31576 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.517365 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:09.360383 31450 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.385825 31595 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:09.437901 31430 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.534859 27231 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:09.495569 31606 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.538790 27838 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:09.326440 31647 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.194s
I20260709 13:12:09.329141 31625 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.361928 27050 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 6 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.353493 31586 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.338514 31316 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.546630 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.547766 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:09.576962 27299 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:09.556965 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.578409 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:09.578616 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.558604 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.579277 27301 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:09.580531 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.581269 27836 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:09.487744 31555 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.551774 27271 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:09.582819 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:09.527738 27155 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.585399 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:09.586206 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:09.594482 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.511554 31446 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.516721 31484 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:12:09.551203 31571 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:09.542616 31619 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:09.600754 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49067.8us
I20260709 13:12:09.629006 27153 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:09.597611 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.543833 31644 raft_consensus.cc:2764] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:09.573849 31590 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:09.623602 27155 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.627317 27148 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [7.8-11.10]
I20260709 13:12:09.574631 31507 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:09.527227 31570 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.653883 31570 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:09.621075 31637 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:12:09.649420 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:09.627790 31206 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.655501 31444 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.655747 31206 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.650981 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:09.657095 27123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.538s (SENT) [suppressed 17 similar messages]
I20260709 13:12:09.655200 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:09.660825 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:09.624461 27050 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), pending config changed. New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:09.592195 31606 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:09.666541 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 180189us
I20260709 13:12:09.582027 31603 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:12:09.545310 31574 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.627203 31571 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.572391 31576 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.672649 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3106) took 1014 ms. Trace:
I20260709 13:12:09.673631 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:09.572625 31595 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.664374 31206 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.704981 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:09.694875 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.706020 27840 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:09.706614 27229 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.020s	sys 0.022s
I20260709 13:12:09.693894 27151 rpcz_store.cc:276] 0709 13:12:08.657863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.844174 (+186311us) service_pool.cc:224] Handling call
0709 13:12:08.844588 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:08.852047 (+  7459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.852073 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:08.900517 (+ 48444us) log.cc:844] Serialized 52 byte log entry
0709 13:12:09.317096 (+416579us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:09.666845 (+349749us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.672294 (+  5449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.672383 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.672421 (+    38us) raft_consensus.cc:1685] finished
0709 13:12:09.672437 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.672589 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10309,"prepare.queue_time_us":16659,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":21384,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9838,"thread_start_us":715915,"threads_started":2,"wal-append.queue_time_us":513073}
W20260709 13:12:09.706990 27229 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.020s	sys 0.022s
I20260709 13:12:09.589438 31439 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.633699 31510 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.694101 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:09.708078 27301 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:09.700249 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:09.677459 31233 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.002s
I20260709 13:12:09.701066 27050 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 4, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 4 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.708400 27301 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:09.671895 31590 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:09.675284 31424 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:09.693382 31571 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.647362 31619 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.752874 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:09.745038 27050 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:09.714246 27301 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:09.781479 27301 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.763291 27834 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:09.752022 31450 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.811877 31645 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.812460 31655 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:12:09.812487 31644 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.826222 31484 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.826400 31644 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.826797 31484 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.828811 31484 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.747272 31233 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.830905 31233 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:09.831825 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.816460 31619 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:09.824724 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.825929 27299 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:09.842010 27303 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:12:09.843825 31653 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:12:09.845494 31654 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:12:09.824887 31441 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.000s
I20260709 13:12:09.852867 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:09.853987 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:09.862084 27231 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.856185 27232 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:09.857241 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.861061 27301 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:09.863531 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:09.823030 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 263468us
W20260709 13:12:09.783280 31650 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:09.878223 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.878403 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.885296 27230 raft_consensus.cc:2376] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8. Re-sending same reply.
I20260709 13:12:09.878494 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.886487 27226 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:09.887353 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.879026 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.868417 27050 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 6 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:09.843199 31649 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:12:09.895052 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:09.898783 27225 raft_consensus.cc:2376] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7. Re-sending same reply.
I20260709 13:12:09.895295 27227 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:09.901041 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.901510 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.818475 31450 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.904894 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.894104 27231 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:09.821960 31662 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:09.879220 31619 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:09.920436 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.920446 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.901768 27232 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:09.898422 31487 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.001s
I20260709 13:12:09.817250 31590 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.850430 31645 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:09.895390 31563 raft_consensus.cc:2764] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:12:09.921916 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 264853us
W20260709 13:12:09.944254 27123 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.593s (SENT)
I20260709 13:12:09.916491 31450 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.818920 31606 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:09.960858 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81141.3us
I20260709 13:12:09.962399 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:09.890190 31441 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:09.968766 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.981094 27232 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:09.980253 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:09.991091 27224 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:09.936429 31487 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:10.042351 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 342181us
I20260709 13:12:10.043614 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:10.118582 27123 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.739s (SENT)
I20260709 13:12:10.119393 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:09.978901 31416 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:10.137466 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 93998.3us
I20260709 13:12:09.983764 31446 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.931947 31619 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.156746 27050 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 8, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.134711 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.161787 27230 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.138844 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 862) took 1023 ms. Trace:
I20260709 13:12:10.133339 27840 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:10.139614 27123 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.864s (SENT)
I20260709 13:12:10.163686 27297 rpcz_store.cc:276] 0709 13:12:09.115707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.115857 (+   150us) service_pool.cc:224] Handling call
0709 13:12:09.116152 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.495928 (+379776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.138588 (+642660us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001cb1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.138780 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505575680}
I20260709 13:12:10.140897 31573 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:10.141644 31418 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.927664 31664 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.210s
I20260709 13:12:10.138870 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.142357 31430 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:09.989724 31316 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:10.145310 31657 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:12:10.145560 27232 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:10.146179 31576 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:10.148772 31659 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:12:10.130827 31353 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.150221 31555 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:10.151163 31661 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:12:09.989099 31586 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.179945 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:10.144385 31487 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:09.992269 31644 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.137266 31581 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:10.137012 31649 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:12:10.254843 27227 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:10.221154 27225 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:10.179214 31574 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.185045 31437 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:10.212956 31430 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:10.223980 31418 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:10.253082 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.249683 27050 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 3, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:10.218580 27123 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.102s (SENT)
I20260709 13:12:10.257390 27230 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:10.255857 31573 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.179626 31416 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.263075 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3121) took 1090 ms. Trace:
I20260709 13:12:10.264643 31645 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.267331 31441 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.270514 31581 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:10.247975 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 68113.3us
I20260709 13:12:10.272960 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3108) took 1591 ms. Trace:
I20260709 13:12:10.315182 27152 rpcz_store.cc:276] 0709 13:12:08.681642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.851394 (+169752us) service_pool.cc:224] Handling call
0709 13:12:08.851672 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.866536 (+ 14864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.866569 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.867089 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:12:09.425354 (+558265us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:09.438105 (+ 12751us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.698503 (+260398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.698596 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.272725 (+574129us) raft_consensus.cc:1685] finished
0709 13:12:10.272749 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.272899 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18481,"prepare.queue_time_us":12471,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":8418,"raft.queue_time_us":111743,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":34287,"thread_start_us":752688,"threads_started":2,"wal-append.queue_time_us":634330}
I20260709 13:12:10.230135 31353 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:10.319073 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 185562us
W20260709 13:12:10.277324 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58818.3us
I20260709 13:12:10.304036 27154 rpcz_store.cc:276] 0709 13:12:09.173080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.448074 (+274994us) service_pool.cc:224] Handling call
0709 13:12:09.448460 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.448718 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.448753 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:09.449361 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:12:09.658434 (+209073us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:09.658492 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.658587 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.262786 (+604199us) raft_consensus.cc:1685] finished
0709 13:12:10.262810 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.262974 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":208657,"threads_started":1,"wal-append.queue_time_us":358108}
I20260709 13:12:10.321063 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.321832 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.327245 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.327849 27833 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:10.329995 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.330643 27297 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:12:10.313529 31585 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.086s	user 0.013s	sys 0.000s
W20260709 13:12:10.255067 31582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.014s	sys 0.043s
I20260709 13:12:10.276583 31439 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:10.308431 31671 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.311611 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3119) took 1248 ms. Trace:
I20260709 13:12:10.346531 27157 rpcz_store.cc:276] 0709 13:12:09.062844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.314865 (+252021us) service_pool.cc:224] Handling call
0709 13:12:09.315158 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.315535 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.315565 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:09.316060 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:12:09.595667 (+279607us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:09.595725 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.595823 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.311362 (+715539us) raft_consensus.cc:1685] finished
0709 13:12:10.311384 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.311540 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7720,"thread_start_us":229594,"threads_started":1,"wal-append.queue_time_us":425520}
W20260709 13:12:10.340210 31444 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.000s
I20260709 13:12:10.302453 31594 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:10.335413 27807 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.699s (SENT)
I20260709 13:12:10.354153 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.340588 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.258111 31555 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.304240 31418 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:10.342382 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.360260 27300 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:10.310837 31573 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:10.278259 31423 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.138s	user 0.012s	sys 0.003s
I20260709 13:12:10.348685 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.355280 27833 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:10.344292 31582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.015s	sys 0.044s
I20260709 13:12:10.340193 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:10.361635 27232 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:10.363201 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.745s (SENT)
I20260709 13:12:10.364215 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:10.397624 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 57523us
I20260709 13:12:10.376729 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.401432 27227 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:10.374388 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.399678 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.402328 27230 raft_consensus.cc:2376] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10. Re-sending same reply.
I20260709 13:12:10.398689 27050 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 6, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.399437 27225 raft_consensus.cc:2410] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:10.396320 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.396847 27833 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:10.404062 27226 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:10.365833 31671 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:10.399371 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 419201us
I20260709 13:12:10.415998 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.419692 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.420408 27157 raft_consensus.cc:2368] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
I20260709 13:12:10.421049 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.421918 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.422616 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.423229 27152 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:10.422832 27050 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 6 to 7, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.425076 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.425848 27151 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:10.425920 31670 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:12:10.426646 31671 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.427008 31353 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.428143 27833 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:10.429565 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.430436 31671 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.430804 31671 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.430855 31430 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.431258 31671 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.431885 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:10.437697 31206 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.000s
I20260709 13:12:10.438808 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.438977 31416 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.443192 31206 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.446727 31206 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.450332 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.456705 31450 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.459512 31581 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:10.420015 31444 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:12:10.442375 27195 leader_election.cc:400] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
I20260709 13:12:10.461624 27195 leader_election.cc:403] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:10.462438 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.463402 27833 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:10.442464 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.461143 31573 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.464430 31515 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
W20260709 13:12:10.465126 31571 consensus_meta.cc:287] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.004s
I20260709 13:12:10.421105 31418 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.465598 31571 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.467881 31571 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:10.469394 31433 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.358s	user 0.009s	sys 0.006s
I20260709 13:12:10.400267 31669 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:10.367798 31555 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:10.474308 27227 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:10.439281 31671 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.474433 27050 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 6, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.411307 31439 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.410317 31590 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.418628 31441 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.495625 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.365157 31594 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.489831 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.496582 27227 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:10.371812 31423 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:10.500480 31553 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:10.497828 31520 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.249s	user 0.010s	sys 0.004s
I20260709 13:12:10.501056 31553 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:10.503275 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.504216 27226 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:10.505059 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.505231 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.482803 31669 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:10.506415 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.506644 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:10.506834 27807 leader_election.cc:336] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.822s (SENT)
I20260709 13:12:10.511497 27226 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:10.511547 27230 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:10.507154 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:10.512463 27807 leader_election.cc:336] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.888s (SENT)
I20260709 13:12:10.513167 27231 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:10.509276 27227 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:10.512408 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.507472 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.514228 27226 raft_consensus.cc:2368] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:10.515204 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.515443 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.515923 27226 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:10.512557 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.509740 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:10.519573 31675 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.520144 31675 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:10.520277 31423 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.512146 31669 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.521356 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.521236 31675 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.500217 31555 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:10.486814 31433 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:10.520421 31671 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.535830 31441 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:10.537850 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.550225 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3149) took 1070 ms. Trace:
I20260709 13:12:10.550740 27225 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:10.550735 27223 rpcz_store.cc:276] 0709 13:12:09.480102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.480242 (+   140us) service_pool.cc:224] Handling call
0709 13:12:10.549998 (+1069756us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b54000960d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:10.550151 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76366080}
I20260709 13:12:10.535562 31582 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:10.498106 31590 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.546098 31450 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.546144 31595 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.535701 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.556344 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.521974 27152 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.574290 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:10.576784 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:10.527742 31594 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.589854 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:10.616382 31590 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.556221 31553 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.620155 31553 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.588266 31507 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:10.624255 31433 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.629359 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.589329 31671 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:10.634531 31581 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.635344 31581 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.637084 31487 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.637630 31487 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.639626 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1237) took 1406 ms. Trace:
I20260709 13:12:10.639808 31487 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:10.643122 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 932) took 1068 ms. Trace:
I20260709 13:12:10.643718 27840 rpcz_store.cc:276] 0709 13:12:09.575068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.706868 (+131800us) service_pool.cc:224] Handling call
0709 13:12:10.642842 (+935974us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400560254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:10.643042 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812756352}
I20260709 13:12:10.643460 27832 rpcz_store.cc:276] 0709 13:12:09.233072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.233194 (+   122us) service_pool.cc:224] Handling call
0709 13:12:09.233587 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.624330 (+390743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.624363 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:09.624409 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:09.624444 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.639379 (+1014935us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400721854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.639432 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.639567 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898050304}
I20260709 13:12:10.640863 27833 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:10.641412 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1649) took 1473 ms. Trace:
I20260709 13:12:10.640306 31581 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.648372 27834 rpcz_store.cc:276] 0709 13:12:09.167765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.167886 (+   121us) service_pool.cc:224] Handling call
0709 13:12:09.168175 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.808877 (+640702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.641054 (+832177us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.641329 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368025472}
I20260709 13:12:10.652424 27152 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:10.654421 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.653921 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.633445 31680 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.667781 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.628577 31507 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:10.671380 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.671726 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.666349 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.667238 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1645) took 1517 ms. Trace:
I20260709 13:12:10.677400 27839 rpcz_store.cc:276] 0709 13:12:09.149943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.150135 (+   192us) service_pool.cc:224] Handling call
0709 13:12:10.662518 (+1512383us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54004bc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:10.667163 (+  4645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3024903040}
W20260709 13:12:10.680925 27156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 3096) took 2025 ms (client timeout 1634 ms). Trace:
W20260709 13:12:10.681399 27156 rpcz_store.cc:269] 0709 13:12:08.655436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.658471 (+  3035us) service_pool.cc:224] Handling call
0709 13:12:10.680672 (+2022201us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54000695d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:10.680809 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4569908480}
I20260709 13:12:10.633755 31671 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.682606 31671 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:10.685281 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.689739 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 971) took 1541 ms. Trace:
I20260709 13:12:10.690178 27153 rpcz_store.cc:276] 0709 13:12:09.148804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.330422 (+181618us) service_pool.cc:224] Handling call
0709 13:12:09.330798 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:09.629364 (+298566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.689483 (+1060119us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400357d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.689675 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684982528}
I20260709 13:12:10.693516 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.694880 27302 raft_consensus.cc:2410] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:10.695451 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2085) took 1151 ms. Trace:
I20260709 13:12:10.695871 27302 rpcz_store.cc:276] 0709 13:12:09.544493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.546161 (+  1668us) service_pool.cc:224] Handling call
0709 13:12:10.693288 (+1147127us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:10.695367 (+  2079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4607744}
I20260709 13:12:10.651808 31487 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.698388 31487 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.700747 31487 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:10.701279 31487 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.701876 31582 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.670598 31680 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.703001 31680 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.702633 31507 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.713831 27840 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:10.663789 31444 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:10.719095 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.721807 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.723317 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:10.724056 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.724664 27837 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.728566 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.729238 27223 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:10.729295 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.730199 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.730619 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.730795 27223 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:10.731730 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.731851 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.732069 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.732393 27223 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:10.732662 27833 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.732988 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.733500 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.720697 31451 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:10.734969 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.735487 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.735903 27227 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.736040 27231 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:10.736690 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.737869 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.738569 27223 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:10.739342 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.742040 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.745517 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.746966 27832 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:10.706089 31675 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:10.721279 31660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.005s	sys 0.018s
I20260709 13:12:10.752395 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.760567 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.761415 27225 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:10.746742 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54999us
I20260709 13:12:10.763238 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.770206 27227 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:10.773531 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.722561 31423 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.771052 27231 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:10.770221 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.777661 27833 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:10.731009 31581 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.780903 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.743052 31451 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.781167 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.781579 31451 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.781896 27834 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:10.721688 31418 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:10.779383 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.787241 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.790436 27153 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:10.706365 31441 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:12:10.779839 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.802170 27227 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:10.781023 31594 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.701917 31487 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:12:10.748317 31553 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:10.760411 31660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.005s	sys 0.018s
W20260709 13:12:10.778689 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 93507.1us
I20260709 13:12:10.785096 27156 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:10.823725 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.786118 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.786559 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.824731 27152 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.824852 27839 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:10.787241 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.787876 31444 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.788457 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.836863 27840 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:10.791690 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.791837 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.837503 27151 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:10.803000 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.804528 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.838600 27227 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:10.839448 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.840003 27227 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:10.840723 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.792874 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.843150 27153 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:10.807724 31684 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:10.815807 30717 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:10.774256 31675 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:10.817682 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.773703 31625 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:10.818766 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.818521 31594 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.821130 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.863862 27838 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.821261 27223 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:12:10.820869 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.827170 31695 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:10.827270 27154 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:10.865428 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.865818 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.866706 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.867167 31695 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:10.867551 31687 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:12:10.867851 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.868175 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 923) took 1312 ms. Trace:
W20260709 13:12:10.868669 31688 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:10.868336 31695 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.868597 27835 rpcz_store.cc:276] 0709 13:12:09.555888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.557502 (+  1614us) service_pool.cc:224] Handling call
0709 13:12:09.557913 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.569876 (+ 11963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.569922 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:09.570547 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.637744 (+1067197us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18004a0e00. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:12:10.727748 (+ 90004us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:10.727787 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.727859 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.867793 (+139934us) raft_consensus.cc:1685] finished
0709 13:12:10.867818 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.868096 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17555,"raft.queue_time_us":11551,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14680,"spinlock_wait_cycles":5290880,"thread_start_us":89817,"threads_started":1,"wal-append.queue_time_us":1195381}
I20260709 13:12:10.870607 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.871258 27154 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:10.872586 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.873173 27154 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:12:10.874027 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.830371 31206 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:10.832351 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.833341 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.834925 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.835469 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.783475 31423 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.754586 31484 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.882669 31675 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.911270 31484 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.818125 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:10.841859 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.837467 27157 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:10.804876 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:10.914592 27833 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.855628 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:10.914923 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:10.915710 27151 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:10.915753 27155 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.917106 27157 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:10.847826 27152 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:10.855715 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.860534 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.819988 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:10.918788 27152 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:10.919232 27834 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:10.861543 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:10.827490 31685 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:10.868645 27223 raft_consensus.cc:2368] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:10.856266 30717 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:10.903934 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.895900 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.920539 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.921378 27223 raft_consensus.cc:2376] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
W20260709 13:12:10.918809 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58372.9us
I20260709 13:12:10.922369 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.920400 30717 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.923717 30717 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:10.923070 27223 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:10.924336 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.925323 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.925964 27223 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:10.926829 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.909293 27231 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:10.927328 27838 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:10.928951 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.893887 27837 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:10.935282 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.936121 27227 raft_consensus.cc:2410] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:12:10.935940 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 103667us
W20260709 13:12:10.937578 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 82612.1us
I20260709 13:12:10.858446 31663 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:10.938715 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3117) took 1880 ms. Trace:
I20260709 13:12:10.946586 27148 rpcz_store.cc:276] 0709 13:12:09.058045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.286178 (+228133us) service_pool.cc:224] Handling call
0709 13:12:09.312930 (+ 26752us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:09.649470 (+336540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.938307 (+1288837us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400069ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.938633 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722260864}
I20260709 13:12:10.944380 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:10.948294 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52504.5us
I20260709 13:12:10.863193 31553 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:10.945744 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.956564 27231 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.949908 27123 leader_election.cc:400] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8.
I20260709 13:12:10.951383 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.913671 31484 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:10.982887 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 164889us
I20260709 13:12:10.983664 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.865458 31619 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:10.985208 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:10.957012 27833 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:10.986775 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:10.987351 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3120) took 3036 ms. Trace:
I20260709 13:12:10.958396 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.959231 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:10.988466 27224 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.882725 31594 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:10.881855 31669 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:10.966667 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.966914 31625 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:10.956557 31430 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:10.967509 31692 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.969635 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:10.971817 31204 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:10.972637 31451 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.974293 31553 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:10.975059 31423 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:10.870004 31695 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:10.976722 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:10.977510 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.956956 31660 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.977890 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.978214 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.985893 31418 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:10.979151 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:11.043735 27303 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:11.043949 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.980455 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.989207 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:10.987725 27229 rpcz_store.cc:276] 0709 13:12:07.950552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.950737 (+   185us) service_pool.cc:224] Handling call
0709 13:12:07.971117 (+ 20380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.074838 (+103721us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:09.063846 (+989008us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800223420. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:12:09.707373 (+643527us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.209621 (+502248us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.819729 (+610108us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b1800223420. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:12:10.819934 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.822434 (+  2500us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.843618 (+ 21184us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.843790 (+   172us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:10.843830 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.987048 (+143218us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540038c7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:10.987102 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.987151 (+    49us) raft_consensus.cc:1685] finished
0709 13:12:10.987164 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.987291 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":608664,"prepare.queue_time_us":704634,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":132,"raft.queue_time_us":220313,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":17439,"spinlock_wait_cycles":243319936,"thread_start_us":1039036,"threads_started":2,"wal-append.queue_time_us":559935}
I20260709 13:12:10.990715 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:11.043149 27302 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:11.049170 27224 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:10.991561 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:10.991751 27155 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:12:10.973851 31511 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.993485 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:10.993733 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55465us
I20260709 13:12:11.010957 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.018630 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.021173 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.022114 27223 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:11.056887 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:10.956808 31595 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:10.966724 31439 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:11.067569 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.030019 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:11.023538 31694 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:11.071919 27834 raft_consensus.cc:2368] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:12:10.983420 31671 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:10.976725 31696 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:12:11.054435 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.058200 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:11.023770 30717 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:11.063474 27297 raft_consensus.cc:2368] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:12:11.065577 27149 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:11.020038 31582 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:11.056129 31660 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.071300 31590 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:11.075585 31511 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.107437 31511 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.030869 31487 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:12:11.131600 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.066004 27231 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:11.066280 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:11.066390 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:11.067767 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 74355.2us
I20260709 13:12:11.156908 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.071672 31694 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:11.051288 27150 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:11.162366 27306 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:11.074193 27229 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:11.162635 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.077456 31595 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:11.173828 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:11.153354 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 215664us
I20260709 13:12:11.034283 31625 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.155429 27226 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:11.137023 30717 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:11.032671 31433 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.157330 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.067787 31619 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.167549 31510 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:11.170179 27306 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:12:11.151255 31645 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.184250 27306 pending_rounds.cc:85] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 9
I20260709 13:12:11.186249 27306 pending_rounds.cc:107] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:11.192836 27306 raft_consensus.cc:2889] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:11.171103 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.176018 27299 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:11.195598 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.182407 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.065092 31418 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.178601 31692 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.175053 31694 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:11.230264 27305 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:11.259251 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 276620us
I20260709 13:12:11.275734 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.277591 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:11.280246 27300 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:11.213287 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 171716us
I20260709 13:12:11.295907 31669 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.296797 31669 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.298492 31439 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.298998 31439 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.299383 31439 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.180907 30717 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:11.307338 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.186118 31645 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.223801 27297 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:11.182528 31433 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:11.259968 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 273239us
I20260709 13:12:11.311348 27306 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:11.213392 31677 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.240501 31619 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.187026 31510 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.174840 31553 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.187029 31680 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.334889 27297 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:11.345002 30717 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.371774 27301 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:11.372285 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:11.347721 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 185146us
W20260709 13:12:11.366226 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 299905us
W20260709 13:12:11.367013 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 91366.8us
I20260709 13:12:11.311332 31645 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.373788 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.374886 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.314401 31692 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.319168 31433 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.386533 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.388047 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.389761 27807 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.333528 31619 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:11.334286 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.327425 27302 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:11.332624 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:11.383392 31683 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:12:11.371857 31487 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.400381 30717 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:11.402197 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:11.407284 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74741.3us
I20260709 13:12:11.411492 30717 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:11.398622 31619 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.420393 30717 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.426378 30717 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.408737 31451 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.336546 31595 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:11.447587 31703 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:12:11.448773 31702 log.cc:927] Time spent T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:12:11.450639 31705 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:12:11.391917 31692 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.425606 31563 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.434477 31671 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.412914 31487 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:11.457659 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 146723us
W20260709 13:12:11.460436 31699 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:12:11.458626 31701 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260709 13:12:11.511924 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 138213us
I20260709 13:12:11.512074 27272 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.455961 31712 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:11.463162 31563 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.462546 31718 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.540041 30717 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.524716 31582 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.544770 31582 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.545284 31582 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.551348 31570 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:11.552006 31570 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.561580 31660 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.518482 31625 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.512543 31721 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.576151 27271 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.519672 31717 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.531510 31563 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.589475 31510 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:11.594741 31680 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.597127 31692 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:11.597680 31715 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:11.599040 31696 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:11.608897 31696 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:11.600013 31487 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.600941 31433 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.614902 31433 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.586472 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.615523 31710 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.616055 31710 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.616483 31299 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.604071 31720 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.617436 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.573484 31709 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:12:11.618854 31299 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.541631 31718 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.620620 27272 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:11.621587 31718 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.622519 31204 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.623063 31204 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.624097 31204 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.630357 31418 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.632200 31709 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:11.587000 31721 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.635486 31721 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:11.636994 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:11.604769 31727 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:12:11.640733 31663 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.640938 31424 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.641213 31663 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:11.641314 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 253335us
I20260709 13:12:11.641479 31433 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:11.644436 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:11.607322 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 64723.7us
I20260709 13:12:11.646482 27804 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.647398 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:11.648171 27231 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:11.647043 27223 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.651724 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:11.553177 31570 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.609917 31696 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.657938 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:11.661801 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 210159us
I20260709 13:12:11.662705 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.664247 31718 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:11.664631 31718 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.665019 31718 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.663017 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.670246 31720 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.670814 31720 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:11.671756 31720 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.672266 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:11.672847 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:11.674286 31487 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:11.675225 31487 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:11.675576 31487 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:11.675642 31433 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:11.676221 31433 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.676501 31487 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.677227 31433 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.677819 31487 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.679339 27150 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:11.684062 31680 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.684592 31680 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.687528 31680 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.664839 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:11.687875 31718 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:11.659605 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 257478us
I20260709 13:12:11.702519 27834 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:11.702765 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.703361 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.704653 31720 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.718112 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:11.658825 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.019s	sys 0.005s
I20260709 13:12:11.698293 27150 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:11.725114 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.020s	sys 0.005s
W20260709 13:12:11.725680 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 734109us
I20260709 13:12:11.727582 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.704579 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:11.688501 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:11.733464 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.735603 27149 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:11.737171 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:11.749658 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.760468 27197 leader_election.cc:400] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:12:11.760856 27197 leader_election.cc:403] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.732393 27231 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:11.766952 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:11.769105 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:11.771279 27839 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:11.771279 27841 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:11.661881 31451 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.759709 31487 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:11.710172 31441 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:11.756286 31717 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:11.780666 27840 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:12:11.758128 31446 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:11.709841 31581 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:11.784600 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:11.795186 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.776437 31696 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.785846 31725 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.797595 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.801950 27150 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:11.803953 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.780175 31487 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.775014 31731 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:11.795920 31691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.008s	sys 0.022s
I20260709 13:12:11.775848 31664 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11.
I20260709 13:12:11.786329 31698 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.786644 31717 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.794548 31581 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.793807 31484 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.616940 31710 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.820719 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.806354 31487 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:11.806620 31695 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.005s
I20260709 13:12:11.823199 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.824800 27197 leader_election.cc:400] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
W20260709 13:12:11.815124 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 124349us
I20260709 13:12:11.800894 31441 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:11.828703 27301 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:11.811535 31691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.008s	sys 0.022s
I20260709 13:12:11.832013 27197 leader_election.cc:403] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.832402 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.832484 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:11.808532 31498 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.840498 27155 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:12:11.822178 31439 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.010s
I20260709 13:12:11.844792 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:11.825989 31594 consensus_meta.cc:287] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.796s	user 0.006s	sys 0.007s
I20260709 13:12:11.819406 31581 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:11.849810 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.852504 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:11.819293 31717 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.854223 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:11.856662 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:11.854224 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87412.5us
W20260709 13:12:11.910310 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60533.7us
I20260709 13:12:11.910867 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.911602 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.912705 31669 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:11.912993 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:11.919185 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 87446.5us
I20260709 13:12:11.911641 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.914315 27157 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 4.
I20260709 13:12:11.845451 31664 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9.
I20260709 13:12:11.919384 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:11.922947 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.924144 31729 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:11.924988 31729 consensus_queue.cc:1243] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:11.928401 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:11.935344 31694 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 13:12:11.935948 31694 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.939204 31752 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.940502 31752 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:11.943001 31416 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:11.943404 31416 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:11.944334 31416 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:11.947048 31743 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:12:11.826241 31645 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.949539 31645 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:11.951424 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.952368 31498 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:11.952863 31498 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:11.953249 31728 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:11.954239 31671 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:11.953825 31498 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.954756 31671 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:11.954962 31718 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.955664 31671 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:11.958797 31735 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:12:11.959506 31644 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:11.961198 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 1.18487e+06us
I20260709 13:12:11.962028 27150 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:12:11.962222 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:11.945765 31416 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:11.922271 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.968940 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:11.979784 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57601.8us
I20260709 13:12:11.970817 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:11.978607 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.947250 31695 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.986824 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:11.987875 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:11.991706 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:11.821846 31698 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:11.923797 31669 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.998627 31698 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:11.988673 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.000861 27223 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.918046 31692 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:11.917842 31515 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.858738 31446 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:12:11.810514 31725 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.977257 31553 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:12.012468 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:12.018503 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 108830us
I20260709 13:12:11.854708 31594 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:11.908630 31733 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:12:11.978291 31724 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:12.027973 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.028376 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:11.989029 31718 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.000398 31677 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:11.857173 31439 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.006253 31571 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:12.006541 31734 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.001297 31751 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:12.026235 31553 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:12.050192 31753 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:12.050515 31713 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:12:12.028875 31444 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.007679 31418 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:12:12.051863 31723 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:12.038041 31751 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.050324 31553 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:12.032883 31718 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:12.096597 31718 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.099071 31717 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.105859 31717 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.060235 31694 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:12.086400 31570 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:12.087385 31563 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.037786 31734 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:12.091200 31663 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:12.092110 31716 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.620s	user 0.002s	sys 0.002s
W20260709 13:12:12.094976 31619 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.004s
I20260709 13:12:12.089594 31721 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.124404 31563 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.126190 31721 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.032518 31728 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:12.132588 31725 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.133586 31619 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.136554 31619 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:12.143019 31439 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.145013 31594 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.146387 31734 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.038751 31724 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.074584 31571 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.148504 31734 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.148736 31571 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:12.084144 31582 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:12:12.151795 31663 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.052062 31709 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:12:12.106010 31720 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.116693 31751 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:12.154207 31724 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.165787 31751 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.168357 31751 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.205528 27153 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:12.211372 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 987) took 1404 ms. Trace:
W20260709 13:12:12.211833 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 187948us
I20260709 13:12:12.214969 27224 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:12.217456 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:12.218508 27230 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:12.205844 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 214043us
I20260709 13:12:12.212270 27156 rpcz_store.cc:276] 0709 13:12:10.806372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.912132 (+105760us) service_pool.cc:224] Handling call
0709 13:12:10.912636 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:10.913331 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:11.080215 (+166884us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.640012 (+559797us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.640553 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.640701 (+   148us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:11.640736 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.640828 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.091474 (+450646us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:12.210297 (+118823us) raft_consensus.cc:1685] finished
0709 13:12:12.210542 (+   245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.210960 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":340444,"prepare.queue_time_us":270115,"prepare.run_cpu_time_us":1804,"prepare.run_wall_time_us":17978,"raft.queue_time_us":257923,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":4462,"spinlock_wait_cycles":2830720,"thread_start_us":472665,"threads_started":2,"wal-append.queue_time_us":390329}
W20260709 13:12:12.230202 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 219078us
I20260709 13:12:12.236953 27230 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:12.237488 27231 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:12.248894 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.253106 27837 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:12.260437 27304 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:12.260809 27807 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.625s (SENT)
I20260709 13:12:12.262074 31451 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:12.262764 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.262941 31451 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:12.263633 31451 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.266193 31594 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.267343 27300 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:12.115284 31424 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:12.270262 31424 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.270140 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:12.270934 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:12.155607 31582 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.269598 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:12.278726 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:12.279470 27302 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:12.280040 27835 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:12.280841 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.283828 27833 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:12.286600 31487 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:12.287173 27122 connection.cc:256] RPC call timeout handler was delayed by -1.3096847550000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 13:12:12.288841 27122 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:12.289651 31725 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:12.290772 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.290776 31725 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.292644 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.295176 31725 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.296155 31724 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:12.262157 31503 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:12.261766 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:12.311444 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2115) took 1806 ms. Trace:
I20260709 13:12:12.312012 31770 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.316459 31439 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.317605 27836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 931) took 2743 ms (client timeout 2094 ms). Trace:
I20260709 13:12:12.318852 31727 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:12.319594 31708 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:12.323772 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.323778 31724 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:12.337275 27836 rpcz_store.cc:269] 0709 13:12:09.573744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.582541 (+  8797us) service_pool.cc:224] Handling call
0709 13:12:12.317132 (+2734591us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54004bb254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:12.317335 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6120270592}
I20260709 13:12:12.353353 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.354704 31680 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.355209 31680 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:12.356501 31439 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.356706 31680 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.358974 31439 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:12.347626 31724 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:12.335319 27232 rpcz_store.cc:276] 0709 13:12:10.504818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.516620 (+ 11802us) service_pool.cc:224] Handling call
0709 13:12:10.819411 (+302791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:10.821966 (+  2555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:10.821998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.858155 (+ 36157us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.039661 (+181506us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:11.071124 (+ 31463us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.198435 (+127311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.198539 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.450175 (+251636us) raft_consensus.cc:1685] finished
0709 13:12:11.450214 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.615027 (+164813us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4800190158. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:12:11.611534 (+ -3493us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800390be0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:12.310958 (+699424us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400392bd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:12.311216 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95328,"prepare.queue_time_us":31135,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":8727,"raft.queue_time_us":94584,"raft.run_cpu_time_us":5648,"raft.run_wall_time_us":771893,"spinlock_wait_cycles":755032192,"thread_start_us":268566,"threads_started":2,"wal-append.queue_time_us":370188}
I20260709 13:12:12.361881 31439 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:12.362496 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 102111us
I20260709 13:12:12.364833 31487 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.353174 31770 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.368671 31770 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.267365 31594 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.374274 27836 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:12.369405 31581 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.375675 31594 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:12.376405 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 349626us
I20260709 13:12:12.377722 31430 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.378276 31430 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.378575 27838 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:12.391587 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 401166us
I20260709 13:12:12.392412 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.393564 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.394495 27232 raft_consensus.cc:2376] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10. Re-sending same reply.
W20260709 13:12:12.395138 27226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 960) took 1666 ms (client timeout 1625 ms). Trace:
W20260709 13:12:12.395615 27226 rpcz_store.cc:269] 0709 13:12:10.728794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.728957 (+   163us) service_pool.cc:224] Handling call
0709 13:12:12.394584 (+1665627us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54001db5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:12.394863 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966688640}
W20260709 13:12:12.397804 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.398453 31727 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.398802 27227 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:12.399211 31727 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.377578 31581 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:12.379982 31430 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.402475 31698 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:12.403748 31582 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.420063 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:12.422567 31675 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.422978 27836 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:12.423044 31675 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:12.424423 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.424674 31675 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.429426 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.418839 27838 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:12.437126 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 876) took 1457 ms. Trace:
I20260709 13:12:12.404707 31430 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.437614 27303 rpcz_store.cc:276] 0709 13:12:10.979569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.979693 (+   124us) service_pool.cc:224] Handling call
0709 13:12:10.979982 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.044139 (+ 64157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.436541 (+1392402us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b5400268ed4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:12.436902 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137579392}
I20260709 13:12:12.438990 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3153) took 1558 ms. Trace:
I20260709 13:12:12.439420 27227 rpcz_store.cc:276] 0709 13:12:10.880693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.011602 (+130909us) service_pool.cc:224] Handling call
0709 13:12:12.398255 (+1386653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.399461 (+  1206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.438793 (+ 39332us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001db5d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:12.438933 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187792128}
I20260709 13:12:12.405961 31680 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.443437 31719 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:12.444375 31719 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.446367 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:12.447495 27232 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:12.447566 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2347) took 1172 ms. Trace:
I20260709 13:12:12.449368 27305 rpcz_store.cc:276] 0709 13:12:11.274933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.277136 (+  2203us) service_pool.cc:224] Handling call
0709 13:12:12.437838 (+1160702us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800003398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12eee 0000000000375939 00007f9a56c861e0 00007f9a56d4f0c4 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:12.447457 (+  9619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48998656}
I20260709 13:12:12.455344 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:12.456606 27839 raft_consensus.cc:1217] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Deduplicated request from leader. Original: 8.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:12:12.457177 27839 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:12:12.457645 27837 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:12.461231 27833 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:12.462785 31727 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.463184 27306 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:12.464655 31180 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:12.465193 31180 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.471308 31180 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.472204 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2345) took 1287 ms. Trace:
I20260709 13:12:12.484171 27299 rpcz_store.cc:276] 0709 13:12:11.184149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.196783 (+ 12634us) service_pool.cc:224] Handling call
0709 13:12:11.197126 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.391471 (+194345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.391521 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:11.391581 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:11.391631 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.471689 (+1080058us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54003aa054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:12.471759 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.471989 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446335872}
W20260709 13:12:12.488999 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54670.9us
I20260709 13:12:12.491173 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:12.491955 27836 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.492986 31439 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.493686 31439 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.494344 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:12.497267 31760 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:12.498274 31760 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.501166 31418 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:12.502516 31669 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.503571 31675 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.503877 31729 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:12.504402 31714 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:12.504639 31729 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.505211 31714 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.505769 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.488099 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:12.520237 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 197294us
I20260709 13:12:12.515866 31180 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.508613 31451 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.487707 31594 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:12.546064 27223 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:12.549188 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.556516 27224 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 13:12:12.558303 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.559607 27232 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:12.562637 31724 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.563738 31433 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:12.565116 31433 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.565207 31724 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.565537 31433 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.572795 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2331) took 1586 ms. Trace:
I20260709 13:12:12.573222 27298 rpcz_store.cc:276] 0709 13:12:10.986385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.988972 (+  2587us) service_pool.cc:224] Handling call
0709 13:12:12.572370 (+1583398us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001cb1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:12.572591 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725821824}
I20260709 13:12:12.574234 31669 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.574965 31669 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.577409 31669 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.579031 31714 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.579716 31594 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:12.580948 31451 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.582271 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:12.583056 27156 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
W20260709 13:12:12.584549 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 68186.1us
I20260709 13:12:12.597162 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:12.607939 31776 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:12.610855 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:12.585351 31439 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.593612 31594 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:12.602106 31719 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.642767 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.643069 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.653246 27153 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:12.643754 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.644359 31729 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:12.646519 31433 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.643231 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:12.645696 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:12.653973 27223 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:12.678795 27149 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:12.679196 31760 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.653015 31299 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:12.669610 31503 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.658999 31416 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 13:12:12.680593 31553 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.557s	user 0.014s	sys 0.000s
I20260709 13:12:12.659605 31714 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:12:12.650693 27232 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:12.657720 31708 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:12.691332 31503 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:12.709981 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.710796 31503 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.716192 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:12.682804 27836 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:12.668181 27841 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:12.677224 27229 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:12.665334 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.645859 27228 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:12.666563 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:12.669350 27838 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:12.676507 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:12.570609 31424 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.664752 27195 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:12.718284 27228 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:12.631524 31724 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.699038 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:12.702224 31553 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.704157 31709 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:12.705379 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.706295 27226 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:12.629746 31206 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.239s
I20260709 13:12:12.754896 27837 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:12.759194 31430 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:12.759529 31751 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:12.760792 31299 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:12.761719 27833 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:12.762238 27225 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:12.762766 31747 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:12.763444 31729 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:12.766517 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:12.778985 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.659225 31733 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:12:12.791308 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:12.797226 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:12.735884 31709 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.797879 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:12.821389 27148 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:12.824517 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 275763us
I20260709 13:12:12.880667 27229 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:12.904273 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:12.837046 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 172463us
I20260709 13:12:12.792042 31433 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.823872 31487 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.877317 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.905838 31439 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:12.875063 31718 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.778s	user 0.020s	sys 0.004s
I20260709 13:12:12.876741 27155 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:12.941423 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 137428us
W20260709 13:12:12.950507 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 184293us
I20260709 13:12:12.962476 27055 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 6, term changed from 5 to 9, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:12.964982 31563 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.965587 31563 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.966892 31563 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.968901 31563 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.970939 31750 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:12.971498 31750 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:12.972888 31750 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:12.985921 31786 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:12:12.946751 27228 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:13.003909 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.004755 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.009557 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:12.994283 31760 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:12.987109 31299 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:13.035318 31784 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:13.035161 31520 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.998425 31503 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.030963 31418 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:13.052407 31418 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:13.054304 31180 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.055195 31180 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.055668 31520 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.059610 31520 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.060393 31520 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:12.987028 31709 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.037791 31299 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:13.112877 27152 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:13.119597 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:13.006354 31487 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:12.981730 31718 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.065615 31180 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:12.999109 31439 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.126119 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:13.127367 31299 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.123874 31760 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.148763 31760 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.130380 31424 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.130854 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:13.131858 31487 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.132633 27836 raft_consensus.cc:2410] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:12:13.132982 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.137022 27228 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.140717 27055 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.145474 27837 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:13.177486 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:13.168314 31733 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:13.203428 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 206371us
I20260709 13:12:13.133348 31669 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:12:13.202414 31675 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.007s
I20260709 13:12:13.222303 30717 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.222848 30717 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.223315 30717 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.196247 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:13.231850 27154 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:12:13.232489 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59752.2us
W20260709 13:12:13.235168 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 201822us
I20260709 13:12:13.216580 31750 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.237854 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:13.220729 31418 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.238408 31520 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.247949 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:13.248482 31724 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:13.248710 31484 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:12:13.205269 31424 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.217732 31487 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.267529 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:13.282887 31759 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:12:13.291966 27151 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:13.292387 31718 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.293191 31718 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:13.288193 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.284009 31430 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.315026 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 95546.6us
I20260709 13:12:13.284026 31487 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.310768 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.323217 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.290846 31520 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.296224 31418 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:13.334282 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.332163 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 84304.9us
I20260709 13:12:13.303280 31430 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.333894 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.314308 31669 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:12:13.340351 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.342248 31418 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.342445 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.342891 27303 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.343425 31727 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.344314 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.345388 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:13.375490 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.350829 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:13.354362 31789 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:12:13.356724 31751 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:13.362618 31788 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:12:13.372130 27807 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:13.375681 27297 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:13.384413 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.384507 31430 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.385006 31520 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.385578 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:13.385742 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55086.7us
I20260709 13:12:13.379788 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.387190 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.387987 27303 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:13.336024 31439 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.377504 31418 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:12:13.390414 31439 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.390923 31553 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.391841 31727 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.395303 31487 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.395915 31487 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:13.372740 27302 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:13.379734 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.407354 27297 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:13.413445 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:13.393894 31733 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.406643 30717 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.413997 31418 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:13.429265 27840 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:13.430543 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:13.431221 27841 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:13.431341 31430 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.432026 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:13.432093 31430 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.433171 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:13.433455 31738 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.411562 31553 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:13.434252 31553 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:13.435489 31553 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.437459 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.438265 27297 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:13.439389 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.440735 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:13.423020 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 77768.9us
I20260709 13:12:13.449749 27305 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:13.450205 27223 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:13.448549 27226 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.447855 27225 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:13.475181 27154 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:13.416178 31733 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.478303 31418 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.480374 31418 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.433951 31738 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.457265 31770 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:13.451447 31718 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.458171 31727 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.494220 27156 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:13.475780 31719 raft_consensus.cc:2764] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:13.473704 31708 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:13.445957 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:13.505048 27228 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:12:13.483177 31503 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:13.490206 31738 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:13.508087 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 337852us
I20260709 13:12:13.491159 31770 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:13.507853 27228 pending_rounds.cc:85] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 6
I20260709 13:12:13.516808 27227 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:13.513881 27228 pending_rounds.cc:107] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:12:13.521580 27228 raft_consensus.cc:2889] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:13.500049 31644 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:13.499508 31718 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.545229 31799 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:13.547664 31805 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.548633 31805 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:12:13.550966 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72045.6us
I20260709 13:12:13.555727 31805 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.556679 31805 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:13.547668 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 273882us
I20260709 13:12:13.564674 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:13.566290 31418 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.566838 31724 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:13.551334 31714 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:12:13.551672 31571 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.518901 31708 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.551170 31520 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.588102 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.566736 31813 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:12:13.595821 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:13.602494 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 175339us
I20260709 13:12:13.587603 31571 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:13.606726 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:13.620604 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 233987us
I20260709 13:12:13.635665 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:13.642252 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46556.5us
I20260709 13:12:13.643533 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:13.647828 31708 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.648224 31751 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.648696 31751 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:13.649068 31751 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:13.655318 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 498359us
I20260709 13:12:13.652303 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:13.609786 31520 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.604580 31770 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:13.666225 31563 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.697s	user 0.018s	sys 0.001s
I20260709 13:12:13.649639 31805 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.685032 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:13.693337 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 86693.2us
I20260709 13:12:13.694792 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:13.698578 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56564.5us
I20260709 13:12:13.699131 31675 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:13.703786 31795 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:12:13.704708 31520 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.707774 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.709054 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.709726 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:13.712724 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.680810 31804 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.668879 31708 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:13.678311 31727 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:12:13.723253 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50434.4us
I20260709 13:12:13.701668 31770 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.700249 31675 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:13.732963 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 48026.3us
I20260709 13:12:13.722944 31718 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.736147 31718 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:13.736577 31718 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.736960 31718 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:13.738543 31798 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:13.739430 31799 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:13.671782 31503 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.669384 31571 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.745604 31571 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.749099 31733 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:13.749804 31563 consensus_queue.cc:1175] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bc1278c649846e998b312b374274d08" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:12:13.752950 31794 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.373s	user 0.001s	sys 0.001s
I20260709 13:12:13.733357 31418 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.754824 31418 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.757200 31418 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:13.758802 31796 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
W20260709 13:12:13.759150 31791 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.499s	user 0.002s	sys 0.001s
W20260709 13:12:13.759585 31803 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:13.765625 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3189) took 1225 ms. Trace:
I20260709 13:12:13.759876 31800 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:13.760491 31680 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:13.765722 31553 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:13.766729 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.761106 31821 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:13.716917 31806 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:13.718901 31813 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.778254 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:13.767872 31433 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.818s	user 0.007s	sys 0.007s
I20260709 13:12:13.787140 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:13.781039 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49382.6us
I20260709 13:12:13.794577 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:13.795619 31824 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.774379 31680 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:13.815096 31750 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:12:13.815975 31680 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.817320 31680 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.766088 27230 rpcz_store.cc:276] 0709 13:12:12.540475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.540630 (+   155us) service_pool.cc:224] Handling call
0709 13:12:12.554400 (+ 13770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:12.601055 (+ 46655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.601109 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:12.647812 (+ 46703us) log.cc:844] Serialized 26 byte log entry
0709 13:12:13.105456 (+457644us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:13.105506 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.105589 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:13.758444 (+652855us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:13.765270 (+  6826us) raft_consensus.cc:1685] finished
0709 13:12:13.765300 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:13.765549 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25441,"raft.queue_time_us":33902,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":23484,"spinlock_wait_cycles":9885952,"thread_start_us":437507,"threads_started":1,"wal-append.queue_time_us":553651}
I20260709 13:12:13.821934 31439 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:13.779054 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60456us
I20260709 13:12:13.796880 31824 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:13.797703 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.798080 31818 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.828831 27299 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:13.798460 31206 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.802333 31820 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.803056 31821 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.814018 31751 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.836972 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:13.779608 31709 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:13.841168 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 162049us
I20260709 13:12:13.778744 31806 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:13.844034 27154 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:12:13.844985 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 150485us
I20260709 13:12:13.850208 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.852054 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.847784 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.857334 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:13.841989 31820 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.857743 27148 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:13.873267 27156 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:13.874111 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.874891 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.877221 27152 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:13.878700 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 100525us
I20260709 13:12:13.875831 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:13.860191 31750 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:13.884809 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 107341us
I20260709 13:12:13.885823 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.886844 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:13.889613 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.890196 27299 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:13.884918 27154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54872
I20260709 13:12:13.893216 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:13.893702 31418 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.894158 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:13.875895 31439 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:13.881594 31815 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.893172 27154 raft_consensus.cc:606] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:12:13.901866 31821 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.902235 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.903373 31751 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.903477 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.874869 31644 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.904263 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.868129 31206 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.904825 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.837647 31804 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:13.875826 31820 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.914091 31828 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.922118 27304 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:13.923601 27156 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:13.924456 27149 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:13.926211 27301 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: [8.8-12.10]
I20260709 13:12:13.882916 31738 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.944578 27305 raft_consensus.cc:2393] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:13.932735 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:13.923807 31418 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.947433 27155 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:12:13.950346 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56282.3us
I20260709 13:12:13.953466 31299 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.954152 31206 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:13.954777 31829 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.954957 31418 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.955293 31829 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.955693 31829 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.961244 27297 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:13.923879 31807 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.966043 30717 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:13.971505 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:13.969412 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.925907 31828 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:13.943766 31815 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:13.950829 31818 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:13.976622 31206 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:13.980222 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:13.978307 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 114654us
I20260709 13:12:13.984056 30717 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:13.932772 31180 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:13.924120 31439 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.966527 31821 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:13.988039 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 77156.3us
I20260709 13:12:13.972895 31751 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.990305 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.006315 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:13.967060 31807 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:13.987753 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:13.988790 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:14.002044 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:13.924239 31644 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:13.992187 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:13.992460 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.992884 31733 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.993589 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:13.985991 31206 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.993651 31831 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:12:13.995365 31825 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:13.990417 31815 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:13.978922 31799 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.981047 31828 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.022464 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.049213 27228 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:13.986562 31675 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:13.986454 31770 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.040458 27303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e37f81c47354aae99c01542f682acef"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:14.041345 27153 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:14.026628 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:14.063098 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44281.6us
I20260709 13:12:14.004521 31738 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.068568 27303 raft_consensus.cc:606] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:14.069162 27303 raft_consensus.cc:614] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.022562 31206 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:14.072247 27298 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:14.044286 31433 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:13.951256 31806 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.079911 30717 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:14.080230 31830 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.064894 31646 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:14.082178 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 55653.1us
W20260709 13:12:14.088126 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 217036us
I20260709 13:12:14.090358 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:14.093493 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:14.096493 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:14.062404 31439 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:14.012739 31751 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.099802 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:14.101652 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:14.060722 31815 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.080794 31830 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.112262 31646 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:14.118722 31646 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:14.119658 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 249725us
I20260709 13:12:14.120231 31830 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.120534 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:14.116030 31424 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.125092 31424 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:14.126336 31424 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.127233 31644 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.073073 31770 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.127996 31424 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.128468 31430 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.129086 31835 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:14.130543 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:14.097834 31838 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:14.147078 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64412.3us
W20260709 13:12:14.154505 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.079108 31433 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:14.156965 27224 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:14.074608 31813 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:14.156124 27055 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 11, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.172185 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.175827 27151 raft_consensus.cc:2410] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:14.173933 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:14.129658 31835 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:14.181756 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.146740 31669 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:14.190889 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.147745 31838 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.200968 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:14.166105 31433 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:14.195990 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:14.077116 31799 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.205261 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.168592 31644 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:14.204666 27055 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 8, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
W20260709 13:12:14.205905 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 104302us
I20260709 13:12:14.211539 27151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54872
I20260709 13:12:14.272163 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.205008 31770 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.374742 27150 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:14.273952 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 78076.4us
I20260709 13:12:14.110258 31807 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:14.317049 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 116194us
W20260709 13:12:14.284824 31827 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:12:14.177256 31724 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:14.286783 31751 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.167590 31834 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:14.178074 31815 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:14.290657 31813 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.206187 31180 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:14.198189 31669 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:14.362951 31738 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.386776 31806 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.429497 31738 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:14.431331 31841 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:14.314718 31644 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.432551 31807 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:14.433296 31846 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:14.434322 31644 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.435245 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.284166 31826 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:14.363996 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 154234us
I20260709 13:12:14.183779 31821 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:14.438853 31821 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:14.326843 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54343.4us
I20260709 13:12:14.201010 31838 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:14.443363 31714 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.443890 31714 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.444826 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:14.282122 31817 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.446933 31817 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:14.447129 31800 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:14.447800 31800 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:14.447538 31817 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.448915 31800 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.449604 31714 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:14.294607 31788 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:14.367991 31750 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.436671 31826 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:14.390185 31809 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:14.453405 31826 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.460879 27230 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.461781 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.462018 31817 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.462965 31799 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:14.390585 31646 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.394328 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:14.466032 27300 raft_consensus.cc:606] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:14.395192 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:14.396318 27305 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:12:14.468050 31718 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.731s	user 0.013s	sys 0.001s
I20260709 13:12:14.468564 31718 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.351397 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:14.470881 31820 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:12:14.471329 31820 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.473475 31820 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.474494 31646 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:14.407439 27306 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:14.477447 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:14.478214 27226 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.478623 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 880) took 1185 ms. Trace:
I20260709 13:12:14.479025 27306 rpcz_store.cc:276] 0709 13:12:13.293698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.298567 (+  4869us) service_pool.cc:224] Handling call
0709 13:12:14.478439 (+1179872us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001ca7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:14.478559 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864705792}
I20260709 13:12:14.480801 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:14.481362 27306 raft_consensus.cc:606] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:14.484946 31838 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.410655 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:14.493206 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 82629.8us
I20260709 13:12:14.494417 31838 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.494832 27151 raft_consensus.cc:606] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:14.495288 27151 raft_consensus.cc:614] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:14.495414 31848 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:12:14.421911 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 301437us
I20260709 13:12:14.496937 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.497196 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:14.497624 27148 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
W20260709 13:12:14.498241 31850 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.110s	user 0.004s	sys 0.000s
I20260709 13:12:14.498876 27804 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:14.501046 27804 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:14.425843 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.502534 31487 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.502622 31826 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:14.428570 31706 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:14.503403 31487 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:14.503804 31839 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.503930 31706 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:14.504243 31839 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:14.428803 31845 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.503252 31807 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.474435 31708 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:14.507426 31851 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:12:14.507828 31708 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.509984 31708 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.510458 31708 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:14.511433 31835 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:14.511721 27154 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:14.513182 31840 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:14.513622 31840 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:14.514632 31840 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.516054 31840 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.505292 31706 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.518256 31206 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.476416 31750 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.488603 27055 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.527112 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.491312 31738 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.401652 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:14.414291 31709 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:12:14.427577 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.409049 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:14.543061 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 134171us
I20260709 13:12:14.531908 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.531049 27227 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
W20260709 13:12:14.477384 31829 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.521s	user 0.015s	sys 0.000s
I20260709 13:12:14.551251 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.558997 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.536633 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.537503 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.560211 27148 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:14.538414 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.562460 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:14.539028 27050 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 380) took 29692 ms (client timeout 15000 ms). Trace:
I20260709 13:12:14.534720 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:14.535562 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.505280 31839 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.565603 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:14.514832 31708 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.552210 27153 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
W20260709 13:12:14.583555 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.584381 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:14.585457 27150 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:14.593099 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 191536us
I20260709 13:12:14.537503 27055 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 8, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:14.575971 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.529644 31180 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.529894 31669 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.561296 31563 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.605230 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.575135 31770 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.563951 31644 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:14.582602 31806 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:14.617286 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:14.617201 27807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.039s
I20260709 13:12:14.583159 31747 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:14.578276 31646 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:14.620589 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:14.623301 27807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.012s	sys 0.039s
I20260709 13:12:14.542567 31828 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.634927 27155 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.635663 27055 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.546185 31815 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.595934 31817 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:14.596405 31729 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:14.641369 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.590567 31571 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:12:14.542901 31834 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.596724 31180 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:14.560345 31829 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.671962 31206 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:14.672261 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.673650 27123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.422s (SENT) [suppressed 34 similar messages]
I20260709 13:12:14.619105 31839 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:14.676195 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47469.6us
I20260709 13:12:14.634245 31646 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.650554 31644 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.678301 31751 raft_consensus.cc:993] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:14.678972 31751 raft_consensus.cc:1081] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:14.678428 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.679714 27227 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:14.680141 31644 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.680701 27225 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:14.682987 27228 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:14.683301 31646 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.678973 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:14.684056 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.684391 27229 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.686383 31835 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.686947 31835 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.678329 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.651548 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.689421 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.666766 31669 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.627993 31747 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.671542 31815 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:14.643302 31817 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.673755 31829 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:14.660158 31834 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.641839 31708 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.701486 27055 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 7 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:14.699188 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 300033us
I20260709 13:12:14.619870 31563 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.741443 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:14.642683 31806 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:14.750881 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:14.749590 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 155348us
W20260709 13:12:14.757814 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.758894 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:14.758337 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.764009 27152 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:14.653901 31718 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.700199 31747 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.777961 27153 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:14.708860 31817 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.788401 27226 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:14.782325 27055 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 11, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.794358 27224 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:14.798511 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.709064 31807 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:14.752413 31852 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:14.749524 31845 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:14.813654 27055 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 11, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:14.754683 31847 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:14.819399 27150 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:14.710362 31729 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:14.820984 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:14.783277 31829 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.763870 31424 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:12:14.836858 27226 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.837648 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:14.843637 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.846135 27225 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:14.850314 27833 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:14.850616 27224 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:14.847402 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.846426 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:14.851167 27839 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:14.837124 27055 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 6, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 6 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.854054 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:14.855259 27306 raft_consensus.cc:606] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:14.855429 27835 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:14.855697 27306 raft_consensus.cc:614] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.854139 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.860664 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:14.861354 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 254569us
I20260709 13:12:14.846086 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.868417 27836 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.872658 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:14.831017 31751 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:14.876685 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:14.863185 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.842550 31856 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.885754 27224 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:14.881762 27840 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:14.824267 31807 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.880640 27055 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:14.885671 27835 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:14.894662 27837 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:12:14.901690 31854 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:14.902520 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.903434 31206 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:14.904429 31206 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:14.906270 31646 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.906198 31206 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:14.921707 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.922575 31857 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:14.823395 31845 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.832664 31847 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.891709 31424 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:14.931792 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.932688 27836 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:14.908463 31856 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.940191 27229 raft_consensus.cc:2410] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:14.951046 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.929613 31669 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.837951 31852 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:14.978979 27055 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:14.983951 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:14.987798 27055 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 7, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 7 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.993783 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.994804 27836 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:14.986027 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:14.996668 27835 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:14.564234 27050 rpcz_store.cc:269] 0709 13:11:44.846692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.846991 (+   299us) service_pool.cc:224] Handling call
0709 13:11:45.219373 (+372382us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:12:14.538786 (+29319413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:10.747469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:10.781651 (+ 34182us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:10.781689 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:12:10.781706 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:10.782834 (+  1128us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:10.782903 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:10.782932 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:12:10.788168 (+  5236us) tablet.cc:701] Row locks acquired
0709 13:12:10.788191 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:12:10.788380 (+   189us) write_op.cc:270] Start()
0709 13:12:10.788535 (+   155us) write_op.cc:276] Timestamp: P: 1783602730788312 usec, L: 0
0709 13:12:10.788558 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:10.821702 (+ 33144us) log.cc:844] Serialized 4407 byte log entry
0709 13:12:11.596617 (+774915us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b
0709 13:12:12.017120 (+420503us) op_driver.cc:464] REPLICATION: finished
0709 13:12:12.018559 (+  1439us) write_op.cc:301] APPLY: starting
0709 13:12:12.018664 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:12.164624 (+145960us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:12.164656 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:12.169886 (+  5230us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:12.170235 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:12:12.170306 (+    71us) write_op.cc:312] APPLY: finished
0709 13:12:12.170686 (+   380us) log.cc:844] Serialized 97 byte log entry
0709 13:12:12.170864 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:12.171035 (+   171us) write_op.cc:454] Released schema lock
0709 13:12:12.171093 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:12.415216 (+244123us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:12.415291 (+    75us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34012,"reported_tablets":44,"spinlock_wait_cycles":238808832,"child_traces":[["op",{"apply.queue_time_us":1134,"apply.run_cpu_time_us":15227,"apply.run_wall_time_us":396502,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45867,"num_ops":10,"prepare.queue_time_us":84521,"prepare.run_cpu_time_us":36345,"prepare.run_wall_time_us":1127916,"raft.queue_time_us":223328,"raft.run_cpu_time_us":1384,"raft.run_wall_time_us":1384,"replication_time_us":1228360,"spinlock_wait_cycles":23887104,"thread_start_us":1073299,"threads_started":4,"wal-append.queue_time_us":954052,"wal-append.run_cpu_time_us":9335,"wal-append.run_wall_time_us":1477067}]]}
I20260709 13:12:14.993235 27838 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:14.930392 31835 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:14.954372 31424 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.872543 31829 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.020540 27836 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:15.021991 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.023043 27232 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:15.005452 27055 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:15.007653 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:15.009271 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 427457us
I20260709 13:12:14.878268 31806 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.048118 27226 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:15.055019 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.055917 27837 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.952927 31751 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.026469 31818 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.059922 27841 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:15.068424 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.083174 31845 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.026957 31828 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.092190 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.098030 27833 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.099428 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.104846 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.106137 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.107846 27226 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:15.109328 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.127472 27155 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:15.113233 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.103642 31433 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.857s	user 0.013s	sys 0.000s
I20260709 13:12:15.085129 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.021096 31424 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:15.132269 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.138965 27305 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:15.106814 31800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.004s	sys 0.015s
I20260709 13:12:15.150255 27055 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.077545 31818 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.159054 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:15.152925 31800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.004s	sys 0.016s
I20260709 13:12:15.166601 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:15.167811 27155 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:15.135135 31847 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.182643 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.183660 27226 raft_consensus.cc:2376] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8. Re-sending same reply.
W20260709 13:12:15.185246 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 347681us
I20260709 13:12:15.188423 27055 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:15.181384 31770 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.002s
I20260709 13:12:15.145390 31433 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.196633 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.198628 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.198468 27305 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:15.199831 27300 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:15.200865 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.196058 27055 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 9, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.209683 27302 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:15.217492 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:15.218665 31870 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:15.218961 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.219601 27836 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:15.220498 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.224655 31829 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.225145 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.228166 31433 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:15.228597 31839 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.003s
I20260709 13:12:15.231194 31719 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:15.231781 31719 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:15.232791 31719 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.236411 31646 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.196388 31729 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.199196 31770 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.244151 27230 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:15.245536 31839 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:15.192586 31807 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.248757 31751 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:15.250955 31862 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:12:15.253311 31868 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:15.192085 31817 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:15.256436 31817 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.257401 27228 raft_consensus.cc:2368] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11.
I20260709 13:12:15.246629 31839 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.259701 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.261323 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:15.265151 31180 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.001s
I20260709 13:12:15.221308 27836 raft_consensus.cc:2410] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:15.274338 27833 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:15.274837 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.275074 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.275488 27232 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:15.275686 27229 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.276471 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.276517 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.277288 27224 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:15.283861 27229 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:15.285002 27837 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:15.287611 27299 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:15.290254 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:15.290769 27055 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 4, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 4 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.292202 27837 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:15.289690 31863 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.294345 31424 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:15.297545 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.300318 27302 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:15.302311 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.304455 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:15.306596 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:15.307402 27156 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.310040 27832 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.305266 27306 raft_consensus.cc:606] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.271127 31719 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.322299 27055 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 6, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:15.324404 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.290446 27836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:12:15.293774 31863 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.326830 27836 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.327417 27836 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.331235 27838 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:15.333148 31874 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:15.333508 31818 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.333815 31874 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:15.336385 31874 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.287688 31180 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.338840 31180 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.342453 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.350005 27834 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:15.355073 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.355098 27226 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:15.294395 31843 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:15.370245 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:15.311288 31852 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.355161 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:15.367039 27226 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:15.367985 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.364959 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:15.372615 27150 raft_consensus.cc:2410] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:12:15.369372 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 78934.3us
I20260709 13:12:15.367204 27055 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 8, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 8 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.287928 31831 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:12:15.370486 31563 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.371137 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:15.369872 31708 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.000s
I20260709 13:12:15.379765 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.372221 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:15.373679 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:15.384719 31852 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:15.384804 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:15.385283 31852 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:15.385479 27148 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:15.391002 27055 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 8, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 8 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.394440 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.380097 27836 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.329764 31863 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.398207 27232 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:15.402873 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.404011 27228 raft_consensus.cc:2410] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:15.407944 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.408761 27229 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:12:15.417200 27197 connection.cc:256] RPC call timeout handler was delayed by -1.9557413969998834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:12:15.424158 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.426460 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.426666 27838 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.423682 27055 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 6, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 6 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } }
I20260709 13:12:15.424474 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:15.428975 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.429690 27837 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:15.371294 31424 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.427084 27832 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:15.433780 27154 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:15.437137 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.437959 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.380187 31843 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:15.442705 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.448968 27832 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:15.435034 31747 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.626s	user 0.013s	sys 0.000s
I20260709 13:12:15.453390 27837 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:15.444444 27055 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 10, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 10 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:15.449990 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49814.4us
I20260709 13:12:15.421159 31831 consensus_queue.cc:1243] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:15.446892 27840 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:15.452742 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.453011 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.421447 31829 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.455916 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.455569 27055 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 9 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:15.456414 27227 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.428335 31430 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.456434 27224 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:15.431964 31839 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.469969 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:15.470283 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.468103 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.468591 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.455453 27223 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:15.471748 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.472628 27304 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12. Re-sending same reply.
I20260709 13:12:15.470991 27055 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:15.455181 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:15.475224 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.475409 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:15.423923 31724 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:15.471020 27297 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:15.474735 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.481010 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.482026 27299 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:15.482827 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.484117 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.485819 27304 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:15.486223 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.487236 27302 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:15.478345 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.479007 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.426002 31852 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.472292 31430 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.489156 31867 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:15.489647 31867 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:15.489693 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.490393 27297 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:15.450407 31669 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:12:15.491402 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.492201 27225 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:15.492528 27224 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:15.492970 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.493703 27841 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:15.488694 31843 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:15.488744 27300 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:15.434820 31840 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:12:15.453928 31818 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.494596 27055 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 3 to 6, term changed from 6 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to <none>, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130), VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:15.503172 27055 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:15.501847 31818 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.506737 31818 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.497355 31867 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:15.513967 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.516705 27300 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.480064 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:15.496393 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.468941 31747 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.520232 31747 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.450994 31424 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:15.525934 27305 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.527977 27838 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:15.528867 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.535900 27148 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:15.537402 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.538105 27837 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:15.539090 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.540198 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.540680 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.539348 31750 raft_consensus.cc:993] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:15.494205 31503 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.544196 27301 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:15.495118 31563 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:15.542587 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46278.2us
I20260709 13:12:15.549623 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.561570 27838 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:15.561947 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.562186 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.549633 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:15.552683 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.556396 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:15.552260 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 116272us
I20260709 13:12:15.471428 31831 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:12:15.568091 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.473260 31829 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.713701 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.635012 31724 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:15.685071 31817 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.639168 31838 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.667054 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.701030 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.610945 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:15.768765 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 124669us
I20260709 13:12:15.551739 31503 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:15.643772 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 81697.8us
I20260709 13:12:15.603474 31889 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:15.612023 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.638379 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:15.643222 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 163237us
W20260709 13:12:15.646092 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.622152 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:15.625451 27832 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:15.630426 27227 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:15.634400 31738 raft_consensus.cc:1081] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:15.660712 31747 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.626204 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.776655 27840 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:15.641304 27156 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:15.777928 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 209980us
I20260709 13:12:15.661877 31874 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:15.552484 31864 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.499800 31863 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:12:15.613381 31424 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:15.783751 31883 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:12:15.653487 31882 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:12:15.652398 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:15.785198 27229 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:15.785408 31888 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:15.773540 31503 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.748553 27149 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:15.787508 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.788344 27304 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:15.750763 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.708153 31823 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.790936 31823 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.779850 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.795379 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.767691 31433 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.797837 31433 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.800028 31433 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.781970 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.781658 31840 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:15.801338 31840 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:15.793753 31823 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.782673 31874 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:15.802623 31884 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:12:15.802431 31840 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.802673 31874 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.804597 31430 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.777298 31843 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:15.807560 31843 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:15.795617 31856 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.808604 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.809296 27299 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.810689 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:15.811046 31863 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:15.796012 31424 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.808286 31747 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:15.811515 31863 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:15.780421 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:15.821969 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 210044us
I20260709 13:12:15.813896 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.814208 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:15.815601 27229 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:15.813220 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.821995 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.831856 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:15.819675 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 209413us
I20260709 13:12:15.834314 27836 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:15.835884 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.833140 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:15.840308 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59971.9us
I20260709 13:12:15.841213 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:15.834355 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.843086 31424 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:15.819582 31669 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.841288 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.822242 31818 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.848639 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:15.848806 27303 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:15.849238 27300 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.845542 27299 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:15.849571 27300 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:15.823035 31856 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:15.777153 31817 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:15.858467 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44653.5us
I20260709 13:12:15.862914 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:15.863404 27304 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:15.833499 31889 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.866730 27299 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:15.865046 31750 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:15.836550 31852 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:15.867828 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:15.868743 31840 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.850706 31770 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:12:15.850505 31864 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.835453 31503 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.870711 27300 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.901540 27300 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.873502 31867 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.844247 31806 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:15.846652 31807 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:15.874413 31747 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:15.891912 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 47072.2us
I20260709 13:12:15.843636 31424 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:15.895403 27224 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:15.871730 31863 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.861886 31724 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.892822 31852 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:15.925976 31424 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.866878 31873 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:15.926913 31852 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.909535 27232 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:12:15.927677 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74494.6us
I20260709 13:12:15.875036 31751 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:15.931370 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.912356 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71187.3us
I20260709 13:12:15.848474 31839 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:15.917645 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:15.943730 31839 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:15.945232 31839 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.945583 31839 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:15.946825 31724 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:15.947255 31724 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:15.947624 31724 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.950122 31839 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.952841 31503 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.954816 31867 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.956763 31817 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:15.911289 31807 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:15.923806 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 82666.9us
I20260709 13:12:15.908651 31818 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.926373 31829 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:15.957723 31807 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.928767 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.955507 31839 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.969643 27300 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:15.933286 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:15.940646 31892 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:12:15.971527 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:15.907325 31847 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.942348 31806 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:15.959489 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:15.808492 31843 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.971676 31644 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.958426 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:15.972769 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:15.966012 31818 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:15.973515 31843 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.973487 31644 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:12:15.982698 31818 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.984184 31818 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.986532 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:15.910658 31864 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:15.998626 27299 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:15.998494 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.000968 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.002025 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:15.994035 31644 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:16.011503 31903 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:16.012786 27840 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:12:16.013175 27840 pending_rounds.cc:85] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 7
I20260709 13:12:16.013424 27840 pending_rounds.cc:107] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:12:16.013672 27840 raft_consensus.cc:2889] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:16.014848 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.015192 31903 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:16.016542 31903 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:16.019418 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46732.3us
I20260709 13:12:16.024457 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.025931 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:16.026499 27272 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:16.026652 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.029753 27303 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:16.004733 31847 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:15.990408 31856 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:16.019986 31894 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:16.036160 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.030799 27230 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:16.046542 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.972954 31817 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:12:16.003825 31829 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.030161 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1273) took 1186 ms. Trace:
I20260709 13:12:16.064056 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.068631 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.070446 27834 rpcz_store.cc:276] 0709 13:12:14.835897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.856727 (+ 20830us) service_pool.cc:224] Handling call
0709 13:12:16.021709 (+1164982us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400603954. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:16.021867 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848453888}
I20260709 13:12:16.032462 31865 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.031761 31899 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.080848 31910 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:16.028468 31901 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:16.083389 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 88476.9us
I20260709 13:12:16.056490 31873 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:16.057207 31847 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:16.066246 31503 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:16.092072 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:16.102142 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 204308us
I20260709 13:12:16.068070 31751 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:16.056546 31646 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:12:16.112480 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48495.3us
I20260709 13:12:16.109150 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:16.111057 31817 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:16.115700 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 182405us
I20260709 13:12:16.085886 31747 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.082010 31644 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:16.122350 27123 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.083993 31905 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:16.103403 31503 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.103171 31770 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.140302 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:16.129463 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 65469.4us
I20260709 13:12:16.141310 31847 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.142779 31847 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.144032 31905 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:16.155153 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46106.7us
I20260709 13:12:16.126391 31900 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.140195 31503 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.139400 31898 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.137871 31906 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:16.090394 31899 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.181495 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:16.172590 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67920.7us
I20260709 13:12:16.171463 31815 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.202781 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.175494 31910 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.210171 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.133075 31747 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.211282 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:16.231119 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.174230 31900 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.234997 31815 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.239995 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.244300 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:16.247236 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.151858 31856 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.188654 31915 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.271014 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.235543 31838 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:16.263437 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 107298us
I20260709 13:12:16.278209 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.280599 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.281087 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.281266 27837 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:16.271966 27841 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:16.285722 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.288764 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.289857 27836 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:16.260265 31900 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.209232 31644 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:16.272125 31905 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:16.311070 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:16.311738 31908 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:12:16.312070 31905 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.190109 31898 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.188382 31873 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.295536 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.263362 31918 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.311017 31913 raft_consensus.cc:2764] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:16.305912 27835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:12:16.331789 27835 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:16.332295 27835 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:16.274127 31922 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:16.246546 31815 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:16.283234 31853 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:16.315068 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 81505us
I20260709 13:12:16.231858 31751 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.286968 31912 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.305192 31847 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:16.308288 31806 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:16.349875 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 105694us
I20260709 13:12:16.352097 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.352450 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.355034 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.355726 27836 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:16.279196 31915 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:16.374413 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3198) took 1011 ms. Trace:
I20260709 13:12:16.374848 27149 rpcz_store.cc:276] 0709 13:12:15.363282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.364495 (+  1213us) service_pool.cc:224] Handling call
0709 13:12:15.379602 (+ 15107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:15.787075 (+407473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.371615 (+584540us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540012bbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:16.374347 (+  2732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437489920}
W20260709 13:12:16.378314 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 233819us
I20260709 13:12:16.379192 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:16.381078 27838 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.384951 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.385521 27150 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.385823 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.384145 27155 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:16.386763 27155 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:16.355507 31918 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.388420 27151 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:16.389032 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.349905 31922 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:16.373131 31907 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:16.357645 31806 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.389533 27149 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:16.378974 31910 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.427862 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.384302 31847 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.360180 31838 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:12:16.422884 27155 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:16.441249 27155 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.441968 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:16.476217 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.479458 27833 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:16.417055 31924 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.418076 31918 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:16.484400 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.430539 31806 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.488531 27150 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:16.439795 31917 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:16.556074 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 70203.3us
I20260709 13:12:16.556962 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:16.556878 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 361774us
I20260709 13:12:16.558579 27833 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:16.556353 27155 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:16.477638 31898 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.478255 31921 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.484881 31646 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.573051 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:16.573690 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 221308us
I20260709 13:12:16.575492 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.572675 27150 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.576553 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.560287 31813 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:16.559468 31917 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.582182 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.582752 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:16.588604 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.588478 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.589272 27150 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:16.570567 31936 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.563069 31899 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.444736 31910 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.563318 31911 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:16.560164 31913 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:16.594290 27149 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:16.610307 31915 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.636098 31918 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:16.617902 31874 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.813s	user 0.008s	sys 0.002s
I20260709 13:12:16.586716 31930 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:16.581274 31917 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:16.601083 31843 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.008s
I20260709 13:12:16.579365 31813 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:16.602321 31938 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.602780 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.552587 31924 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.578925 31922 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:16.637470 31839 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.661s	user 0.002s	sys 0.010s
I20260709 13:12:16.629801 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.670328 27151 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:12:16.626662 31724 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.003s
I20260709 13:12:16.695983 31724 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.622828 31815 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.644742 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.698010 27148 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:16.592808 31847 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:16.661895 31874 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.637961 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.639659 27835 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.638655 31563 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.619012 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:16.719816 27832 raft_consensus.cc:2410] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:16.671665 27155 raft_consensus.cc:2410] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:12:16.673112 31901 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:16.673949 31924 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.637938 31906 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.638172 31936 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.676257 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:16.735971 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.736112 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1002) took 1125 ms. Trace:
I20260709 13:12:16.609256 31503 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.577381 31921 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.745783 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:16.746615 31852 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.819s	user 0.015s	sys 0.006s
I20260709 13:12:16.747004 31921 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.747305 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 991) took 1295 ms. Trace:
I20260709 13:12:16.747697 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:16.741659 31930 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.748383 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.747699 27226 rpcz_store.cc:276] 0709 13:12:15.452057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.452217 (+   160us) service_pool.cc:224] Handling call
0709 13:12:16.618858 (+1166641us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:16.747246 (+128388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3434240}
I20260709 13:12:16.688959 31923 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:16.751700 31503 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:16.752863 27103 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1010256288ec4502b330749e2e3d7c85 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:16.753381 27103 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:12:16.753705 27103 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:16.701905 31874 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.748394 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.759183 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:16.686576 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:16.717171 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.761346 27230 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:12:16.761852 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44796.6us
W20260709 13:12:16.707331 31807 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 13:12:16.717458 27305 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:16.741642 27835 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.736708 27228 rpcz_store.cc:276] 0709 13:12:15.610935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.638909 (+ 27974us) service_pool.cc:224] Handling call
0709 13:12:16.676117 (+1037208us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12eee 0000000000375939 00007f9a56c861e0 00007f9a56d4f0c4 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:16.736038 (+ 59921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476672}
W20260709 13:12:16.741564 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 356587us
W20260709 13:12:16.706693 31880 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:12:16.749095 31930 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.738538 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:16.731201 31563 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:16.763918 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:16.730877 31818 consensus_meta.cc:287] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.005s
I20260709 13:12:16.772411 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:16.730798 31817 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:12:16.776832 27834 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:12:16.708755 31747 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.778869 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:16.784713 27152 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:16.787917 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.788663 27301 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:16.791429 27301 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:16.791775 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.732543 31901 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:16.735162 31847 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:16.809250 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.836704 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.839049 27148 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:16.794950 31874 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:16.780339 31180 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:16.845100 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.846479 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.847965 27149 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:16.808776 31770 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.836755 31724 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.775674 31807 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.855741 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.747015 31852 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.702582 31813 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.789422 31817 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.864100 27305 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:16.795056 31926 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:16.844507 31874 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:16.871659 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.884259 27148 raft_consensus.cc:2376] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10. Re-sending same reply.
I20260709 13:12:16.885226 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.885798 27148 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:16.809695 31838 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:16.705507 31938 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.810375 31206 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:12:16.875599 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 103261us
I20260709 13:12:16.871866 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.889950 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.890323 27149 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.890760 31770 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.891095 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:16.892274 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.882470 31932 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.883637 27840 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:16.907675 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.909415 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.882906 31847 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.902249 31901 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.913076 31901 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.913115 31932 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.915495 31852 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.916041 31932 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.917454 31938 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:16.918645 31929 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:16.919063 31929 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.919407 31929 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.919585 31864 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:16.922024 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.922422 31919 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:16.923360 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.923897 27153 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:16.877162 31719 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:12:16.927533 31898 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:16.928350 31898 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:16.923919 31919 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:16.934042 31919 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:16.929775 31898 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.935702 31806 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:16.938091 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.938818 27838 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:16.939898 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:16.940896 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 48682.6us
I20260709 13:12:16.941058 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.944042 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:16.945869 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:16.951222 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:16.951787 27223 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.954334 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:16.958498 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.962015 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:16.962601 27299 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:16.962906 27299 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:16.965327 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.965883 27834 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:16.966396 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:16.967204 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:16.961066 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.970001 27226 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:16.970935 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:16.976123 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:16.979421 27149 raft_consensus.cc:2410] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:16.980654 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:16.981485 31829 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.937901 31806 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:16.963577 27299 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:16.984038 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:16.984490 27299 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:16.985668 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:16.986179 27303 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:16.986754 27300 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:16.987149 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.989907 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:16.984524 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:16.973472 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 111021us
I20260709 13:12:16.995400 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:16.996196 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:16.948259 31918 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:16.998332 27841 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:16.948282 31815 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.015064 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:16.971558 31900 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:17.017696 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:16.972206 31921 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.020334 27834 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.972615 31938 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:17.023676 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.024288 27230 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:17.024693 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:16.973694 31852 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:17.029546 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.030292 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.038162 31503 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:17.073042 27229 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:17.041600 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:17.073141 27149 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:17.042331 31807 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.043200 31913 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:17.044625 27834 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:12:17.044715 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60798.3us
I20260709 13:12:17.076045 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:16.987941 31856 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:17.046909 27299 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:17.050351 31911 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.050956 31818 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.054260 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.052270 31917 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.055033 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.098520 27224 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.080066 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:17.053931 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.100066 27225 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:17.055584 27230 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:17.059818 31942 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:17.060357 31938 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:16.968816 31912 consensus_queue.cc:1175] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4afe81810944d70bc2cc31754392f3d" responder_term: 15 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: [14.13-14.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:17.022887 31770 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.065900 31874 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.065824 27232 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:12:17.012854 31940 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.136296 31919 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.044724 31863 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.138441 31910 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.139397 31930 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.084600 31913 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:16.972960 31916 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:17.077080 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 911) took 1116 ms. Trace:
I20260709 13:12:17.140628 31913 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.141281 27304 rpcz_store.cc:276] 0709 13:12:15.961002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.961195 (+   193us) service_pool.cc:224] Handling call
0709 13:12:15.961660 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.966806 (+  5146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.966854 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.967506 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.707639 (+740133us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b180044a580. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:12:16.865104 (+157465us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:16.865144 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.865209 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:17.072111 (+206902us) raft_consensus.cc:1685] finished
0709 13:12:17.072129 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:17.077010 (+  4881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4690,"raft.queue_time_us":4815,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":6396,"spinlock_wait_cycles":27664640,"thread_start_us":157300,"threads_started":1,"wal-append.queue_time_us":1035680}
I20260709 13:12:17.045240 31867 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.077986 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:17.078248 27153 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:17.084575 27223 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:17.020167 31900 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:16.973479 31902 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
I20260709 13:12:17.087517 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.153043 27229 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:17.089195 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.100117 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.153978 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
W20260709 13:12:17.113147 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.154407 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54392.1us
I20260709 13:12:17.114850 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.115545 27230 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:17.080011 31925 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.082389 31571 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:17.120591 27232 pending_rounds.cc:85] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 8
I20260709 13:12:17.083385 31852 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:17.088462 31911 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.123200 31938 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:17.126176 31942 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.132318 31917 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:17.147081 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69154.6us
I20260709 13:12:17.143600 31867 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.195150 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:17.073431 31921 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:17.158850 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 187970us
I20260709 13:12:17.115061 31899 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.164812 27232 pending_rounds.cc:107] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:17.211998 27232 raft_consensus.cc:2889] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:17.116786 31936 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.153553 31900 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.196396 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:17.204900 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:17.206498 27834 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:17.120602 31563 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.210883 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.158217 31914 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:17.172915 31571 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.088287 31818 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.157554 31925 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.208500 31867 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.233844 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.209472 31770 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.238595 27306 raft_consensus.cc:2368] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:17.211956 31899 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.233577 31815 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.245522 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.230729 31940 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.250590 27223 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:17.244521 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.251071 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.251919 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.240097 27224 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: [5.7-8.9]
I20260709 13:12:17.254470 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.312824 27230 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:17.256245 27227 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: [5.7-9.8]
I20260709 13:12:17.240127 31571 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.237629 31914 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:17.324157 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.326834 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:17.346771 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.346859 27231 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:17.243278 31919 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.351626 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.248895 31925 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.348454 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.361588 27223 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:17.348605 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:17.248644 31902 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:17.357576 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 113101us
I20260709 13:12:17.359565 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.363212 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.363502 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:17.364478 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 113477us
I20260709 13:12:17.364951 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:17.258737 31899 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.366997 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.368182 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.368736 27230 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.369275 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.309258 31940 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.375162 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:17.346189 31914 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.375948 27834 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:17.372048 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:17.381928 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.378180 31915 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:12:17.385192 31958 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:12:17.385612 31915 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:17.386525 31915 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:17.386843 31915 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:17.372150 31930 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:17.387614 31915 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.370566 31856 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.388895 31915 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.384392 31724 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:17.393168 31921 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:17.253738 31929 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.395473 31929 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.350132 31852 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.370244 31847 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.414575 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:17.366923 31960 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:17.370428 31843 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.418829 27123 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:17.378347 31916 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.379846 31940 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.400091 31903 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.401919 31919 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.494377 31919 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.446210 31933 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:17.454259 31840 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.498517 31933 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.498667 31840 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.501411 31840 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:17.456183 31957 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:12:17.462868 31563 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.463423 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:17.503674 27229 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:17.509052 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.509794 31806 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.510468 31806 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.512840 27229 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:17.513038 31806 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.514313 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:17.515594 31563 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:17.516193 31563 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:17.464725 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 45966.7us
I20260709 13:12:17.465567 31898 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.467027 31646 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:17.467523 31751 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:17.520994 31751 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.523689 31751 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:17.466904 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52406us
I20260709 13:12:17.424013 31930 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:17.525837 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:17.526093 31930 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:17.526678 31930 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.531507 27271 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:17.416862 31902 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:17.532513 31902 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:17.533648 31902 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.478175 31911 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.376148 31503 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:12:17.447942 31903 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:17.483399 31942 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.448365 31960 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:17.447175 31910 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:17.497632 31919 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.517233 31563 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.541193 27230 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:17.520296 31867 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.501446 31933 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.547811 31903 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.552416 31751 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:17.573856 31813 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:17.561121 31747 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.582885 31747 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:17.585379 27839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1285) took 1585 ms (client timeout 1852 ms). Trace:
W20260709 13:12:17.585788 27839 rpcz_store.cc:269] 0709 13:12:16.000492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.000664 (+   172us) service_pool.cc:224] Handling call
0709 13:12:17.585187 (+1584523us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54003377d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:17.585316 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983310720}
I20260709 13:12:17.585402 31747 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.591711 31960 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.547763 31299 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:17.603886 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:17.604470 27153 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.608831 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.609470 27157 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:17.617933 27153 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:17.623066 31818 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.628062 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.628783 27300 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:17.629002 31924 raft_consensus.cc:993] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower f4afe81810944d70bc2cc31754392f3d to start an election
W20260709 13:12:17.628813 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.639992 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.640592 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.641876 27303 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:17.629505 31924 raft_consensus.cc:1081] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Signalling peer f4afe81810944d70bc2cc31754392f3d to start an election
I20260709 13:12:17.644420 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:17.645375 31905 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:17.645825 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:17.646214 27232 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:17.647488 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.648442 31906 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:17.663013 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:17.667889 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 101083us
I20260709 13:12:17.661959 31669 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:12:17.675559 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.676247 27298 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:17.678339 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:17.645391 31751 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:17.662289 31889 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:17.698422 31912 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.714913 31863 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.008s
I20260709 13:12:17.705003 31889 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.733400 27302 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:12:17.727393 31843 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:17.733269 31889 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:17.734107 31729 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.750615 31729 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.715219 31900 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.768479 27297 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.729423 31571 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:17.775302 31975 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:12:17.775492 31972 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:12:17.742950 31847 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.731752 31912 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.778489 27156 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:17.764057 31424 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:17.783941 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 79886.8us
W20260709 13:12:17.785758 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 413744us
I20260709 13:12:17.787146 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:17.789381 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:17.798684 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.801999 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:17.803350 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:17.805310 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:17.805773 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.782392 31751 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.807699 27157 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:17.799124 31852 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:17.811439 27122 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Timed out: RequestConsensusVote RPC to 127.25.109.132:42741 timed out after 1.852s (SENT)
I20260709 13:12:17.813803 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.814258 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:17.803192 31920 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:17.820128 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.823067 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.824312 31847 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.824572 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.824842 31847 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.826900 31847 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.827495 31902 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.808588 31865 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:17.830994 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 455850us
I20260709 13:12:17.794288 31424 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.798255 31916 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:12:17.810173 31433 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:17.842298 31424 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.842437 31433 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:17.843526 31900 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.837165 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:17.837445 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.838083 27298 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:17.838348 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.839006 27303 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:17.846405 27304 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:17.839745 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.840334 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.840405 31912 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.838943 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.847654 27149 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:17.801744 31940 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.813659 31852 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.851992 27149 pending_rounds.cc:85] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 8
I20260709 13:12:17.857149 27149 pending_rounds.cc:107] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:17.857426 27149 raft_consensus.cc:2889] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:17.849943 31977 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:17.843433 31433 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.864675 31847 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.818845 31839 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:17.819521 31843 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:17.855279 27153 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:17.836135 31913 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.870571 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.871138 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.836464 31865 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.871958 27835 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:17.873773 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:17.874537 27835 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.876785 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.861065 31852 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.856489 31920 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:17.880159 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.877427 27157 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:17.829123 31925 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.865180 31916 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.850971 31899 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.886551 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.888849 27841 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:17.888950 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:17.897210 27157 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:17.873850 31865 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:17.867899 31818 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:17.902467 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.906628 27836 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:17.904902 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:17.904326 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.910192 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:17.913465 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:17.915652 31424 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:17.915825 27157 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:17.916473 31750 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.878345 31913 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.916970 31571 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.917006 31750 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.917737 31900 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:17.918318 31900 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:17.903422 31912 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.918692 31900 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.918977 31912 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.919378 31912 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.919477 31750 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:17.886617 31916 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.917786 31571 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.922796 31571 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.924031 27837 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:17.925259 31571 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.929394 31913 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.932511 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:17.931440 31900 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.872784 31847 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.887475 31180 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:17.957530 27835 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:17.959573 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:17.961650 27157 raft_consensus.cc:2410] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:12:17.887295 31914 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.964457 31940 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.964583 31914 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.966189 31903 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.967892 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.969614 27833 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:17.970163 31180 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:17.972185 31180 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:17.972865 31930 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:17.974700 31987 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:17.974839 27832 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
W20260709 13:12:17.981272 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.986217 31988 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.986804 31988 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.987445 31925 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:17.988998 31988 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.990131 31903 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.990990 31847 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:17.986236 31920 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:17.995669 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.996021 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.997292 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:17.997452 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:17.997961 27832 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:17.998906 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:17.999349 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.014415 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.015161 27301 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:18.018607 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.020445 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:18.022010 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:18.024060 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:17.981537 31889 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.019414 27298 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:18.017370 31818 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.044533 27197 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:18.040275 31942 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.041388 31913 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.039919 31940 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:18.013933 31988 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:18.043768 31911 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.058935 31919 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.044090 31964 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:12:18.057870 31914 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:18.043486 31818 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.064455 31960 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.057176 31942 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.089923 31914 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:18.110765 31818 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.106076 31912 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.116503 31912 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.118160 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.097940 31930 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.124714 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.130864 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.131569 27297 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:18.141060 31911 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:18.141534 31911 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:18.142418 31911 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.143616 31911 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:18.145328 31993 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:18.145640 27297 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:18.146313 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.147274 27298 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:18.147564 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 103131us
I20260709 13:12:18.123262 31900 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.162963 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:18.165884 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:18.166198 31813 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:18.166806 31813 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:18.167690 31813 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.169430 27298 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:18.179430 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:18.179862 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.180459 27834 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:18.146432 31912 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.178315 31889 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.183450 31900 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:18.262785 27834 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:18.184587 31913 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.180131 31865 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.185746 31912 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:18.300410 31913 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:18.322711 31998 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:12:18.324252 31999 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:12:18.325642 31992 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:12:18.308120 31900 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:18.328145 31912 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:18.330314 31865 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:18.322711 31994 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:12:18.300096 31847 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:18.337611 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.328208 31900 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.344884 31852 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.350445 31942 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.317611 31964 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.335836 31913 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.339507 31847 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.370929 31847 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:18.367995 31964 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.374395 31964 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.375501 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:18.398221 31916 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:18.416905 31729 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.421689 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3286) took 1089 ms. Trace:
I20260709 13:12:18.422125 27226 rpcz_store.cc:276] 0709 13:12:17.331957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.371238 (+ 39281us) service_pool.cc:224] Handling call
0709 13:12:17.408405 (+ 37167us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:17.534414 (+126009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.534460 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:17.535256 (+   796us) log.cc:844] Serialized 52 byte log entry
0709 13:12:17.706853 (+171597us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:17.706894 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.421114 (+714220us) spinlock_profiling.cc:243] Waited 87.2 ms on lock 0x7b54002288d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:18.421163 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.421209 (+    46us) raft_consensus.cc:1685] finished
0709 13:12:18.421223 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.421622 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38311,"raft.queue_time_us":39799,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10737,"spinlock_wait_cycles":200445312,"thread_start_us":171184,"threads_started":1,"wal-append.queue_time_us":267732}
W20260709 13:12:18.423305 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.424429 31867 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.427695 27152 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:18.429149 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.430339 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.430454 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.430962 27225 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.430485 31899 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:18.429956 27232 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.434441 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.437918 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.438795 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:18.439790 31913 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.440040 31899 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:18.440042 27232 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:18.443419 31988 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:18.444191 31988 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.444608 31988 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.445046 31988 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.446528 31916 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:12:18.446933 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 260899us
I20260709 13:12:18.448453 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.449085 27223 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:18.450651 31900 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.451152 31900 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.452086 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.452945 27226 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:18.452896 31889 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.440706 31902 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:18.460067 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.460389 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.461220 27223 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:18.461424 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.462255 27229 raft_consensus.cc:2410] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:12:18.466600 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.453625 31889 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.466984 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:18.528263 27150 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 5.
I20260709 13:12:18.467133 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.467687 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.462554 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.453562 31900 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:18.523569 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.529053 27305 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:18.467149 31942 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:12:18.524860 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:18.533223 27302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2140) took 1750 ms (client timeout 2044 ms). Trace:
I20260709 13:12:18.533455 27229 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:12:18.533787 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:18.533601 27302 rpcz_store.cc:269] 0709 13:12:16.782625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.782788 (+   163us) service_pool.cc:224] Handling call
0709 13:12:18.533077 (+1750289us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54000a4e54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:18.533172 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119894784}
I20260709 13:12:18.534348 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.525185 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:18.534901 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:18.535617 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.536139 27231 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.525478 27154 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:18.526141 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.465979 27303 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:18.529600 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:18.531942 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 1.15279e+06us
I20260709 13:12:18.538905 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.540848 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.539435 27227 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:18.542557 27229 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:18.540525 31899 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.543433 27806 leader_election.cc:400] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:18.543735 27806 leader_election.cc:403] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.545536 27305 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:18.544446 27195 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:18.547037 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.547061 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.550876 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:18.553140 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:18.554786 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:18.541009 31880 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:18.567408 27229 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:18.552412 31940 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:18.580332 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 155333us
I20260709 13:12:18.545662 31899 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:18.585434 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.586113 27302 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:18.586796 27225 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:18.571550 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1024) took 1666 ms. Trace:
I20260709 13:12:18.587881 27232 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:18.587739 27156 rpcz_store.cc:276] 0709 13:12:16.905388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.042857 (+137469us) service_pool.cc:224] Handling call
0709 13:12:17.043175 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.784881 (+741706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.571238 (+786357us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540012cad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:18.571454 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690607360}
I20260709 13:12:18.591647 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:18.593137 31299 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:18.593751 31299 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:18.594841 31299 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.565485 31964 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.565743 31912 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.556526 31900 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.557091 31813 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:18.543301 31916 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:18.568650 31424 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.612524 32015 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.567355 31880 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:18.588467 31902 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.587255 31943 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:18.582659 31940 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:18.588002 31899 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.604561 31964 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:18.620111 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 79975.5us
W20260709 13:12:18.621292 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 74371us
I20260709 13:12:18.622375 31940 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.570681 31922 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:12:18.613428 31813 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:18.608088 31913 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.600819 31920 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:18.604447 31912 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.617977 31852 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.614372 31894 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.619310 31900 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.627365 31964 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.629504 31916 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:18.639101 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.619753 31424 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.633154 31813 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.640688 31940 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.631192 31943 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:12:18.654219 27231 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:18.638113 31912 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.640806 31900 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.640275 31922 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:18.621335 32015 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.647024 31852 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.676280 31852 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.678404 31852 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.637974 31930 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:12:18.679739 31930 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:18.680120 31930 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.681049 31930 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.653389 31916 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.682729 31916 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.683876 31916 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.685806 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.686589 27225 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:18.669687 31424 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.688251 32015 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.675494 31900 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.667078 31922 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:18.688722 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.689265 27302 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.689497 31922 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.690732 31922 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.686452 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.669157 31943 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:18.694845 31943 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.695683 31943 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.696964 31943 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.699993 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.701402 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.709728 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:18.723413 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 92654.6us
W20260709 13:12:18.725297 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 180941us
I20260709 13:12:18.727725 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.641368 31894 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.735297 27303 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:18.739640 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 100616us
I20260709 13:12:18.744026 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.744715 27303 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:12:18.715220 31424 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:18.750296 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:18.750486 27306 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:18.746461 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.717550 31889 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.717298 32011 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:18.663450 32014 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:18.728653 31930 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.751389 27305 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:12:18.745553 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.760094 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.753887 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.766505 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.767287 27834 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:18.734216 31900 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:18.750345 31424 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:18.768576 31424 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.771973 27833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489"
dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:12:18.772922 27833 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:18.773262 27833 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.771723 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:18.755151 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.775188 27306 raft_consensus.cc:2368] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:18.744418 32015 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:12:18.776597 32015 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:18.776942 32015 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.777271 32015 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.746474 32001 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:12:18.778697 32001 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:18.779062 32001 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:18.730211 31852 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:18.758090 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.778708 27838 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:18.781038 27833 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.779870 32001 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.783023 27833 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.783406 32001 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.784011 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.784716 27833 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:18.785425 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.758212 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:18.761790 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.763140 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.781845 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.786561 27838 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:18.786710 27839 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:18.744227 32004 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:18.787339 31852 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.787961 31852 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.779846 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.787575 32004 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.789078 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:18.788861 31852 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.789618 27231 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.790179 32004 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.775480 27835 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:18.791323 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:18.793259 32029 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.793859 32029 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.794909 27223 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:18.796379 32029 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:18.797096 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:18.796931 32015 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.801584 32015 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:18.802870 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.804656 27835 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 5: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:18.806159 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.806316 27231 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:18.807380 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:18.812749 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.818549 32029 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:18.829555 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.830571 27298 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:18.835208 27304 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:18.837004 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.837882 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.840093 27297 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:18.659651 31880 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.844502 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.845186 27223 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:18.847218 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:18.847952 27304 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:18.843379 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:18.849104 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 119587us
I20260709 13:12:18.759338 32011 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.863480 32029 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:18.863559 31912 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.864188 32029 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:18.867707 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.869184 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.854765 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:18.899166 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:18.865814 31912 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:18.907455 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 100167us
I20260709 13:12:18.907999 27297 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 5.
I20260709 13:12:18.865084 32029 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:18.912822 27231 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:18.903033 31982 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:18.919999 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.897423 31889 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:18.914834 27302 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:18.866120 31503 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:12:18.902863 31935 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:18.928537 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:18.915403 31880 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:18.986644 32012 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 13:12:18.927420 31912 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.001986 31935 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:19.011395 31935 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.012816 31914 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:18.998258 31983 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:19.001901 32011 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.014847 31983 consensus_queue.cc:1243] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:19.015276 32011 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.015328 31983 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:19.016098 31983 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:19.016927 31983 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.018034 31983 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:19.018451 32013 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:12:19.021854 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2182) took 1782 ms. Trace:
I20260709 13:12:19.022241 27228 rpcz_store.cc:276] 0709 13:12:17.239187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.240575 (+  1388us) service_pool.cc:224] Handling call
0709 13:12:17.259691 (+ 19116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.383488 (+123797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.383519 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.408158 (+ 24639us) log.cc:844] Serialized 26 byte log entry
0709 13:12:17.715909 (+307751us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:17.715984 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.021443 (+1305459us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001261d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:19.021501 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.021547 (+    46us) raft_consensus.cc:1685] finished
0709 13:12:19.021559 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.021797 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16340,"raft.queue_time_us":5932,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":11920,"spinlock_wait_cycles":247860608,"thread_start_us":240623,"threads_started":1,"wal-append.queue_time_us":361732,"wal-append.run_cpu_time_us":5032,"wal-append.run_wall_time_us":1181534}
I20260709 13:12:19.025807 27152 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:19.033624 27151 raft_consensus.cc:2410] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:19.046542 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:19.046489 31964 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.049525 31964 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.050289 32019 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:19.050530 31960 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:19.051604 32019 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.052376 31847 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:19.052898 31847 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:19.053905 31847 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.055437 31847 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.917235 31424 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:19.060247 31424 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.050374 32011 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:12:19.064805 31813 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.051657 31960 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:19.102149 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.103219 27305 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:19.103368 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:19.104182 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:19.104804 27302 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:19.106909 31913 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:19.107450 31913 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.109505 31913 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:19.110193 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.111277 31988 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
I20260709 13:12:19.111665 31988 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.112176 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:19.113090 31935 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:19.114509 31912 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.115168 31912 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:19.115579 31912 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:19.120018 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.120817 27149 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:19.120959 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.121937 27152 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:19.124516 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:19.128931 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.129525 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.130220 27153 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.135007 27155 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:19.139858 31889 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:19.140547 31889 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:19.142920 32015 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.143500 32015 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.154451 31900 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.155224 31900 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.052348 32019 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.159016 32019 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.071951 31960 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:19.167263 31960 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.178905 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.000707 32030 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.186460 27305 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.113788 31988 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.177486 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:19.190131 32030 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.190816 31935 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:19.169490 31960 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.193706 31900 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:19.195596 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.927639 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:19.198421 27297 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:19.202032 27153 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:19.191254 31935 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.179768 32015 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:19.223685 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 369002us
I20260709 13:12:19.141570 31889 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.192999 31894 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.235008 27149 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:19.214771 31916 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.218822 31900 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.237000 27149 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:19.253080 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.254041 27195 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:19.208505 31922 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.201818 27297 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:19.222148 31935 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.278192 27225 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:19.278242 27149 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:12:19.175205 31912 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.289172 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.289677 27150 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: [10.10-12.11]
W20260709 13:12:19.234701 31902 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
W20260709 13:12:19.232102 31899 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.002s
I20260709 13:12:19.283386 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.299535 27225 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:19.300117 27152 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:19.205006 31964 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:19.291285 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.289922 27149 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 5.
I20260709 13:12:19.285681 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.284543 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.304508 27155 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:19.298552 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.290575 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.305954 27156 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.282894 27297 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.285941 31729 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.310084 31919 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:19.332103 31919 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:19.333220 31919 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:19.334502 32023 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:19.311694 31988 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:12:19.319535 32001 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:12:19.309681 31180 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.343894 31180 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.347543 31914 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.309444 31905 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.310333 31902 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:19.311295 32011 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:12:19.308885 31847 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:12:19.309626 31922 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:19.327737 31943 consensus_meta.cc:287] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.005s
W20260709 13:12:19.328264 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.328063 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.375893 27150 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.282358 31916 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.366727 27156 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:12:19.364874 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 318384us
I20260709 13:12:19.310240 31899 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.378834 32011 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:19.379009 31180 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.379336 32009 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:19.380141 27839 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:19.382817 27806 leader_election.cc:400] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:19.384807 27156 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:12:19.387773 27806 leader_election.cc:403] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:19.387892 27156 pending_rounds.cc:85] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 7
I20260709 13:12:19.388408 27156 pending_rounds.cc:107] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:12:19.388743 27156 raft_consensus.cc:2889] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:19.368304 27305 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
W20260709 13:12:19.391968 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 386477us
I20260709 13:12:19.392653 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:19.392781 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.394100 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:19.394874 27841 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.401610 27155 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:19.403053 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:19.403767 27225 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.405515 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:19.409369 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.412936 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.397523 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.414031 27836 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:19.324074 31206 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:12:19.419324 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:19.437362 27806 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.351122 31729 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.447824 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:19.448724 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:19.442399 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48984.6us
I20260709 13:12:19.452800 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:19.454137 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:19.444689 27837 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:19.391692 32009 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:19.415153 31902 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:19.477473 27225 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:19.391856 32011 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:19.474598 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.404350 32030 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.359095 31905 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.490948 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.442498 31943 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.447359 31818 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:19.486403 27150 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
W20260709 13:12:19.483429 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46192us
I20260709 13:12:19.521370 27155 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:19.522439 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.522677 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:19.513772 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.534741 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:19.540398 32009 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.541742 32009 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.542364 31913 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.545362 31729 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.550352 32042 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.551684 27841 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:19.558877 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.559693 27153 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:19.560479 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.449407 31988 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:12:19.561213 31988 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:19.561546 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.557897 31813 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.562793 27153 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:19.566215 32011 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.482854 32005 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.569943 31899 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:19.572413 31922 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:19.478762 32001 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:19.573464 32001 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:19.574100 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.573942 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.479053 32021 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.487756 31852 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:19.589813 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.573958 32001 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.587074 31920 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:19.598248 31920 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.599066 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.600373 31920 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:19.600466 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.601574 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:19.523541 31818 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:19.604130 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.603871 31818 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:19.604696 27149 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.605139 31818 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:19.604926 31935 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:19.606184 27228 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:19.523443 32034 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:19.611131 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:19.631003 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:19.632535 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:19.607052 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 413749us
I20260709 13:12:19.589479 31922 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.639417 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.641781 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.648301 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:19.661231 27149 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:19.666571 27154 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:19.667431 31852 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:19.672191 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 59215.4us
I20260709 13:12:19.672365 31852 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:19.672788 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.673043 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:19.673280 31852 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.670398 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:19.679797 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 363280us
I20260709 13:12:19.679955 27155 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:19.640944 31906 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:19.683270 31930 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.004s
I20260709 13:12:19.683502 27148 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:19.684221 27832 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:19.687577 27154 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:19.689307 32032 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.684s	user 0.001s	sys 0.003s
I20260709 13:12:19.691937 27154 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:12:19.665776 31920 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:19.698292 31920 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.698730 31920 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.698992 27297 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.648013 31899 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.695508 31912 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:19.702275 31899 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.702364 31912 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.702772 31899 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.702824 31912 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.629338 32034 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.710770 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.712236 32034 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:19.713264 32011 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.713541 31935 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.715456 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:19.715538 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:19.716459 27154 pending_rounds.cc:85] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 7
I20260709 13:12:19.638751 31433 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.717724 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.719310 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.719908 27837 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:19.647533 31943 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.654263 31180 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:19.725796 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:19.607406 32021 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:19.732553 27832 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:19.733744 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.732852 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:19.734427 27837 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
W20260709 13:12:19.732928 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 51148.2us
I20260709 13:12:19.732396 27149 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:19.739835 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:19.740578 27834 raft_consensus.cc:2368] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7.
I20260709 13:12:19.666566 32014 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:19.718093 27154 pending_rounds.cc:107] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:12:19.742913 27154 raft_consensus.cc:2889] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:19.744243 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.744938 27837 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:19.724249 31180 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.744557 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:19.666886 31922 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:19.734074 32019 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
W20260709 13:12:19.747577 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 256715us
I20260709 13:12:19.751271 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.760546 27297 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:12:19.757324 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 436525us
I20260709 13:12:19.735666 31916 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:19.766862 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:19.731389 31925 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:12:19.799436 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47547.3us
I20260709 13:12:19.800196 27231 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:19.801218 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:19.731359 31906 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:19.804584 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:19.806999 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:19.748579 31180 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:19.764508 31911 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.773108 32037 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.771418 31935 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.732074 31912 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.771147 32019 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.820015 31964 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:19.813642 31880 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:19.823984 27232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.014s	sys 0.022s
W20260709 13:12:19.799440 31960 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.002s
W20260709 13:12:19.876626 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 51087.6us
I20260709 13:12:19.877837 31926 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:19.880136 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 114611us
I20260709 13:12:19.876816 27271 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:19.884827 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.936105 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:19.884455 27232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.022s
I20260709 13:12:19.937093 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:19.937803 27841 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:19.937924 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:19.939782 27835 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:19.806720 31646 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:12:19.938689 27836 raft_consensus.cc:2410] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:19.941221 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:19.948354 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64467us
I20260709 13:12:19.948748 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:19.943058 27835 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:19.961010 27833 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:19.882787 31889 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.969914 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:19.884264 31964 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:19.982352 27834 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 11. Ops: []
I20260709 13:12:19.825935 31920 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:19.939014 31926 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.888669 31905 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:19.950619 32045 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 13:12:19.949968 32048 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:19.877341 31983 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
W20260709 13:12:20.005407 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260709 13:12:19.876655 32037 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.006402 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.998042 31847 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.886762 32039 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:12:19.966210 31813 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:19.966545 31960 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.978780 32014 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.980847 31424 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:20.012480 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.000972 31926 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.995352 31964 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.024240 27271 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:19.938654 31880 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.013885 27832 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:20.016192 32039 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:20.016592 32059 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:20.008384 31430 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.010157 31905 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:19.980351 32057 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:19.946702 32030 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:12:20.007367 32051 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:12:20.023258 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 233197us
W20260709 13:12:20.020565 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 216450us
I20260709 13:12:20.023448 27304 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:12:20.025508 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 76839.7us
I20260709 13:12:20.021821 31424 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:19.993875 31889 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.019717 31916 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.001854 31433 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:20.014307 31900 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.034924 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.038591 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:20.043802 27836 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:20.050829 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.050958 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:20.051745 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:20.085907 27150 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:20.052585 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.029109 32005 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:20.086640 27225 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
W20260709 13:12:20.031947 32050 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
W20260709 13:12:20.064669 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.024361 31813 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:20.027426 31299 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.094152 27226 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 9. Current term is 10. Ops: [5.7-9.9]
I20260709 13:12:20.009087 32054 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:12:20.088528 27839 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:12:20.021016 31925 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:20.026424 31646 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.096149 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45305us
I20260709 13:12:20.096634 32015 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:20.023954 31960 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.039697 32057 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:20.100032 27839 pending_rounds.cc:85] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:12:20.120600 27839 pending_rounds.cc:107] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:20.120995 27839 raft_consensus.cc:2889] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.121379 27839 pending_rounds.cc:107] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:20.121678 27839 raft_consensus.cc:2889] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.102257 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:20.090144 31916 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.095238 31900 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.081128 31935 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:20.110474 32049 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:12:20.081852 31424 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:20.114955 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:20.047638 32021 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.084558 31922 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.089293 31984 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:20.089433 31905 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:20.023885 32014 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.146745 27122 leader_election.cc:400] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7.
I20260709 13:12:20.147063 27122 leader_election.cc:403] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:12:20.150707 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 112038us
I20260709 13:12:20.151715 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:20.152715 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 101819us
I20260709 13:12:20.157967 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:20.158149 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:20.158818 27155 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:20.162405 27300 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:20.040081 32059 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.130795 32057 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.170928 27271 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:20.159438 31818 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:12:20.146294 31912 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.188093 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:20.183229 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1038) took 1273 ms. Trace:
I20260709 13:12:20.194739 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2643) took 1065 ms. Trace:
I20260709 13:12:20.159134 31646 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.099531 32005 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.164188 32034 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:20.170737 32009 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 13:12:20.235278 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:20.212071 27223 rpcz_store.cc:276] 0709 13:12:18.909617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.909732 (+   115us) service_pool.cc:224] Handling call
0709 13:12:18.910147 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.921461 (+ 11314us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:18.937170 (+ 15709us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.028378 (+ 91208us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b18003a6120. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:19.433603 (+405225us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:19.471777 (+ 38174us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.471998 (+   221us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:19.472054 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.472133 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.169414 (+697281us) raft_consensus.cc:1685] finished
0709 13:12:20.182971 (+ 13557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.183156 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30820,"prepare.queue_time_us":52150,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":47584,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":29485,"spinlock_wait_cycles":22759168,"thread_start_us":213325,"threads_started":1,"wal-append.queue_time_us":518100}
W20260709 13:12:20.251116 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 138112us
I20260709 13:12:20.140733 31935 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:20.199069 27836 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:20.174198 32019 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.169327 32074 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:20.270890 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:20.247933 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49878.3us
I20260709 13:12:20.214454 27151 rpcz_store.cc:276] 0709 13:12:19.138387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.161755 (+ 23368us) service_pool.cc:224] Handling call
0709 13:12:19.170266 (+  8511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.170681 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.170718 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.171279 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.630334 (+459055us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:19.630392 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.630484 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.194458 (+563974us) raft_consensus.cc:1685] finished
0709 13:12:20.194486 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.194666 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5159,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11356,"thread_start_us":458669,"threads_started":1,"wal-append.queue_time_us":637238}
W20260709 13:12:20.253919 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 136217us
I20260709 13:12:20.183044 32073 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 6. Current term is 7.
I20260709 13:12:20.282660 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.284195 27837 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:12:20.254246 32056 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:12:20.289917 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.172245 31852 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:12:20.181455 32033 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:12:20.156150 31984 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:20.269871 32030 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.298969 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.197121 32039 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:12:20.278038 31299 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.345817 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49574.4us
I20260709 13:12:20.280529 32078 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.296861 32019 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.352774 32067 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:12:20.353298 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1046) took 1113 ms. Trace:
W20260709 13:12:20.353667 32065 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
W20260709 13:12:20.354885 32058 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:12:20.353682 27157 rpcz_store.cc:276] 0709 13:12:19.239850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.263850 (+ 24000us) service_pool.cc:224] Handling call
0709 13:12:19.264289 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.277671 (+ 13382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.277715 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.296264 (+ 18549us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.673776 (+377512us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:19.673814 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.673895 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.353065 (+679170us) raft_consensus.cc:1685] finished
0709 13:12:20.353084 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.353216 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12980,"raft.queue_time_us":57258,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":19851,"spinlock_wait_cycles":1193728,"thread_start_us":349723,"threads_started":1,"wal-append.queue_time_us":497558}
I20260709 13:12:20.187054 31813 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:20.254473 32075 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 13:12:20.295871 32079 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:20.186765 32054 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:12:20.275920 31920 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.269567 32029 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:20.278613 32074 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.239494 32076 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:12:20.278412 32009 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:20.367551 32063 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:12:20.309247 27304 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:20.300354 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 146059us
I20260709 13:12:20.285694 31906 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:12:20.347208 32055 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 13:12:20.365875 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.423971 27304 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:20.424055 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 54658.8us
W20260709 13:12:20.406785 32064 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.285s	user 0.001s	sys 0.003s
I20260709 13:12:20.364665 31943 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:20.425518 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 150906us
I20260709 13:12:20.426185 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:20.291045 31905 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:20.415750 32060 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:12:20.429987 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.344408 31913 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:12:20.301755 32081 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:12:20.345074 32030 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.364593 32019 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.428548 32014 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.360630 31299 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.427333 27304 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.459537 27304 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.460227 31299 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.407527 32074 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:20.425243 32015 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:20.427389 31889 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.454587 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:20.416369 32029 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:20.454275 32001 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 13:12:20.428068 32009 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:20.523720 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69253.6us
I20260709 13:12:20.524637 27839 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:12:20.525318 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56895.7us
I20260709 13:12:20.527604 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:20.531344 32066 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:12:20.532593 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3243) took 1053 ms. Trace:
I20260709 13:12:20.532943 27152 rpcz_store.cc:276] 0709 13:12:19.479704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.576343 (+ 96639us) service_pool.cc:224] Handling call
0709 13:12:19.576669 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.576930 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:19.576966 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.577489 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.886709 (+309220us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:19.886758 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.886843 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.532383 (+645540us) raft_consensus.cc:1685] finished
0709 13:12:20.532402 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.532535 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":308820,"threads_started":1,"wal-append.queue_time_us":676613}
I20260709 13:12:20.535935 32014 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:20.536726 32014 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.537077 31920 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:20.537793 32072 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 13:12:20.539001 31964 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 13:12:20.539498 31964 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.541290 32014 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:20.541576 31964 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.538856 31920 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.542665 31920 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.544215 27304 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:20.546324 31919 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.546844 31919 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.548918 31919 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.549396 31919 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:20.550155 32068 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
W20260709 13:12:20.551934 32053 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:12:20.554836 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.555477 27840 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:20.556404 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.556926 27840 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:20.557669 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.560165 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3321) took 1286 ms. Trace:
I20260709 13:12:20.562021 27230 rpcz_store.cc:276] 0709 13:12:19.273854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.273963 (+   109us) service_pool.cc:224] Handling call
0709 13:12:19.274317 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.286521 (+ 12204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.286564 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.309259 (+ 22695us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.667052 (+357793us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:19.667097 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.667174 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.559958 (+892784us) raft_consensus.cc:1685] finished
0709 13:12:20.559977 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.560108 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1894,"raft.queue_time_us":12260,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23113,"thread_start_us":311616,"threads_started":1,"wal-append.queue_time_us":566798}
I20260709 13:12:20.563352 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:20.441265 31943 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.457309 32037 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.469298 32033 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.573096 27835 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:20.576722 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:20.466750 32015 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:20.579137 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.586709 32085 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:20.586848 32033 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.587414 32085 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:20.588276 32085 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:20.589069 32033 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.582465 32091 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:20.590044 32091 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.590427 32091 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:20.595144 32030 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.577246 32059 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.597329 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:20.578455 31180 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.002s
I20260709 13:12:20.597981 32019 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.598459 31180 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.600282 27302 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:20.600926 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 76295.5us
I20260709 13:12:20.531379 32009 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:20.470147 31900 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.584204 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1051) took 1241 ms. Trace:
I20260709 13:12:20.560029 27840 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:20.371192 32079 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.601974 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:20.597918 32011 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.000s
I20260709 13:12:20.579389 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:20.474258 32039 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:12:20.577400 31914 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.225s	user 0.012s	sys 0.002s
I20260709 13:12:20.608352 27156 rpcz_store.cc:276] 0709 13:12:19.342844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.389779 (+ 46935us) service_pool.cc:224] Handling call
0709 13:12:19.440495 (+ 50716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.475578 (+ 35083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.475623 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.481635 (+  6012us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.811476 (+329841us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:19.811517 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.811581 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.583971 (+772390us) raft_consensus.cc:1685] finished
0709 13:12:20.583999 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.584142 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38361,"raft.queue_time_us":38417,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10947,"thread_start_us":271804,"threads_started":1,"wal-append.queue_time_us":467322}
I20260709 13:12:20.577139 31847 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:20.621712 31847 consensus_queue.cc:1243] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:12:20.601614 31899 consensus_meta.cc:287] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.898s	user 0.004s	sys 0.006s
I20260709 13:12:20.610332 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.549837 31919 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.620292 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:20.580299 31935 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.527323 32001 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.626514 27836 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:20.643317 27840 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
W20260709 13:12:20.626281 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.645824 27122 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:20.646327 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:20.649256 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:20.642817 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61883.9us
I20260709 13:12:20.639782 32009 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.609520 32005 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.654999 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:20.668112 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.656638 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:20.651038 32087 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.657356 31847 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:20.658172 32090 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 13:12:20.658936 32071 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.380s	user 0.000s	sys 0.003s
I20260709 13:12:20.660919 32097 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.701586 27301 pending_rounds.cc:85] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 8
I20260709 13:12:20.701658 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.702076 27301 pending_rounds.cc:107] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:12:20.702333 27301 raft_consensus.cc:2889] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.662304 27833 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:20.703771 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.704582 27223 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:20.671036 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.669271 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.661819 32029 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.683691 32039 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:20.694489 32098 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:12:20.695808 32079 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.696152 32057 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.624126 31983 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.698712 31180 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.697016 32077 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:20.658951 32080 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:12:20.623097 31899 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.707777 27304 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:20.703613 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48922.3us
I20260709 13:12:20.716739 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:20.718977 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.719817 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.720692 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.737123 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:20.736572 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:20.715090 32039 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.746495 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.738626 27806 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:20.747148 27223 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:20.721549 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.724514 27232 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:20.710537 27149 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:20.749511 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.622537 32074 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.726583 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:20.750355 27304 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:20.687258 31984 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:20.687850 31847 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:20.721607 27303 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:12:20.710207 32005 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.740630 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.741600 32104 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.728894 31983 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:20.765978 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.726719 31889 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:12:20.715330 32097 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.700228 32091 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.751670 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:20.756803 27297 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:20.762024 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.769934 27152 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:20.762461 31943 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.762636 32059 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.766391 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.773031 27304 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:20.756639 32033 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:20.766577 27833 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:20.755400 32039 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:20.767314 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.763600 31847 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.776252 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.689644 32087 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:20.778177 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.779609 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:20.783229 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:20.782608 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.780938 27229 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:20.793146 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:20.793861 32109 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.769789 32104 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.796180 31899 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:20.797194 32089 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:12:20.797485 32104 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.799326 32097 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.776417 32059 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.801867 32059 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.768308 32005 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.808005 32005 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.808640 31880 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.809222 32001 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.809437 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.814880 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:20.815160 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:20.818387 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.818599 27231 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:20.820127 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:20.822844 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.823076 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.823423 27840 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:20.823800 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:20.823910 27833 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:20.824607 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:20.824806 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.825330 27297 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:20.825858 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:20.828341 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:20.829507 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.833540 27232 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:20.776485 32033 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.831291 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:20.827152 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:20.819085 31926 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.008s
W20260709 13:12:20.839828 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46767.5us
I20260709 13:12:20.837702 27225 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:20.836784 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.843807 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.845003 27297 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:20.846253 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:20.847532 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.836557 32109 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:20.849601 32109 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.851917 32109 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.822083 31943 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:20.832113 32001 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:20.852461 31943 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.852706 32001 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:20.853008 31943 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:20.853212 32001 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:20.839111 32097 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.859174 32074 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.863029 31919 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.863308 32087 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:20.829013 32104 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:20.865675 32097 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.868985 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:20.874193 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47097.5us
I20260709 13:12:20.835417 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.885412 27303 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:20.864662 32104 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.793061 32085 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:20.897003 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:20.879292 31646 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.005s
W20260709 13:12:20.914291 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45392.7us
I20260709 13:12:20.837337 32033 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:20.916801 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:20.891348 32105 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.895170 31899 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.940202 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.897456 32104 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:20.910883 32059 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.961695 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:20.943122 32102 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:20.918839 31646 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.939958 31912 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.919209 32091 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:20.920051 32074 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:20.915872 32014 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.839394 31926 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.936674 31852 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:20.936131 32019 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.090974 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.917392 32085 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:20.945339 32105 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.013468 32102 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.208928 27300 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:12:21.202030 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1057) took 1159 ms. Trace:
I20260709 13:12:21.210475 27153 rpcz_store.cc:276] 0709 13:12:20.042627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.042814 (+   187us) service_pool.cc:224] Handling call
0709 13:12:20.087083 (+ 44269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:20.097401 (+ 10318us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:20.097440 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:20.097880 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:12:21.196594 (+1098714us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18004350a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1
0709 13:12:21.196788 (+   194us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:21.196823 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.196892 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:21.196941 (+    49us) raft_consensus.cc:1685] finished
0709 13:12:21.196952 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.201965 (+  5013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19263,"raft.queue_time_us":42130,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":13121,"spinlock_wait_cycles":3591424,"thread_start_us":60757,"threads_started":1,"wal-append.queue_time_us":358425}
I20260709 13:12:21.212553 27299 raft_consensus.cc:2368] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:21.213229 32102 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.215463 32001 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.216634 27297 pending_rounds.cc:85] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 7
I20260709 13:12:21.216912 27297 pending_rounds.cc:107] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:12:21.217139 27297 raft_consensus.cc:2889] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.217444 27297 pending_rounds.cc:107] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:12:21.217516 32001 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.217711 27297 raft_consensus.cc:2889] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.223398 32102 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.151693 31813 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.226428 31813 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.227075 32102 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.228928 31813 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.230822 27223 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:21.233238 27223 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:21.104351 32074 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.219216 31926 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.153954 31913 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.219446 32039 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.207101 32021 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:21.218175 32116 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:12:21.215865 32085 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.152029 32077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54492 (request call id 0) took 5309 ms. Trace:
W20260709 13:12:21.244750 32049 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:21.209890 32005 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.066519 32059 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.248126 32074 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.270303 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1042) took 1220 ms. Trace:
I20260709 13:12:21.296790 27227 rpcz_store.cc:276] 0709 13:12:20.049523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.049627 (+   104us) service_pool.cc:224] Handling call
0709 13:12:20.087275 (+ 37648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.087459 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:20.247617 (+160158us) log.cc:844] Serialized 14 byte log entry
0709 13:12:21.266256 (+1018639us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18004c0600. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a
0709 13:12:21.269915 (+  3659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:21.269971 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:21.270017 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.270103 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.270244 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":276828,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":83,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8988,"spinlock_wait_cycles":17566336,"thread_start_us":255712,"threads_started":2,"wal-append.queue_time_us":223421}
W20260709 13:12:21.279776 31424 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.125s	user 0.008s	sys 0.003s
W20260709 13:12:21.282146 32108 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:12:21.283484 32005 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.254983 31913 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:21.285349 32069 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.287237 31847 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.217516 32105 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.266353 32021 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:21.277233 32114 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:12:21.208357 31852 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.322348 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.328204 32046 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.242935 32019 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.275604 31818 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:21.355072 31818 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:21.358300 32046 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.358675 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.359803 31894 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.360504 32046 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.360337 31894 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.284421 32015 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.366063 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3258) took 1770 ms. Trace:
I20260709 13:12:21.367376 31894 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.366487 27148 rpcz_store.cc:276] 0709 13:12:19.595129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.684196 (+ 89067us) service_pool.cc:224] Handling call
0709 13:12:19.684460 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.798357 (+113897us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:19.815420 (+ 17063us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.096640 (+281220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:20.097515 (+   875us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:20.098261 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.658214 (+559953us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:21.365803 (+707589us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540012bbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:21.365862 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:21.365990 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43443,"prepare.queue_time_us":17023,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":55814,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":74,"spinlock_wait_cycles":276519040,"thread_start_us":223868,"threads_started":1,"wal-append.queue_time_us":373567}
I20260709 13:12:21.355680 31818 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.373656 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:21.376995 32092 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.761s	user 0.001s	sys 0.000s
W20260709 13:12:21.329077 32116 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:21.341647 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:21.342497 32121 log.cc:927] Time spent T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:12:21.342655 31206 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:21.330735 31424 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.404671 31206 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:21.251221 31899 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:21.344712 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:21.346632 31847 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.384459 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:21.382659 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.331740 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:21.411664 27834 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:21.336781 32069 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.392478 31913 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.395686 32021 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.401096 27840 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:21.402945 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.406562 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.406831 27154 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:21.388542 32005 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.431027 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.432618 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:21.442819 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.405705 31206 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.445456 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:21.457729 27306 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:21.421342 32097 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:21.463889 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54492
I20260709 13:12:21.465906 27301 raft_consensus.cc:606] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 13:12:21.466636 27301 raft_consensus.cc:614] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:21.453516 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:21.467990 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.471642 31922 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:21.472064 31922 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:21.472865 31922 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.475135 32104 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.477280 32126 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.478330 31206 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.484774 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.485872 27834 raft_consensus.cc:2393] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 6: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:21.487732 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.488699 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:21.488726 27834 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:21.437945 31913 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.493460 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.420451 31899 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.444782 32085 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.465626 32097 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:21.490336 31943 consensus_meta.cc:287] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 13:12:21.510776 27834 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:21.498240 32033 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.003s
I20260709 13:12:21.522974 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:21.508394 31984 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:21.496364 31906 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:21.496078 31424 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.531114 27834 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:21.522073 32097 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:21.500041 32078 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.522336 32039 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.523375 31430 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:21.526927 31935 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:21.508824 31913 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.538587 32104 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.520991 32085 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.549129 32085 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.554654 32019 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.559046 32059 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.539201 32078 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.553742 32074 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.560685 31899 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.530809 31906 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.561949 32078 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.562300 32070 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.562942 32074 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.563794 32070 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.564669 31913 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.565333 31913 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.558856 31818 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.269027 32077 rpcz_store.cc:276] 0709 13:12:15.794675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.796006 (+  1331us) service_pool.cc:224] Handling call
0709 13:12:17.747742 (+1951736us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b58000eb4d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51c930aa 00007f9a51d15447 00007f9a51d3270a 00007f9a51d3376a 00007f9a51d3291b 00007f9a51d3e03c 00007f9a51d3d6b3 00007f9a51d359fa 00007f9a56cfd4c9 00007f9a50279c54
0709 13:12:17.782417 (+ 34675us) log.cc:844] Serialized 508 byte log entry
0709 13:12:18.434919 (+652502us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b540040ed20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51cb7b26 00007f9a51cb149a 00007f9a51cb0714 00007f9a51c90eaa 00007f9a51c97d53 00007f9a51c97cd9 00007f9a51c97c69 00007f9a51c97c31 00007f9a51c96dfd 000000000038f354
0709 13:12:19.098689 (+663770us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800151120. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51cb0142 00007f9a51c90eaa 00007f9a51c97d53
0709 13:12:19.099490 (+   801us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b540040ed20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51cb0142 00007f9a51c90eaa 00007f9a51c97d53 00007f9a51c97cd9 00007f9a51c97c69 00007f9a51c97c31 00007f9a51c96dfd 000000000038f354 000000000038f199 00007f9a4ec4a475
0709 13:12:21.064911 (+1965421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53898,"raft.queue_time_us":72054,"raft.run_cpu_time_us":18238,"raft.run_wall_time_us":1736366,"spinlock_wait_cycles":1525617920,"thread_start_us":172016,"threads_started":2,"wal-append.queue_time_us":69227,"wal-append.run_cpu_time_us":2274,"wal-append.run_wall_time_us":1112617}
I20260709 13:12:21.525408 31943 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.535763 32001 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.575074 27840 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:21.527432 32033 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.562651 32085 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.563058 31906 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.535562 32005 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:21.566825 31935 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.595950 31916 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.601886 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:12:21.602819 32129 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:12:21.611670 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1783) took 1330 ms. Trace:
I20260709 13:12:21.612100 27835 rpcz_store.cc:276] 0709 13:12:20.282225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.282353 (+   128us) service_pool.cc:224] Handling call
0709 13:12:21.611491 (+1329138us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54007b7ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.611608 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666122112}
I20260709 13:12:21.367341 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:21.617333 32005 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.618047 32005 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.581874 31899 raft_consensus.cc:476] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:12:21.565886 31913 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:21.629328 32112 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 13:12:21.667135 32126 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:21.695130 32019 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:21.690817 27832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1774) took 1755 ms (client timeout 1733 ms). Trace:
I20260709 13:12:21.655189 32069 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.695837 32019 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:21.696270 27832 rpcz_store.cc:269] 0709 13:12:19.935727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.935859 (+   132us) service_pool.cc:224] Handling call
0709 13:12:21.690514 (+1754655us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b5400363654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.690715 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176939264}
I20260709 13:12:21.659615 31818 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.636066 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1337) took 1073 ms. Trace:
I20260709 13:12:21.691448 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1782) took 1412 ms. Trace:
I20260709 13:12:21.698623 32019 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.698449 27839 rpcz_store.cc:276] 0709 13:12:20.280796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.281183 (+   387us) service_pool.cc:224] Handling call
0709 13:12:21.691246 (+1410063us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400202954. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.691379 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383315200}
I20260709 13:12:21.666946 31424 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.665091 32091 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.700109 31424 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.649718 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.700223 32091 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:21.702859 31424 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.667913 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.705672 27157 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:21.704000 32126 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.650117 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:21.707810 27149 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.666638 32039 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.704020 32091 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.710412 32039 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.710872 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 942) took 1539 ms. Trace:
I20260709 13:12:21.711390 27300 rpcz_store.cc:276] 0709 13:12:20.234887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.235037 (+   150us) service_pool.cc:224] Handling call
0709 13:12:21.710682 (+1475645us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000a4e54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.710790 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075023744}
I20260709 13:12:21.712811 32039 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.708566 32126 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.717126 27806 leader_election.cc:400] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:21.718308 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:21.760093 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:21.761657 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:21.722270 27149 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:21.763064 27806 leader_election.cc:403] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:21.727077 32057 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:21.734345 32128 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 13:12:21.739037 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:21.740638 27302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2165) took 2015 ms (client timeout 2038 ms). Trace:
I20260709 13:12:21.743306 31983 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.746382 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3269) took 1093 ms. Trace:
W20260709 13:12:21.778625 27302 rpcz_store.cc:269] 0709 13:12:19.725420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.725560 (+   140us) service_pool.cc:224] Handling call
0709 13:12:21.740458 (+2014898us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540005d2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.740585 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009017728}
I20260709 13:12:21.650538 27148 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:21.709885 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 3271) took 1053 ms. Trace:
I20260709 13:12:21.781453 27152 rpcz_store.cc:276] 0709 13:12:20.656279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.656422 (+   143us) service_pool.cc:224] Handling call
0709 13:12:21.709632 (+1053210us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b540013a454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.709790 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229813120}
W20260709 13:12:21.754540 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.756109 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:21.697809 27836 rpcz_store.cc:276] 0709 13:12:20.562270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.597074 (+ 34804us) service_pool.cc:224] Handling call
0709 13:12:21.635800 (+1038726us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400899ed4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:21.635976 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65012096}
I20260709 13:12:21.598577 32085 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.774878 32039 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:21.786172 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.747330 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:21.787424 27230 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:12:21.787532 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70536.1us
I20260709 13:12:21.778757 27154 rpcz_store.cc:276] 0709 13:12:20.652863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.653053 (+   190us) service_pool.cc:224] Handling call
0709 13:12:20.653378 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.426930 (+773552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.746145 (+319215us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003e0654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:21.746325 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732361472}
I20260709 13:12:21.595037 31852 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.595480 32070 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.790814 32034 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.777638 32091 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:21.788815 31983 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.797650 31983 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.799754 31983 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:21.777451 32126 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:21.802443 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.803292 32015 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.803858 32005 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.806432 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.807250 32033 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.791728 27154 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:21.773197 32029 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.793366 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.779974 32019 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:21.794395 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.600464 31935 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.795396 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:21.809598 27156 raft_consensus.cc:2368] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:21.808640 32029 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.811007 31899 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:21.811817 32029 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.811522 31899 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.813903 31913 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:21.685118 31960 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.648285 31943 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.815634 31899 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.594870 32001 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:21.818485 32039 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:21.819052 32123 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.618s	user 0.002s	sys 0.000s
I20260709 13:12:21.836018 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:21.836665 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:21.844220 27839 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:21.837827 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:21.837985 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.845604 27302 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:21.840386 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.841168 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.847245 27299 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:21.847396 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.848366 27156 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:21.834259 32126 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:21.851756 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.828935 31922 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:21.852180 32126 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:21.852588 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:21.853391 27156 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:21.858331 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:21.858922 27153 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.859545 32034 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:21.860312 27832 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:21.834151 31917 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:12:21.867990 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:21.868667 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.841400 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:21.872350 27151 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:12:21.875108 27122 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:21.848192 32091 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:21.876430 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.878402 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.882170 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:21.879458 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:21.882890 27300 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:21.882337 27156 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:21.819156 32001 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:21.891022 27304 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.891330 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:21.881129 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 92741.9us
I20260709 13:12:21.889973 32039 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.898185 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:21.907236 27153 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:21.907411 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.909544 27154 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:21.910595 27832 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:12:21.911091 27832 pending_rounds.cc:85] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 8
I20260709 13:12:21.911428 27832 pending_rounds.cc:107] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:21.911775 27832 raft_consensus.cc:2889] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.912989 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:21.915820 27153 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:21.930400 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48293.8us
I20260709 13:12:21.933718 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:21.935920 27297 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:21.909826 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:21.834503 32074 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:12:21.939915 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 429721us
I20260709 13:12:22.022897 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.023046 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:21.900005 32030 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.900352 32075 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:21.940184 32108 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:12:21.933399 32123 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:12:21.949985 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:21.952147 27835 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.938692 32078 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.943672 31996 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:21.965801 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:22.111564 27833 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:21.969592 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:21.959668 32073 raft_consensus.cc:2764] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:12:21.998205 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 461217us
I20260709 13:12:22.007622 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:22.116462 27153 raft_consensus.cc:2368] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12.
I20260709 13:12:21.966517 32097 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.008734 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.120983 27157 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:22.121995 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.009617 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.024109 27151 raft_consensus.cc:2410] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:22.062879 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.117349 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:22.008375 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:22.118317 27804 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.515s (SENT) [suppressed 12 similar messages]
I20260709 13:12:22.116142 31996 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:22.131037 32128 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:12:22.131666 31996 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.132880 31996 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:22.136037 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:22.138267 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.063014 32074 consensus_queue.cc:1243] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:22.141355 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.144833 27839 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
W20260709 13:12:22.139045 27269 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.044s
I20260709 13:12:22.151633 27155 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:22.153252 27269 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.001s	sys 0.044s
I20260709 13:12:22.069617 32030 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.069021 31922 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.152812 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.159088 27151 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:22.150810 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 88042us
I20260709 13:12:22.112061 32086 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:22.139259 32130 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:22.122536 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.120533 31913 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.158425 32030 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.188766 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.116997 32039 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:22.190688 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:21.995676 32091 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.150415 32001 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:22.152424 31900 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:22.185348 27838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.015s
W20260709 13:12:22.219086 27838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.015s
I20260709 13:12:22.194249 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.219923 27230 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:22.196311 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.220999 27228 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.157003 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.188339 27834 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
W20260709 13:12:22.210583 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.158313 32088 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:22.157425 32005 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.210423 27151 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:12:22.213130 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.213894 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.227439 27227 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:22.155455 32136 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.188998 32086 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.215227 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:22.215950 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 93502.8us
I20260709 13:12:22.218219 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.224712 27155 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:22.188624 31922 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:22.238083 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.249544 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.291682 27151 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:22.235036 27228 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:22.291823 27152 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:22.289095 27223 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:22.300148 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.302937 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.332494 27155 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:22.329504 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.334367 27228 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:22.211174 31729 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:12:22.234990 31818 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:22.360432 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.234439 31943 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.211046 31913 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.290930 32086 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.369117 27148 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
W20260709 13:12:22.304102 32108 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:12:22.288430 32059 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.015s	sys 0.047s
I20260709 13:12:22.226751 32138 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.218530 32039 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:22.406962 27150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.024s	sys 0.031s
W20260709 13:12:22.407348 27150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.024s	sys 0.031s
W20260709 13:12:22.338339 31905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.018s	sys 0.027s
I20260709 13:12:22.218780 32001 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.234277 32088 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.349798 31900 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.422632 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.423291 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.286094 32005 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:22.406032 32059 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.016s	sys 0.048s
W20260709 13:12:22.403493 32126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.049s
W20260709 13:12:22.421810 31905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.020s	sys 0.029s
W20260709 13:12:22.449900 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 331373us
W20260709 13:12:22.430424 31424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.008s	sys 0.049s
I20260709 13:12:22.372713 31818 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.457144 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:22.442785 32126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.006s	sys 0.049s
I20260709 13:12:22.476655 27834 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.449560 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.463960 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.486428 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:22.457829 27229 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:22.470852 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:22.471674 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.490146 27230 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:22.490780 32148 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:12:22.490914 31922 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:22.441658 31900 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.373591 31943 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.493372 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.494191 32070 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:22.494385 32131 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:12:22.494940 31943 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:22.495430 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.496189 32070 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:22.496595 32070 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.496968 32070 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.483330 27227 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:22.473721 27224 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:22.499931 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.487205 27839 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:22.493539 31900 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.500998 27232 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:22.503089 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.501019 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.512049 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.513015 27227 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:22.513309 32001 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.514032 31913 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.514943 32088 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:22.475986 31424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.009s	sys 0.049s
W20260709 13:12:22.483413 32021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.049s
I20260709 13:12:22.507191 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.523213 27225 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:12:22.524220 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.524955 27225 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.508843 32039 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.497750 32074 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:22.513836 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.521370 27834 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:22.483436 32097 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.516752 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.540364 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:22.521904 31433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.010s
I20260709 13:12:22.547564 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:22.522789 32014 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.548556 27834 raft_consensus.cc:2368] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12.
I20260709 13:12:22.513865 32126 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.528231 31943 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:22.547236 32019 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:22.522873 32021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.050s
I20260709 13:12:22.574685 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:22.569705 31433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.006s	sys 0.011s
I20260709 13:12:22.578045 32019 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.580394 32019 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:22.603824 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:22.604660 27835 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:22.575562 31943 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.618338 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:22.619685 27834 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:22.581853 32014 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:22.569595 32074 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:22.581192 32126 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.618515 31943 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:22.653575 32140 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:12:22.654461 32151 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:22.655242 32086 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.660238 32086 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.647380 32014 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.663358 32074 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:22.686412 32147 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
W20260709 13:12:22.728453 27122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.009s	sys 0.007s
W20260709 13:12:22.729333 27122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.009s	sys 0.007s
W20260709 13:12:22.731626 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 797909us
W20260709 13:12:22.475490 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 565756us
I20260709 13:12:22.736676 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.739651 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.748206 27123 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:22.778429 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.781885 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:22.790155 31424 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.791529 31424 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.792340 31424 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:22.753779 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2654) took 2101 ms. Trace:
W20260709 13:12:22.759356 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 471040us
I20260709 13:12:22.762241 27223 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:22.763535 27225 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:22.567126 27227 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:22.767593 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 946) took 2332 ms. Trace:
I20260709 13:12:22.799587 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:22.767916 27271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.019s
W20260709 13:12:22.802420 27271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.000s	sys 0.020s
W20260709 13:12:22.802999 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 593020us
W20260709 13:12:22.768436 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.007s
W20260709 13:12:22.804764 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.011s	sys 0.008s
I20260709 13:12:22.805524 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.777390 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:22.775524 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:22.807071 32005 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.807617 27836 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:22.808130 32005 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.809202 32005 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.794319 27150 rpcz_store.cc:276] 0709 13:12:20.652686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.653541 (+   855us) service_pool.cc:224] Handling call
0709 13:12:20.653830 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:21.731105 (+1077275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:21.731147 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:21.777422 (+ 46275us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b2c000014c8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:21.777815 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.407767 (+629952us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:22.407819 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.753139 (+345320us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003c6254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:22.753239 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.753303 (+    64us) raft_consensus.cc:1685] finished
0709 13:12:22.753316 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.753594 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8769,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":2524810752,"thread_start_us":629569,"threads_started":1,"wal-append.queue_time_us":841275}
I20260709 13:12:22.812868 32005 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.814184 32005 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.814599 32005 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.815135 32005 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.800263 27298 rpcz_store.cc:276] 0709 13:12:20.434872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.434973 (+   101us) service_pool.cc:224] Handling call
0709 13:12:20.435346 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:20.435786 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:20.435827 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:21.747979 (+1312152us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:21.748368 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.243950 (+495582us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:22.243991 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.244057 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.766646 (+522589us) raft_consensus.cc:1685] finished
0709 13:12:22.766689 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.767176 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4003,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3814,"spinlock_wait_cycles":6756224,"thread_start_us":495285,"threads_started":1,"wal-append.queue_time_us":830158}
I20260709 13:12:22.818522 32015 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.818666 27195 leader_election.cc:400] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12.
I20260709 13:12:22.819133 32015 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.819721 32015 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.819213 27195 leader_election.cc:403] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:22.827533 31913 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:22.827745 31818 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.828583 31913 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:22.822472 31424 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.831384 31818 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12.
I20260709 13:12:22.829490 31913 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.833762 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1788) took 2536 ms. Trace:
I20260709 13:12:22.834373 31913 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.834787 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:22.835870 27229 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:22.834239 27838 rpcz_store.cc:276] 0709 13:12:20.300913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.571568 (+270655us) service_pool.cc:224] Handling call
0709 13:12:20.571911 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:21.619520 (+1047609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:21.619572 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:21.620245 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 13:12:22.219550 (+599305us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:22.219600 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.832974 (+613374us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:22.833049 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.833106 (+    57us) raft_consensus.cc:1685] finished
0709 13:12:22.833117 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.833542 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2974,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2407985024,"thread_start_us":598853,"threads_started":1,"wal-append.queue_time_us":825659}
I20260709 13:12:22.838588 31899 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.839227 31899 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.844319 32015 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.847013 31899 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:22.849454 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45159.7us
I20260709 13:12:22.851157 32074 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:22.785364 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:22.829641 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:22.852142 32077 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:22.871838 32077 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:22.872287 32077 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:22.680588 32085 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:22.672250 32070 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.877460 31917 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:22.873558 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.886363 31917 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:22.915493 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69559.7us
I20260709 13:12:22.889138 31917 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:22.897432 32074 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.929867 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:22.925470 32166 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.938925 32015 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.948215 27197 leader_election.cc:400] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12.
I20260709 13:12:22.950328 32085 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:22.950613 32165 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:22.951064 32085 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:22.951547 32165 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.952490 32085 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.946632 31899 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:22.960397 31925 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:22.960928 31899 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:22.961508 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.961171 31925 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:22.962273 31943 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.963614 31925 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:22.955186 31206 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.966867 31943 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:22.965687 27197 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:22.967180 31206 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.968799 32166 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:22.969365 32166 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:22.969920 32166 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.933188 32077 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.970041 31206 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:22.970556 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 185443us
I20260709 13:12:22.970584 27229 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:22.985697 32074 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.977069 32077 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.986335 31424 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:12:22.988370 32074 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:22.989274 32074 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:22.989686 32074 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:22.990883 32074 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:22.992663 32074 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.994958 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:22.995208 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:22.996778 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:22.997558 27298 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:22.998814 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:22.956347 32164 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.004644 32164 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.005121 32166 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.005762 27303 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:22.955243 32163 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.006366 32163 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.006821 32163 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.007170 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:23.012569 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 183159us
I20260709 13:12:22.998752 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.016390 27300 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.018190 32059 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.019030 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.019680 27304 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.018862 32059 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.024322 31935 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.214s	user 0.008s	sys 0.021s
I20260709 13:12:23.024953 31935 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.028040 32164 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:23.030295 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 139434us
I20260709 13:12:23.031579 32057 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.032161 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.034169 31899 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:22.967093 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:22.958457 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.049141 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.050406 32104 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.036497 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.000486 32165 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.056099 32078 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:23.047250 32057 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.056635 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 89836.3us
I20260709 13:12:23.056936 32078 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.057359 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.051066 32104 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.058248 32104 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.058490 31906 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.058175 32078 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.058943 31906 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.059357 31906 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.062429 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.063513 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.064463 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.064546 32139 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.065119 32139 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.065517 32139 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.065729 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.066298 31913 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:23.066738 31913 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.066910 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.067191 31913 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.067799 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.068732 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.069628 27231 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.070333 31818 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.055533 32097 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.056630 32126 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.072686 32097 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.073407 32097 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:23.055627 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 99202.7us
I20260709 13:12:23.074075 32164 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.075145 32166 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.074945 32164 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.076359 32030 consensus_meta.cc:287] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.861s	user 0.016s	sys 0.000s
I20260709 13:12:23.076938 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.076870 32030 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.077680 27837 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.078123 27153 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.058211 27838 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:23.077618 32164 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.070757 31818 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.082935 31818 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.086277 27833 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.086751 32059 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.087452 31922 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.088205 31922 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.088711 32057 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.067770 27230 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:23.053495 31899 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.098424 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.099215 27300 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.098907 31899 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.101290 31899 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:23.065470 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.098176 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:23.114670 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49315us
I20260709 13:12:23.124532 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.128850 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.129703 27839 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:23.133131 32139 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.134276 32088 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:23.139874 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 103526us
I20260709 13:12:23.141280 31424 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:23.142200 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.145732 31935 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.148892 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.149925 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.116593 31925 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.150472 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.151057 32070 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.151814 31922 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.152853 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.153092 32164 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.154484 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.163311 27833 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:23.166730 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.167047 27229 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.171937 27224 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.172104 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.160218 32088 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.165109 31925 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.177095 27303 raft_consensus.cc:1217] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-12.11]   Dedup: 9.9->[10.10-12.11]
I20260709 13:12:23.145732 31913 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:23.198246 27223 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.198423 31913 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.199700 31925 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.200774 31433 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:23.182308 27303 pending_rounds.cc:85] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 9
I20260709 13:12:23.201896 27303 pending_rounds.cc:107] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:23.202241 27303 raft_consensus.cc:2889] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.204448 31818 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.205076 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.205657 27228 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.206321 31430 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:23.207055 31430 consensus_queue.cc:1243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:23.207492 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.208671 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.187047 32057 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:23.204834 27051 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 3 to 7, term changed from 7 to 9, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.189065 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.189776 32179 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.189929 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.190303 31922 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:23.191310 32126 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:23.191594 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.192023 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.192907 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.193388 32015 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.231381 27836 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:23.179570 32088 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.235823 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.206550 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.188378 31917 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.238761 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57153.2us
I20260709 13:12:23.185364 31206 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.215001 27304 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.216867 27300 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:23.201889 31433 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:23.210282 27834 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:23.164232 32097 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.240921 27302 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:23.241051 32189 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:23.241263 27055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 385) took 18267 ms (client timeout 15000 ms). Trace:
I20260709 13:12:23.241575 32189 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.194619 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:23.241977 32189 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.192629 27832 raft_consensus.cc:2955] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:23.209487 32164 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.243832 32019 consensus_meta.cc:287] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.663s	user 0.015s	sys 0.000s
I20260709 13:12:23.244300 32019 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.245462 27835 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:23.245733 32164 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.241984 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:23.249648 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56859.3us
W20260709 13:12:23.248271 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72256.8us
I20260709 13:12:23.246232 32178 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.216610 32057 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.251246 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.253201 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.248632 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.249425 32097 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.259658 27305 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
W20260709 13:12:23.260118 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85343.7us
I20260709 13:12:23.260673 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.261103 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.257674 32165 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:12:23.246913 31433 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.261914 27301 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:12:23.262126 31899 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:23.259778 32019 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.263441 31899 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:23.263038 31433 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:23.263839 31899 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:23.241708 27055 rpcz_store.cc:269] 0709 13:12:04.974339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.974662 (+   323us) service_pool.cc:224] Handling call
0709 13:12:23.241019 (+18266357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:16.022887 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:16.242303 (+219416us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:16.262839 (+ 20536us) write_op.cc:435] Acquired schema lock
0709 13:12:16.268724 (+  5885us) tablet.cc:662] Decoding operations
0709 13:12:16.639381 (+370657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:16.639504 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:16.639535 (+    31us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:12:17.052362 (+412827us) tablet.cc:701] Row locks acquired
0709 13:12:17.052411 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:12:17.052600 (+   189us) write_op.cc:270] Start()
0709 13:12:17.052754 (+   154us) write_op.cc:276] Timestamp: P: 1783602737052528 usec, L: 0
0709 13:12:17.052792 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:12:17.053549 (+   757us) log.cc:844] Serialized 11494 byte log entry
0709 13:12:17.776701 (+723152us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.961709 (+185008us) write_op.cc:301] APPLY: starting
0709 13:12:17.961815 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:18.353272 (+391457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:18.353477 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:19.553342 (+1199865us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800384160. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:19.693966 (+140624us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b1800384160. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a557 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:19.703059 (+  9093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:19.703471 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:12:19.703534 (+    63us) write_op.cc:312] APPLY: finished
0709 13:12:19.704109 (+   575us) log.cc:844] Serialized 252 byte log entry
0709 13:12:19.978501 (+274392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:20.008672 (+ 30171us) write_op.cc:454] Released schema lock
0709 13:12:20.019651 (+ 10979us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:20.040395 (+ 20744us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:20.049805 (+  9410us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1269444,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":182906,"apply.run_cpu_time_us":70912,"apply.run_wall_time_us":2062083,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125173,"num_ops":29,"prepare.queue_time_us":155243,"prepare.run_cpu_time_us":39480,"prepare.run_wall_time_us":1231259,"raft.queue_time_us":202401,"raft.run_cpu_time_us":16201,"raft.run_wall_time_us":173539,"replication_time_us":683185,"spinlock_wait_cycles":74159744,"thread_start_us":694628,"threads_started":5,"wal-append.queue_time_us":610967,"wal-append.run_cpu_time_us":107906,"wal-append.run_wall_time_us":2685877}]]}
I20260709 13:12:23.264441 31433 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.264761 31899 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.266283 32160 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.267241 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.260998 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.262989 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.272665 31206 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.252416 32057 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.276154 27305 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.279016 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.237977 31922 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.279568 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.266772 32160 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:23.283829 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 237982us
I20260709 13:12:23.284672 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.252722 32015 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.295014 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.293474 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:23.301334 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 84985.1us
I20260709 13:12:23.303231 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.304095 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.266870 32126 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.287185 32030 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.307303 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.313377 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.289731 32160 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.296684 32164 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.272964 32179 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.316416 31206 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.314640 32073 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.316066 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.317790 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.305673 31899 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.319020 32165 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.322664 32165 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.319432 27229 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.319831 27297 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.320647 32075 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:23.320972 32187 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:12:23.321158 31813 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:23.316493 27051 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 6 to 10, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 10 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.321581 32086 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:23.289304 32005 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.288975 31917 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.335167 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.281471 32178 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.324896 32165 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.317499 32139 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.332695 27302 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:23.334177 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.314678 32101 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:23.316473 32164 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:23.337461 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.327580 32073 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:23.335431 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.341284 27231 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.311721 32097 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:12:23.344375 32075 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:23.344812 32015 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.344936 32075 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:23.345398 31917 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:23.345954 32075 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.347054 32005 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.347812 27838 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:12:23.349119 27051 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.316444 32077 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:12:23.318269 32104 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.354417 27835 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:23.351893 27051 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.339614 31818 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.343240 32073 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.327776 32163 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.370345 32021 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:23.334976 31813 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.375101 32126 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.375861 31813 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.376787 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.362636 32097 consensus_queue.cc:1243] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:23.383042 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.382489 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.384790 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.385563 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.387562 27228 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:23.389766 27150 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:23.364528 32030 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:23.388469 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.361879 32015 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.392416 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.394989 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.397397 27051 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 2 to 8, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 8 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:23.384018 32104 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.402423 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.405143 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.405342 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.406392 32156 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.407162 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.408166 32179 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:23.408690 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.408993 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.388787 32178 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.443022 32086 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:23.443508 32086 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.444351 32086 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.445590 32086 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.414465 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.448299 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.448969 32077 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.449215 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.415026 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.450318 31913 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.451025 31913 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.409739 32164 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.452040 32164 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.420980 31563 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.452558 31563 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.453536 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.421972 31813 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.453514 31563 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.454310 31813 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:23.420433 32163 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.454919 31563 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.455482 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.456041 27153 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.456146 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.457121 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.457711 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.458267 32005 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:23.427067 31943 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:23.458506 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.458700 32005 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.459123 32005 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.429000 27154 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:23.459801 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.410372 31922 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.458273 27151 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.434327 27152 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:23.434484 27156 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.434672 27224 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.463464 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.463877 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.464184 27231 raft_consensus.cc:2393] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.465642 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.466687 32101 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.467021 32189 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.467224 32101 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.467962 27156 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.434790 27228 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.469413 32101 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.400379 32126 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.470306 32126 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.470674 32126 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.436287 32156 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.472126 32185 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:12:23.473214 32156 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.439098 32139 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:23.473840 32139 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.399607 32015 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.441656 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 132559us
I20260709 13:12:23.474920 32139 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.476286 32139 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.441247 32078 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:23.442112 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 148677us
I20260709 13:12:23.442225 31430 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:23.442447 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.411374 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.449388 32077 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.450350 27835 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.451073 32166 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.400110 32030 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:23.454794 31813 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.423913 32029 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:23.424916 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71940.5us
W20260709 13:12:23.493319 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 190127us
I20260709 13:12:23.480166 27305 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:23.441048 31925 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.480567 27151 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:23.487332 31206 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:23.496414 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.492125 27051 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 10, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 10 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.481343 31913 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.469449 32189 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.500141 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.489425 32166 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.506626 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.513237 27231 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:23.514916 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.514475 31906 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.516922 31925 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.517613 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.525095 27223 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:23.525758 32194 log.cc:927] Time spent T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.113s	user 0.004s	sys 0.000s
I20260709 13:12:23.517413 27051 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 11 to 12, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.527319 27051 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.528903 27051 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.531175 32015 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.531414 31430 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:23.522197 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.533880 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.497830 32057 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.531059 32070 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:23.536834 27225 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.544430 27223 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:23.541352 27051 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 8, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 8 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:23.534368 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.546485 32030 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.548388 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.549291 32078 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.549322 31917 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:23.549820 32078 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.547034 27051 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.550206 32078 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.550484 31917 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:23.550976 31917 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.551177 27051 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.551817 31917 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.554185 27228 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:12:23.555811 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 68930.9us
W20260709 13:12:23.556843 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56708.3us
I20260709 13:12:23.558670 27153 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:23.522835 32166 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.520563 32085 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.510790 32029 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:23.566658 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 44531.1us
I20260709 13:12:23.534874 31430 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.577489 27051 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 8, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.579653 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:23.579600 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 73080.7us
I20260709 13:12:23.580848 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.573573 31943 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:23.545670 32160 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.589354 32156 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.594241 32156 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.593797 31906 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:23.594795 32156 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.599169 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.578296 31430 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.600170 31922 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.600400 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.601151 32163 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.571341 32085 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:23.607085 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.587127 31818 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:23.610410 31818 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:23.610773 31818 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.590996 32088 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.616461 32088 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.591281 32073 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.618971 32073 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.619159 31818 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.622300 32029 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.624686 31430 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.626026 27149 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.627877 31818 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.629426 31430 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.579572 31925 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:23.591987 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.601583 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.632966 27835 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.640899 32163 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:23.642786 27051 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 10 to 11, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:23.643978 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52107.8us
I20260709 13:12:23.634433 31925 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.653177 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.630286 31943 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:23.655983 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.659117 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.661192 27051 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 9, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:23.662401 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 80445.7us
I20260709 13:12:23.649329 32074 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:23.649471 32179 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:23.579964 32077 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.664785 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.669996 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.667395 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.667670 27228 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:23.670504 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.672617 27301 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.672199 27297 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:23.659987 31943 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.677882 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.677145 27051 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.678561 27223 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.679802 27195 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.681071 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.682127 27225 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.686789 31996 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:23.687384 31424 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.687942 32088 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:23.688477 32088 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:23.688076 31424 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.688910 32088 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.690809 32005 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.691723 31424 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:23.692296 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 85287.8us
I20260709 13:12:23.692931 32005 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.673038 31925 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.697402 31925 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:23.699960 32198 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:12:23.684988 32104 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:23.665143 32075 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:12:23.702595 32075 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.703002 32075 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:23.703785 32075 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.667126 32200 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:12:23.705010 32075 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.705684 32200 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:23.706094 32200 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.706310 32057 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.706476 32077 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.707345 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.707036 32200 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.708124 31922 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:23.708566 32200 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.708544 31922 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:23.709304 31922 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:23.711556 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44250us
I20260709 13:12:23.712390 32160 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.714083 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.714898 32189 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:23.714975 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.673091 32179 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.670004 32021 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:12:23.718608 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:23.719903 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.720544 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.715466 32189 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.724831 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.727015 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.718880 27051 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.740535 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.666200 32165 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:12:23.743705 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.743526 27838 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:23.741379 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.742147 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.723506 32179 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.749404 27151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:12:23.751173 27151 raft_consensus.cc:606] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.749698 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.749478 32189 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.725042 31996 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:23.752939 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.753942 27840 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.753786 27836 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:23.727746 32057 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.755676 27835 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:23.755753 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.756693 27152 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:23.758740 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.759212 27150 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.759279 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.759862 27151 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.761293 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.727596 32101 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:12:23.764843 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.766986 27300 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:23.769158 32126 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.769951 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.771245 32178 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:23.771639 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.772245 27152 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:23.774889 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.762174 32057 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.778970 32057 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:23.783393 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:23.783994 27306 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.784653 27302 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:23.785804 27301 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:23.779098 31813 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.787462 32073 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:23.785163 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:23.789296 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74387.9us
I20260709 13:12:23.793252 27151 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:23.796432 32085 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.789742 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.754412 31913 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.799973 31913 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.805263 27150 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:23.805553 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.811213 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:23.815629 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49324.2us
I20260709 13:12:23.818735 27156 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.819059 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.822433 31913 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:23.824071 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.823730 32166 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.825314 31818 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:23.825403 32057 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:23.825886 31818 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.827708 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.822461 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.828943 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.817735 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.804559 32021 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:23.835978 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.836773 27151 raft_consensus.cc:2376] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6. Re-sending same reply.
I20260709 13:12:23.837424 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.837625 31913 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:23.838963 31913 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.839466 31913 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.839933 32156 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.840656 31913 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.826961 31818 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:23.846673 32197 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.316s	user 0.001s	sys 0.001s
I20260709 13:12:23.846679 32029 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:23.849457 32199 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:23.850114 32029 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:23.850517 32164 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:23.852308 32164 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.850800 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.851511 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.853222 27231 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:23.853557 27229 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:23.853353 32164 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.854164 27228 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:23.854760 32164 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.849879 32199 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:23.855252 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.855173 32029 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.856879 31430 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:23.816206 32160 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.856324 32199 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.858326 32160 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.850618 27225 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.858780 32160 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.858780 32199 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.859547 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.837570 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.861898 27152 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.835171 32139 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.862913 32139 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:23.854966 31913 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.863865 32139 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:23.864667 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.868769 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.810240 31424 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:12:23.870532 31424 consensus_queue.cc:1243] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:23.871037 31424 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:23.871364 31424 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:23.872613 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.873324 27150 raft_consensus.cc:2368] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:23.812714 32126 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.876672 27306 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:23.877890 27051 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:23.885393 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 79940.7us
I20260709 13:12:23.886653 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.889526 27152 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:23.826037 32166 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.889254 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.890563 27227 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:23.890563 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.894027 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.894815 27156 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:23.895051 27153 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:23.894112 27151 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.892982 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.891310 27149 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14. Re-sending same reply.
I20260709 13:12:23.900537 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.895481 27051 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.881987 32156 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:23.911479 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.827939 32078 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:23.849857 32088 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.913659 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.914476 27156 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:23.915709 32196 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.333s	user 0.005s	sys 0.002s
I20260709 13:12:23.916966 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.918170 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.827785 32179 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.913587 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.906452 32104 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:12:23.925845 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.926566 27156 raft_consensus.cc:2368] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
W20260709 13:12:23.927368 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 408765us
I20260709 13:12:23.931860 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.895618 31813 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:23.934269 27149 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:23.938257 27841 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:23.933691 27051 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 11 to 12, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.933262 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:23.938290 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:23.941399 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.942008 27836 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 6.
I20260709 13:12:23.939221 27152 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14. Re-sending same reply.
I20260709 13:12:23.943967 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:23.944310 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.944953 27838 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:23.945554 31960 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:23.946187 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.946609 27228 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:23.946935 31960 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:23.947292 32078 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:23.947409 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:23.947700 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.946406 27051 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 9, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.948558 27231 raft_consensus.cc:2410] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:23.948611 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:23.949528 31960 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:23.949577 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.950271 27223 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:23.950316 31960 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:23.953011 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:23.953639 27306 raft_consensus.cc:606] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:23.953955 27306 raft_consensus.cc:614] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:23.954828 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.955556 27833 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:23.956663 27225 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.945019 27224 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:23.949977 27804 leader_election.cc:400] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:23.963040 27150 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:23.957110 31424 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.957778 31960 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:23.967108 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:23.972345 27151 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.974848 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:23.972183 27122 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.979475 27152 raft_consensus.cc:1240] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.980201 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.981508 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:23.984463 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.984833 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.985419 27153 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:23.985954 27227 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.986312 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.966540 32029 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:23.987797 27302 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:23.989460 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:23.992532 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:23.993415 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:23.996580 27837 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:23.997388 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.998749 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.998442 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.000198 31813 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:24.001171 31960 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:23.996414 32029 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:24.002143 32029 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:24.003211 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:24.003754 32074 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:24.004091 31813 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:24.004340 32074 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.004671 31813 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.005285 32074 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.005605 31813 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.006876 32077 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:24.006910 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.007356 32077 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:24.007602 27302 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.999532 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:24.009246 27839 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:23.978978 32104 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:23.978982 31424 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.034488 27302 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:24.018350 27300 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:24.022243 32156 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.022571 32160 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.022742 32208 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.027247 27835 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:24.046154 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:24.027642 31917 raft_consensus.cc:2764] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:24.028352 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:24.014213 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:24.035969 27225 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:24.036911 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.040961 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:24.054679 27151 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:24.042263 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 92404.9us
I20260709 13:12:23.996367 32163 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:24.045827 27153 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:12:24.051129 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58278.2us
I20260709 13:12:24.029794 31818 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:24.056432 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:24.015980 32104 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.028371 31430 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.069159 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:24.069841 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.068637 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:23.979393 31943 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.078487 32126 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:24.078370 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.082587 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.087050 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:24.081820 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67721.6us
I20260709 13:12:24.089803 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:24.080253 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.091817 27302 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.093055 27148 raft_consensus.cc:2368] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:24.094964 27223 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:24.097846 27224 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:24.097998 31206 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.079905 32104 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.102886 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.066634 31818 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:24.087392 31433 raft_consensus.cc:2764] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:12:24.108856 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.045814 32156 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.110220 27303 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:24.110848 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:24.111657 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.115315 32014 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:24.116043 32126 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.117271 32126 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.052081 31922 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.125156 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:24.114020 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.115149 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58791.1us
I20260709 13:12:24.107359 27151 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:24.122236 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.122609 27153 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:24.124503 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.128922 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:24.130982 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75311.2us
I20260709 13:12:24.131641 32005 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:24.132426 32005 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:24.133065 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.107862 32015 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.138538 32015 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.140677 32015 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.120942 31899 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.092435 31430 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.101892 31917 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:12:24.087568 32189 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:24.121313 32078 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:12:24.133468 32005 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.108191 32021 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:24.142023 32160 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:24.158826 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.142571 31899 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.120064 32086 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:12:24.160936 32086 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:24.161296 32086 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:24.119591 32163 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.162976 32163 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.165874 27149 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:24.169018 27152 raft_consensus.cc:2393] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:24.146019 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:24.169857 27299 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:24.150771 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.151474 27231 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:24.170372 27303 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:24.151785 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:24.152087 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:24.153479 27306 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:24.150394 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:24.173884 27225 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:24.131729 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:12:24.179767 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48120us
I20260709 13:12:24.181953 27230 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:24.150337 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:24.185544 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.183897 27302 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:24.187971 32179 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:24.184353 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.183943 27153 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:12:24.192086 27153 raft_consensus.cc:606] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.192451 27153 raft_consensus.cc:614] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:24.192360 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.192112 32030 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:24.193711 32030 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.189450 32077 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.195845 32077 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.198256 27300 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:24.207358 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.194577 32030 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.212394 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:24.214877 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.219964 27227 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:24.145115 31430 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.152026 31917 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:24.155947 32088 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.250535 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:24.251150 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.209185 32178 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.261325 27836 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:24.206974 31899 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:24.185513 32139 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:24.240058 32075 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.265208 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:24.214876 32208 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:24.273501 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.253363 31917 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:24.273687 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:24.273937 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 93311.7us
I20260709 13:12:24.275328 27804 leader_election.cc:400] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:24.276119 27271 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.267634 32021 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.267392 32178 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:24.270834 32030 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:24.285252 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.271409 32156 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.207336 32086 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.281596 32021 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.285276 32178 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.280777 31922 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.289760 32164 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.300004 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:24.272051 32139 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.285622 32222 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:24.313117 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.291404 32160 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.320359 32222 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:24.286082 32075 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:12:24.324709 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.340040 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46060.6us
I20260709 13:12:24.308542 32021 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:24.343142 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 149032us
W20260709 13:12:24.355193 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.357815 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 115009us
I20260709 13:12:24.277205 31818 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.360853 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:24.364893 32223 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:24.366288 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:24.341259 31906 consensus_queue.cc:1175] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4afe81810944d70bc2cc31754392f3d" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:12:24.371412 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:24.376622 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 86156.1us
I20260709 13:12:24.378286 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.379243 27304 raft_consensus.cc:2368] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:12:24.322969 32222 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.351478 31943 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:24.359752 32086 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.391366 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.393330 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.389410 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:24.393108 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:24.422906 31818 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.319087 31917 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.341023 32160 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.355571 32029 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.363724 31899 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:24.431201 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:24.481765 27837 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:24.436803 32217 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:12:24.442710 32216 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:12:24.319407 32014 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:12:24.371093 31813 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:12:24.452247 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64135.9us
I20260709 13:12:24.452737 27152 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:24.453076 27835 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260709 13:12:24.376921 32200 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 13:12:24.503521 27835 pending_rounds.cc:85] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 10
I20260709 13:12:24.503841 27835 pending_rounds.cc:107] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:12:24.504068 27835 raft_consensus.cc:2889] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:24.506981 32139 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.507656 32189 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.508240 32189 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.511094 27305 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:24.461266 27157 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:24.381934 32075 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.464920 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.468466 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.471411 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:24.470784 32057 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.491523 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.517877 27302 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:24.497114 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.497586 27836 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:24.486356 32179 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.523164 32057 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.523468 32200 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:24.523726 32179 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.524904 32075 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.525398 32075 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.518436 27303 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:24.526800 31813 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:24.500522 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.527204 31813 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.528069 31813 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.528472 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:24.501478 32160 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.455582 32156 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:24.494164 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.537451 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.538790 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.541436 27836 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:24.541836 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:24.503273 32164 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:24.507221 32029 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:24.523093 27840 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:24.532115 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:24.550730 27832 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.546433 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:24.546733 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.525861 32179 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:24.525547 32057 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.530133 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.558540 27299 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:24.549048 32030 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.549363 32166 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.567144 32166 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:24.567528 32166 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:24.568833 31424 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 13:12:24.542940 32156 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:24.552239 27301 raft_consensus.cc:2376] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14. Re-sending same reply.
I20260709 13:12:24.535499 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:24.550655 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.547021 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:24.594950 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47995.9us
W20260709 13:12:24.598827 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.546782 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.576889 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.602486 27302 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:24.575088 32085 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:24.604014 31917 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.603827 32085 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:24.607733 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.590843 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 90379.3us
I20260709 13:12:24.611074 32156 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.612622 32156 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.593845 27304 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:24.607620 31913 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.614586 31913 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.616590 31913 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.617065 31913 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:24.624238 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.625520 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.577244 32104 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:24.627197 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.627972 27229 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:24.629346 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.630796 32088 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:24.631343 32088 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:24.631419 27148 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:24.632385 32088 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.633500 27148 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:24.635417 32085 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.546066 32229 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:24.555415 32160 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:24.536938 32139 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:12:24.639678 32232 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:24.520834 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 127199us
I20260709 13:12:24.651867 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.647876 27837 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:12:24.657063 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.656709 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.659137 27301 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:12:24.660883 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.545475 32015 consensus_queue.cc:1059] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:12:24.663950 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.665249 27302 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:24.547001 31922 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:12:24.666671 27299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d425a845db244636a6b92ed85545087c"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:24.669569 27299 raft_consensus.cc:606] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:24.669906 27299 raft_consensus.cc:614] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:24.598701 31813 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.671034 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:24.671677 27148 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:24.598467 32189 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:24.654160 31960 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:24.688802 27832 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:24.701390 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.662222 32078 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:12:24.722002 32233 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:12:24.720072 32078 consensus_queue.cc:1243] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:24.724556 31433 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:24.724992 31433 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:24.726153 27155 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:24.727360 32227 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:24.728781 32231 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:24.729363 32231 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.731523 32231 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:24.731750 27306 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:24.722033 32104 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:24.736202 32178 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.739174 27306 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:24.741477 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.751376 27148 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
W20260709 13:12:24.753676 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.754830 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:24.755743 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.757949 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.768570 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.770568 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:24.725878 31433 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.768123 31943 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:24.775496 31943 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.784483 32227 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:24.788478 32227 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:24.790037 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.703879 31960 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:24.795542 31960 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:24.811143 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:24.812758 32077 consensus_meta.cc:287] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.616s	user 0.004s	sys 0.009s
I20260709 13:12:24.830856 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:24.831949 27153 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:24.832314 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.833521 27304 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:24.834738 27148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:12:24.835443 27148 raft_consensus.cc:606] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.836118 27148 raft_consensus.cc:614] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:24.833990 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 207320us
W20260709 13:12:24.880692 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 272256us
I20260709 13:12:24.881497 27157 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:24.882771 27301 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:24.883251 27804 leader_election.cc:400] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:24.898790 27804 leader_election.cc:403] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:24.914264 27306 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:24.825338 31960 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:24.833639 31899 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:24.893036 27155 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:24.838510 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.884085 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:24.929685 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:24.963686 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:24.831660 32178 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:24.988505 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 105363us
I20260709 13:12:24.838349 32231 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:25.008563 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 170112us
I20260709 13:12:25.028070 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.011324 27837 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:25.037568 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.019061 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.025038 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:25.042025 27148 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.040807 27157 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:24.952196 32104 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:24.965804 32074 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.981792 32160 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:25.061623 31206 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.062567 31206 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:25.050625 32088 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:25.071460 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 271919us
I20260709 13:12:25.021327 32005 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.005240 32057 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:25.007910 32240 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:25.046228 32232 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:24.981907 31818 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 13:12:25.084203 27806 leader_election.cc:336] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.614s (SENT)
I20260709 13:12:25.084407 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.051849 32077 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.115698 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 231697us
I20260709 13:12:25.017653 32166 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.089753 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.094744 31206 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:25.103729 27305 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:24.997970 31960 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.113158 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.114902 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:25.115783 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.086319 27148 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:25.120611 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.122237 27304 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:25.119940 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 58609us
I20260709 13:12:25.045614 32231 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.126258 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:25.129101 27302 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:12:25.133136 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 105177us
I20260709 13:12:25.133231 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.136044 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.068410 32104 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.155201 32250 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:12:25.116389 32057 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.150920 32248 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.157689 32057 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.158704 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:25.115638 32014 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:25.151247 32227 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:25.075008 32074 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.159811 32227 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:25.118880 32253 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:12:25.161765 32074 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.161926 32253 consensus_queue.cc:1243] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:25.151367 32240 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:25.094410 32005 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:25.120837 32077 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.185509 27148 pending_rounds.cc:85] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 8
I20260709 13:12:25.186004 27148 pending_rounds.cc:107] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:12:25.186344 27148 raft_consensus.cc:2889] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:25.082705 32160 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:25.171316 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.173785 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:25.189611 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 105446us
I20260709 13:12:25.178529 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:25.165181 32222 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
W20260709 13:12:25.177021 31813 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
W20260709 13:12:25.165586 32021 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.002s
W20260709 13:12:25.169461 32075 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.643s	user 0.006s	sys 0.002s
I20260709 13:12:25.201886 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.162125 32015 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:25.171181 32156 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.005s
I20260709 13:12:25.229043 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.162869 32074 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:25.166426 32030 raft_consensus.cc:3055] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:25.162009 32227 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.178241 32179 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.216400 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.385211 27305 raft_consensus.cc:2376] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9. Re-sending same reply.
I20260709 13:12:25.386387 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.167716 32005 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.213508 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.168928 31960 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.163295 32166 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.195585 32189 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.390260 32189 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.390808 32245 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:12:25.392800 32189 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.386371 27150 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:25.179850 32104 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.228634 27151 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:25.394555 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.229748 27231 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:25.396066 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:25.230238 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.164256 32231 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.217042 27301 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:25.291029 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.328959 27154 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:25.397688 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 243432us
I20260709 13:12:25.288919 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.316975 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.401365 27149 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:25.402626 27302 raft_consensus.cc:2376] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14. Re-sending same reply.
I20260709 13:12:25.291673 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.326010 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.309854 31433 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.341049 31943 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.386746 32015 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:25.339243 32246 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
W20260709 13:12:25.316176 32239 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
I20260709 13:12:25.319566 32235 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:25.229244 32075 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.290362 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.152045 31899 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.341926 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.309966 27298 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:25.229482 32021 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.289772 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:25.302608 32244 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:12:25.296938 32255 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:12:25.234380 32030 raft_consensus.cc:740] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:25.216637 32222 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.206409 32240 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:25.278141 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.295992 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:25.388034 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.171171 32077 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:25.398162 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:25.441776 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.399047 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.164758 32230 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:12:25.405965 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:25.332072 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:25.411036 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.413704 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.444080 27157 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:25.412374 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:25.417181 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 266656us
I20260709 13:12:25.417631 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:25.418838 27806 leader_election.cc:336] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.778s (SENT)
W20260709 13:12:25.445662 27806 leader_election.cc:336] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.816s (SENT)
W20260709 13:12:25.421597 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.446118 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.444072 27153 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:25.428117 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.429622 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.447693 27297 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:25.439512 27299 raft_consensus.cc:2376] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12. Re-sending same reply.
I20260709 13:12:25.448691 27303 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:25.419773 32179 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:25.436156 27304 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:25.446767 27300 raft_consensus.cc:2376] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12. Re-sending same reply.
I20260709 13:12:25.452322 27227 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:25.436863 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:25.440701 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 144826us
I20260709 13:12:25.440896 27152 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:25.437784 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.432156 27306 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:25.453619 27298 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 6.
I20260709 13:12:25.453661 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:25.423895 32235 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:25.455125 27155 raft_consensus.cc:2368] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16.
I20260709 13:12:25.455341 27835 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:25.455473 27302 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:25.456322 27150 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:25.460826 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.463135 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:25.472611 27223 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:25.471086 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:25.472846 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.448185 32104 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:25.465215 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.477687 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.433110 32231 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:25.473322 32077 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.502270 32232 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.502965 32253 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:25.506824 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.528533 27226 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:25.497048 32104 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.440445 31943 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:12:25.510010 32057 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.509482 32235 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.460505 32166 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.517849 27224 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:25.518666 31206 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:25.519164 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48183us
W20260709 13:12:25.555327 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 109680us
I20260709 13:12:25.473050 31960 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.496181 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:25.521967 27305 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:25.521891 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.561513 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:25.472823 32251 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:25.511430 31922 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:12:25.547374 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.495528 32262 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:25.459915 32179 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.553942 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.575752 27226 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:25.514431 32261 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:25.559334 27229 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:25.559715 31206 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:25.523906 31906 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:25.523967 32075 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:25.531733 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 97220us
W20260709 13:12:25.572086 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75978.9us
I20260709 13:12:25.548436 32104 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.587698 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:25.556645 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1029) took 1161 ms. Trace:
I20260709 13:12:25.588658 27839 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:25.573791 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:25.579330 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.579916 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1383) took 1129 ms. Trace:
I20260709 13:12:25.591255 27838 rpcz_store.cc:276] 0709 13:12:24.450719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.451523 (+   804us) service_pool.cc:224] Handling call
0709 13:12:24.481755 (+ 30232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:24.527885 (+ 46130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.527920 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:24.528505 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:12:24.809779 (+281274us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:24.826925 (+ 17146us) log.cc:844] Serialized 14 byte log entry
0709 13:12:24.836755 (+  9830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.155910 (+319155us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54007341d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:25.155962 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:25.338395 (+182433us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:25.393186 (+ 54791us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b180042bc20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:25.579702 (+186516us) raft_consensus.cc:1685] finished
0709 13:12:25.579729 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.579862 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12017,"prepare.queue_time_us":16950,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":232,"raft.queue_time_us":80084,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":52825,"spinlock_wait_cycles":163171328,"thread_start_us":275444,"threads_started":1,"wal-append.queue_time_us":450635}
I20260709 13:12:25.512735 32030 consensus_queue.cc:260] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.530586 32077 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.600857 32263 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:25.601308 32259 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:25.601699 32259 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.598377 27832 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:25.564373 32166 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:25.512899 32015 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.602659 27806 leader_election.cc:400] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:12:25.622480 31206 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:25.622748 27806 leader_election.cc:403] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:12:25.608076 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.576447 32235 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.554963 32057 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.576493 32251 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:25.614727 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.548623 32253 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.548542 32232 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.617183 27225 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:12:25.632800 27225 pending_rounds.cc:85] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 5
I20260709 13:12:25.633141 27224 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:25.613457 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57543.7us
I20260709 13:12:25.588585 27841 rpcz_store.cc:276] 0709 13:12:24.389287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.389511 (+   224us) service_pool.cc:224] Handling call
0709 13:12:24.389847 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:24.474833 (+ 84986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:24.479255 (+  4422us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:24.499337 (+ 20082us) log.cc:844] Serialized 52 byte log entry
0709 13:12:24.767061 (+267724us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:24.767118 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.767217 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:25.550102 (+782885us) raft_consensus.cc:1685] finished
0709 13:12:25.550130 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:25.550307 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72997,"raft.queue_time_us":121744,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":22107,"thread_start_us":267291,"threads_started":1,"wal-append.queue_time_us":451786}
I20260709 13:12:25.582484 31906 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.602021 32265 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:25.583050 32262 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:25.626509 27226 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:25.616829 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.665881 27232 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:25.618811 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.633142 27225 pending_rounds.cc:107] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:25.570611 32240 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.615505 32259 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.624941 32075 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:25.663100 27228 raft_consensus.cc:1240] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:25.666755 27225 raft_consensus.cc:2889] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:25.671139 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 52403.5us
I20260709 13:12:25.663789 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.670271 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.672909 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.669310 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.674337 27226 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:25.678328 27225 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:25.634471 32230 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:25.595476 32261 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.664021 31906 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:25.680478 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.695509 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.678938 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.681849 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:25.682654 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.684808 32179 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:25.677443 32085 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.699699 27224 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:25.685381 32077 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.685863 32251 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.687498 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.696307 27226 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:25.696424 27298 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:25.694410 32267 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:12:25.666303 32021 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.696760 27225 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:25.685181 32057 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.697085 31913 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:25.704200 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.681953 32222 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:25.677510 31943 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7.
I20260709 13:12:25.710361 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:25.711181 32077 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.711796 32077 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.712162 32077 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.713083 32272 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.713238 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 1096) took 1088 ms. Trace:
I20260709 13:12:25.713605 27152 rpcz_store.cc:276] 0709 13:12:24.625100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.625242 (+   142us) service_pool.cc:224] Handling call
0709 13:12:25.713018 (+1087776us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54003566d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:25.713152 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873378176}
I20260709 13:12:25.714349 27151 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:25.714912 27232 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:25.676244 32265 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.675863 31899 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:25.733505 27298 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:25.720577 32077 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.741828 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:25.708367 32005 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.709507 32166 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:25.766252 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 163698us
I20260709 13:12:25.771059 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.771921 32222 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.774397 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.775179 32222 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:25.775580 32222 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:25.775944 32222 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.776569 32077 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.742916 32057 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:12:25.751577 32275 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:12:25.751472 32262 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.752432 32264 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:25.757937 31424 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:25.790786 31424 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:25.791705 31424 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.759249 32261 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.764562 32253 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.759665 32265 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.762566 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:25.763504 32232 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:25.764544 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.796339 31906 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.765632 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.797719 27302 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:25.766208 27305 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:25.798580 32077 consensus_queue.cc:1059] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:25.743359 32278 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:12:25.799608 32077 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:25.800009 32077 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:25.800488 32278 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:25.777745 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1388) took 1303 ms. Trace:
I20260709 13:12:25.800983 32278 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:25.800891 32077 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.801259 27835 rpcz_store.cc:276] 0709 13:12:24.474724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.507436 (+ 32712us) service_pool.cc:224] Handling call
0709 13:12:24.507718 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:25.455685 (+947967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.777462 (+321777us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b5400510754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:25.777671 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178909568}
I20260709 13:12:25.778838 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.802296 27226 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.805693 32030 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:25.810940 27226 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
W20260709 13:12:25.784711 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 173354us
I20260709 13:12:25.790248 32264 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:25.812379 32264 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.796967 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.816838 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:25.817842 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.818461 32164 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.819064 32164 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.819257 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.820128 32280 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:25.820547 32280 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:25.820896 32280 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.821318 32164 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.821411 32253 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:25.822237 32279 raft_consensus.cc:2764] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:12:25.822005 32253 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.823069 32279 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:25.829092 32280 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.829941 31906 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:25.833150 32014 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:25.841840 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:25.844111 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.848066 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.848201 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:25.821950 32164 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:25.851083 32232 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:25.865060 27228 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:12:25.865000 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 169540us
I20260709 13:12:25.866081 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.866366 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:25.866894 31913 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.866983 27227 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:25.870826 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:25.871628 27299 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:25.875792 32077 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.878144 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.879518 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.881091 27197 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.882545 27227 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:25.849570 32014 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:25.895066 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 120726us
I20260709 13:12:25.839020 32253 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:25.895910 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.862563 32232 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:25.892537 31906 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:25.877230 32265 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.871546 31917 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.896106 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:25.893386 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:25.890301 32164 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:25.889925 32277 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:25.853500 32230 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:12:25.916363 31206 consensus_queue.cc:1059] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:25.917090 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:12:25.942651 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49328.7us
I20260709 13:12:25.918183 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:25.898227 32075 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.894675 31913 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:12:25.929409 27197 leader_election.cc:336] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.500s (SENT)
I20260709 13:12:25.896719 32085 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:25.842207 32278 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:25.958175 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 62222.4us
I20260709 13:12:25.898699 32074 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:25.894776 31433 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:25.964726 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:25.962170 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:25.937045 32265 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.970252 32259 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.972632 32278 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.973253 32251 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:25.973848 32251 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:25.974313 32282 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:12:25.976153 32251 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:25.976310 32160 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:25.972755 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.912444 32232 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.911048 32235 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:25.984769 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:12:25.986805 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.981704 32277 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:25.935092 32021 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.910785 32249 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:25.965313 32156 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:25.911325 32073 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:12:25.963848 32078 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:25.977874 31424 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.917217 31943 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:12:26.023738 32249 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:25.982544 32251 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:26.037535 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 108162us
W20260709 13:12:25.977161 32279 consensus_queue.cc:1175] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1010256288ec4502b330749e2e3d7c85" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:12:25.993242 32179 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:26.046681 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61966.3us
I20260709 13:12:26.051218 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:25.996356 32277 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.011583 32231 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.006341 32156 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.061959 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.032735 31433 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:25.993676 32272 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:12:25.980031 32164 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:26.066512 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 148571us
I20260709 13:12:26.058589 32189 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.066181 27839 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:25.978134 32075 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.000370 32160 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:12:26.003654 32021 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.086236 32288 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:12:25.963289 32014 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.059854 32277 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:26.088374 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.086377 32284 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.062816 32253 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:26.088608 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.067519 32156 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:26.067068 32231 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:26.097285 32280 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:26.097477 32209 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:26.100206 27839 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:26.105355 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.112907 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.113222 27305 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:26.113653 27154 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:26.114270 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.114952 27305 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:26.118330 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.118952 32014 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:26.119445 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.122650 32075 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.091877 32189 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.124356 27299 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:26.125398 32189 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.111544 32104 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.129073 32104 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.105705 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.125420 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.129974 27304 raft_consensus.cc:2368] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16.
I20260709 13:12:26.130893 27223 raft_consensus.cc:2368] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:26.058779 32251 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.138131 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:26.123464 32258 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:26.106074 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.141309 27306 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:26.133077 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.133419 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.142650 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.143173 27305 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.095304 31433 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:26.138435 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:26.138950 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:26.109251 32074 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.167307 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 117917us
I20260709 13:12:26.062541 32179 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.170403 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:26.170609 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.171027 27152 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.133925 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:26.148799 32286 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:26.149149 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:26.149765 27103 auto_rebalancer.cc:893] Removing replace marker failed: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:26.150074 27155 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:26.150350 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.151221 27299 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:26.192198 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.157019 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.193079 27835 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:26.158269 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.158316 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.160388 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.195159 27150 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:26.160521 27304 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:26.139273 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.165437 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.165642 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.166922 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.198570 27837 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.112063 32231 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.167366 27302 raft_consensus.cc:1275] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:26.166823 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.203022 27841 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.203068 27305 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:26.167919 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:26.168743 27197 leader_election.cc:336] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.797s (SENT)
I20260709 13:12:26.166800 32299 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.190420 27157 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:26.190713 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.176409 27156 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:26.198868 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:26.204873 27197 leader_election.cc:336] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.009s (SENT)
I20260709 13:12:26.205304 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.204897 27298 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:26.190382 32078 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:26.169939 32029 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.172631 32272 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:26.201648 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.212817 27838 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:26.201495 32297 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:12:26.175035 32209 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.216986 27835 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:26.220036 27837 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
W20260709 13:12:26.225126 27103 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:12:26.202659 32280 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:26.226809 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61251.4us
I20260709 13:12:26.172196 32074 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.228609 32078 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.227123 31913 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.232708 31424 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:26.236177 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.237656 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:26.240389 27103 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:12:26.256454 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:26.238962 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:26.258613 27226 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:26.239570 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:26.176229 32278 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:12:26.237331 27152 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:26.238375 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:26.260722 27225 raft_consensus.cc:2368] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9.
I20260709 13:12:26.211896 32248 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.245808 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:26.248494 27197 leader_election.cc:336] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.011s (SENT)
I20260709 13:12:26.250394 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:26.264473 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:26.265017 27232 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:26.265017 27225 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:26.267086 27197 leader_election.cc:336] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.019s (SENT)
I20260709 13:12:26.267494 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.269637 27301 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:26.270695 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.271335 27224 raft_consensus.cc:2393] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:26.268874 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:26.272599 27197 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 2.034s (SENT)
I20260709 13:12:26.273051 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.253079 27841 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:26.254138 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:26.250413 27804 leader_election.cc:400] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16.
I20260709 13:12:26.274101 27804 leader_election.cc:403] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:26.246351 32235 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:26.251930 32302 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:26.211462 32299 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.219328 32029 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.246665 32280 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.282428 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:26.263795 32288 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:26.284715 32164 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.263401 32248 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.298218 27227 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:26.222978 32272 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.298596 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:26.303865 27226 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:26.282086 32189 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:26.310779 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56931.8us
I20260709 13:12:26.307518 27224 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:26.282053 32085 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:26.227607 31433 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:26.306782 32222 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.530s	user 0.016s	sys 0.000s
I20260709 13:12:26.324735 27306 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:26.327798 32249 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.307096 32248 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:26.336339 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 51267.9us
I20260709 13:12:26.320716 31913 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:26.342411 32179 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:26.358129 32299 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:26.370872 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 49511us
W20260709 13:12:26.380722 32276 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.593s	user 0.003s	sys 0.000s
I20260709 13:12:26.384054 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.385563 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.347163 32288 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16.
I20260709 13:12:26.391074 27302 raft_consensus.cc:2376] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13. Re-sending same reply.
I20260709 13:12:26.392747 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.393703 27302 raft_consensus.cc:2376] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12. Re-sending same reply.
I20260709 13:12:26.349038 32251 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:26.399698 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 207562us
I20260709 13:12:26.400517 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.402570 32262 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:26.403067 32262 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:26.403977 32262 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.405263 32262 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:26.411156 32077 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:26.411731 32077 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:26.412839 32077 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.339538 32222 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.418536 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:26.420066 27833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1390) took 1891 ms (client timeout 2167 ms). Trace:
W20260709 13:12:26.395248 32306 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:12:26.424427 27806 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.421463 27302 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:26.420629 27833 rpcz_store.cc:269] 0709 13:12:24.526380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.546218 (+ 19838us) service_pool.cc:224] Handling call
0709 13:12:26.417425 (+1871207us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003377d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:26.417549 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2411687168}
W20260709 13:12:26.423069 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 50377.6us
I20260709 13:12:26.426626 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:26.429080 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:26.435385 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.434597 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.441154 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:26.467999 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:26.469534 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:26.434027 32057 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:26.475317 32057 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.475764 32057 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.478335 32074 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.435719 32077 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:26.487984 31917 consensus_meta.cc:287] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.001s
I20260709 13:12:26.488559 31917 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:26.557523 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:26.559221 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 89773.3us
I20260709 13:12:26.435406 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.583912 27298 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:26.437722 27302 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.584836 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.560221 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:26.586612 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.433979 32073 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:26.436203 32288 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:26.592125 32288 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:26.592541 32288 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:26.592669 32222 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.432998 32166 consensus_queue.cc:1048] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 13:12:26.428449 32249 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:12:26.559794 31913 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:26.560662 32015 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:12:26.599368 32015 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:26.599809 32015 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:26.600726 32015 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.591359 32280 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:26.602843 32074 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.603502 32074 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.618688 32272 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.435956 32240 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.587369 32005 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:26.630982 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70864.7us
I20260709 13:12:26.631786 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.635241 27225 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:26.640329 27231 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:12:26.559079 31917 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.664731 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 229347us
I20260709 13:12:26.590327 32189 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:26.667897 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:26.663403 32323 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:12:26.653870 32166 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:26.643718 32075 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:26.679801 32057 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.682286 32057 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.667606 27806 leader_election.cc:400] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16.
I20260709 13:12:26.671216 32029 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.670300 32179 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:12:26.687041 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.688216 32179 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.688634 27302 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
W20260709 13:12:26.690999 32156 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.008s
I20260709 13:12:26.691493 32156 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:26.695631 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.696084 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.662743 32005 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:26.668921 32280 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:26.704101 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75324.2us
W20260709 13:12:26.698748 32232 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
I20260709 13:12:26.705734 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:26.690965 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.708009 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:26.709359 27302 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
W20260709 13:12:26.711319 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.668628 31917 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.712553 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.702124 32272 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.713346 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.712713 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:26.714533 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.715552 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.715633 27834 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:26.715541 27302 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:26.718175 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:26.713289 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 371406us
I20260709 13:12:26.719053 32297 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:26.721586 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.705946 32073 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:26.717607 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:26.722396 27302 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:26.700791 32075 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.723855 27306 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:26.723317 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:26.725524 32319 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:26.712647 31813 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:26.725204 32280 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:26.735291 32280 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.735713 32280 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.729769 32272 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.739290 32281 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:26.739703 32281 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.740036 32281 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:26.740254 32272 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.749367 32280 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.753527 32179 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.758905 32297 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:26.761454 32297 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.760918 32319 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:26.761876 32297 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.761904 32319 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:26.762903 32319 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.764089 32319 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:26.766161 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.760948 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.772753 31917 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.729395 32073 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.774410 32240 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:26.775323 32073 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.775956 27841 raft_consensus.cc:1240] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:26.776559 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1092) took 1243 ms. Trace:
I20260709 13:12:26.776927 27223 rpcz_store.cc:276] 0709 13:12:25.511700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.516666 (+  4966us) service_pool.cc:224] Handling call
0709 13:12:26.754888 (+1238222us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001261d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:26.755014 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302343040}
W20260709 13:12:26.779672 32324 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:26.780777 32005 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:26.783423 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60219.3us
I20260709 13:12:26.784431 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.784616 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.784771 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.785385 27835 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:26.793188 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 80562.2us
I20260709 13:12:26.795715 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.796344 27834 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:26.796770 27302 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:26.712229 32232 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.784181 32074 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.791742 32179 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:26.801465 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.809489 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.811422 27832 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.812182 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.797703 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:26.801975 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:26.806130 27836 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:26.806591 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.817076 27835 raft_consensus.cc:2368] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:26.802384 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.823562 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.830550 27302 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:26.832122 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:26.809029 32304 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.680s	user 0.000s	sys 0.008s
W20260709 13:12:26.816552 32235 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.531s	user 0.003s	sys 0.010s
I20260709 13:12:26.835539 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:26.797999 32227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.020s	sys 0.023s
I20260709 13:12:26.800197 31906 raft_consensus.cc:3055] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:26.837939 32227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.020s	sys 0.023s
I20260709 13:12:26.834028 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.820786 31917 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.843045 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.844429 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:26.840104 31906 raft_consensus.cc:740] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:26.852643 32277 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.000s
I20260709 13:12:26.853138 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.853713 27298 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:26.821828 32074 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:26.836724 32319 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:26.859328 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.808601 32297 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.841624 32235 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:26.860460 27149 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:26.868476 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:26.856114 31813 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:26.864043 27302 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:26.870222 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.870847 27302 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:26.871812 31906 consensus_queue.cc:260] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.873075 31906 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.882267 32297 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.861791 32277 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.887511 32299 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:26.887981 32299 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:26.888039 32277 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:26.888438 32299 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:26.890944 32232 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.890997 32156 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.858414 31917 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.893558 31917 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:26.894394 32319 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:26.894650 32300 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.781s	user 0.004s	sys 0.005s
I20260709 13:12:26.895715 27301 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:26.895421 32319 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.895982 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2730) took 1062 ms. Trace:
I20260709 13:12:26.896323 27151 rpcz_store.cc:276] 0709 13:12:25.833193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.833360 (+   167us) service_pool.cc:224] Handling call
0709 13:12:25.833775 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.834222 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.834262 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.834857 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.052836 (+217979us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:26.052892 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.052973 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.858926 (+805953us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:26.895688 (+ 36762us) raft_consensus.cc:1685] finished
0709 13:12:26.895708 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.895908 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3473,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10683,"spinlock_wait_cycles":61487488,"thread_start_us":217429,"threads_started":1,"wal-append.queue_time_us":278609}
I20260709 13:12:26.897776 27301 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.899399 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.902387 27302 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:26.909560 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.910254 27832 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:26.911746 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.914110 27150 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:26.914758 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.916023 27150 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:26.916723 32318 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.917063 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.917235 32318 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.918426 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:26.923182 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:26.928731 31813 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.867950 32074 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:26.930660 32332 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:26.930732 32074 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.931310 32332 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.932183 32015 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:26.933821 32332 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:26.940382 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 78111.9us
I20260709 13:12:26.943272 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:26.944272 27839 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:26.944334 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:26.945578 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.946964 32179 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.950306 32280 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.951184 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:26.951764 32209 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.003s
I20260709 13:12:26.952174 32209 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:26.953447 27299 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
W20260709 13:12:26.954492 32248 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.001s
I20260709 13:12:26.954963 32248 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.955404 32318 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.955631 27299 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:26.956099 27228 raft_consensus.cc:2368] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13.
I20260709 13:12:26.956990 32248 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.910522 32281 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:26.960382 32277 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:26.960933 32277 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.962333 27836 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:26.963171 32277 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:26.964828 32262 consensus_meta.cc:287] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.559s	user 0.017s	sys 0.000s
W20260709 13:12:26.965665 32320 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.343s	user 0.000s	sys 0.003s
I20260709 13:12:26.966221 27833 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:26.966908 32288 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.951778 27302 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:26.969223 32288 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:26.970288 32231 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.003s
I20260709 13:12:26.970714 32231 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:26.972975 32231 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:26.978935 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:26.981935 27839 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:26.982107 27833 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:26.984083 27836 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:26.988277 27300 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:26.986289 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:26.996100 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:26.998457 27302 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:26.998138 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:26.999814 32297 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:27.006500 32333 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:27.007148 31917 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:27.009749 32156 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:27.010202 31906 raft_consensus.cc:2764] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:27.012491 31206 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:27.013679 32297 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:27.018908 27305 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:27.030629 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:27.012619 32281 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.032390 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.032927 27300 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.014812 32333 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:27.019651 31917 consensus_queue.cc:1243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:27.029758 32297 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:27.032971 32074 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:27.046036 32074 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:27.047353 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.046999 32074 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.037457 32333 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:27.053118 32021 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.058969 27833 pending_rounds.cc:85] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:12:27.067417 27833 pending_rounds.cc:107] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:27.067812 27833 raft_consensus.cc:2889] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:27.073108 32301 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.900s	user 0.000s	sys 0.005s
I20260709 13:12:27.074642 27300 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:27.076133 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:27.071636 32297 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.077167 32260 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:27.084136 27299 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:27.077790 32260 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:27.085786 27306 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:27.101213 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.095865 32299 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.111472 27305 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:27.112655 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2725) took 1425 ms. Trace:
I20260709 13:12:27.067325 31917 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.113071 27157 rpcz_store.cc:276] 0709 13:12:25.686970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.687251 (+   281us) service_pool.cc:224] Handling call
0709 13:12:27.112492 (+1425241us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001adbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:27.112596 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110132480}
I20260709 13:12:27.111200 27300 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:27.118309 27306 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:12:27.120466 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:27.122159 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:27.122239 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:27.123328 27839 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:27.112561 32299 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:27.126005 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.098735 32014 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:27.127933 32156 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:27.113364 31917 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:27.125027 32297 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.141516 32014 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.144676 32156 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.148579 32014 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.162611 27299 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:12:27.169632 27123 leader_election.cc:336] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.509s (SENT)
I20260709 13:12:27.170336 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:27.152710 32156 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.182355 31813 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.182688 32074 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.149144 32260 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.198550 27839 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:27.184067 31813 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.199715 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:27.202520 31206 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:27.203017 31206 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:27.199437 32299 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:27.205470 31206 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.207255 32299 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.209721 32299 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:27.215111 32265 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.225298 32259 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:27.230609 32343 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 13:12:27.231348 32074 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:27.232038 32104 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.233103 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1000) took 1066 ms. Trace:
I20260709 13:12:27.233706 32104 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.233471 27301 rpcz_store.cc:276] 0709 13:12:26.169097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.922440 (+753343us) service_pool.cc:224] Handling call
0709 13:12:26.939732 (+ 17292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.940246 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.940286 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.974447 (+ 34161us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.025104 (+ 50657us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:27.025143 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.025211 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.230012 (+204801us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:27.232825 (+  2813us) raft_consensus.cc:1685] finished
0709 13:12:27.232845 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.233048 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":9367424,"thread_start_us":49985,"threads_started":1,"wal-append.queue_time_us":50668}
W20260709 13:12:27.235078 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 567204us
I20260709 13:12:27.238246 32249 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:27.238626 32249 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:27.238991 32249 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:27.239151 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.242161 32319 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:27.243353 32231 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:27.244211 32231 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:27.244568 32231 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:27.244597 27123 leader_election.cc:336] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.515s (SENT)
I20260709 13:12:27.245693 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:27.245944 32325 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.623s	user 0.003s	sys 0.000s
I20260709 13:12:27.245522 32231 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.246667 32189 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:27.247601 32189 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.248205 31813 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.248811 31813 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.248960 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1102) took 1010 ms. Trace:
I20260709 13:12:27.251718 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:27.252658 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.253765 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.256870 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:27.234344 32104 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.261909 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2277) took 1018 ms. Trace:
I20260709 13:12:27.263397 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.264032 27300 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:27.263585 27226 rpcz_store.cc:276] 0709 13:12:26.243212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.268552 (+ 25340us) service_pool.cc:224] Handling call
0709 13:12:27.261747 (+993195us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b540038c7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:27.261853 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71241600}
I20260709 13:12:27.269811 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.271193 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.272153 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.272843 27300 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:27.261298 32166 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:27.275151 27269 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.249341 27229 rpcz_store.cc:276] 0709 13:12:26.238714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.245303 (+  6589us) service_pool.cc:224] Handling call
0709 13:12:26.245819 (+   516us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:12:26.257028 (+ 11209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.257074 (+    46us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:12:26.387538 (+130464us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b2c00010828. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:26.388483 (+   945us) log.cc:844] Serialized 104 byte log entry
0709 13:12:26.402430 (+ 13947us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:26.402907 (+   477us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.403886 (+   979us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.413517 (+  9631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.413620 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.245379 (+831759us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:27.248729 (+  3350us) raft_consensus.cc:1685] finished
0709 13:12:27.248750 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.248901 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4268,"prepare.queue_time_us":364,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":19536,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":20401,"spinlock_wait_cycles":49999488,"thread_start_us":13382,"threads_started":1,"wal-append.queue_time_us":49015}
I20260709 13:12:27.350759 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.281427 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.353502 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:27.353909 27299 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:27.354341 27225 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.355408 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.355907 27227 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:27.356923 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 97173us
I20260709 13:12:27.357791 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.351689 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:27.359602 27154 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:27.358204 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:27.360536 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.363076 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.363818 27227 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:27.365644 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.386626 27197 leader_election.cc:400] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:27.386929 27197 leader_election.cc:403] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:27.383771 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:27.388680 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 113597us
I20260709 13:12:27.370913 27225 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:27.395840 27806 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:27.273384 32350 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:12:27.275920 32297 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.271581 31917 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:27.399104 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.350785 32265 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:27.393554 31813 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.410531 32260 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:27.411115 32297 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.246663 32085 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 13:12:27.394212 32264 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.352101 32178 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.277285 32248 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.221791 32333 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:27.407660 32352 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:27.267904 32277 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.363425 32318 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.417860 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.277429 32005 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:27.420145 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:27.429479 27304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2448) took 1286 ms (client timeout 1627 ms). Trace:
W20260709 13:12:27.407449 32344 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.246s	user 0.003s	sys 0.000s
I20260709 13:12:27.273893 32209 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.388165 32074 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:27.276376 32231 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:27.412777 32014 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:27.437121 31424 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:27.436642 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.446759 27300 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:27.408819 32227 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:27.436231 27304 rpcz_store.cc:269] 0709 13:12:26.131613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.132785 (+  1172us) service_pool.cc:224] Handling call
0709 13:12:27.417422 (+1284637us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5400267fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:27.417504 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42721664}
I20260709 13:12:27.419932 32260 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.446826 31424 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.418691 32265 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.430248 32057 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:12:27.429752 31813 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.450902 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.562288 27301 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.513943 27154 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
W20260709 13:12:27.563498 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 177001us
W20260709 13:12:27.538133 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.572623 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.574277 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.575168 27226 raft_consensus.cc:2410] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:27.575475 31206 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.568282 27302 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:27.576933 27153 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:27.566288 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.493425 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:27.579128 27304 raft_consensus.cc:2368] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
I20260709 13:12:27.523380 27300 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:27.583407 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:27.575923 31206 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.446372 32014 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:27.588630 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:27.512794 32343 log.cc:927] Time spent T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:27.587296 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2271) took 1335 ms. Trace:
I20260709 13:12:27.591643 27152 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:27.586846 32014 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:27.582612 32265 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.600232 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.600891 27148 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:27.602804 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:27.604318 32354 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:27.611385 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.546518 32259 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.447009 32264 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.449890 32261 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:27.613128 32359 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:27.566668 32160 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:27.434926 32178 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.512120 32104 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.533207 32166 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.616381 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:27.618418 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.613871 27227 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:27.448123 32209 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.442625 32318 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.591830 27232 rpcz_store.cc:276] 0709 13:12:26.239762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.298654 (+ 58892us) service_pool.cc:224] Handling call
0709 13:12:26.305073 (+  6419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.328343 (+ 23270us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:26.328622 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.231501 (+902879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.231559 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:27.231603 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.574647 (+343044us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54001257d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:27.574712 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.574821 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586443,"prepare.queue_time_us":533,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":587880,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":54,"spinlock_wait_cycles":53123200,"thread_start_us":315805,"threads_started":1,"wal-append.queue_time_us":392198}
I20260709 13:12:27.654786 27226 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:27.566215 32260 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:27.621964 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:27.662356 27152 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.622625 31206 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:27.567456 31943 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:27.617918 32265 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.667438 31943 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.640887 27301 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:27.493542 32279 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.670236 32279 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.436866 32248 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.673134 32248 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.449338 32074 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.673717 32279 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.675129 32074 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.688472 32260 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.689815 27152 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:27.447607 32005 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.625231 32057 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:27.691777 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67923.7us
I20260709 13:12:27.438536 32277 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.657509 27195 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:27.780296 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:27.780620 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 123183us
I20260709 13:12:27.690932 32261 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:27.696462 32333 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.625452 32259 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.697129 32209 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.491719 32227 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:27.698933 32318 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:27.699793 32294 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.585s	user 0.004s	sys 0.008s
I20260709 13:12:27.701242 32178 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:27.651588 32160 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.653859 32288 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:27.654103 32014 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.709982 32085 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:27.714840 32297 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:27.718600 31813 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.624550 32359 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:27.728955 32249 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.644801 32232 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:27.652995 32299 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:27.731662 32265 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:27.735723 27839 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:27.736286 27840 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:27.736922 27833 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:27.735726 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.737596 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.738245 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:27.738888 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.743147 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2270) took 1503 ms. Trace:
I20260709 13:12:27.744218 32075 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.750881 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2243) took 1336 ms. Trace:
I20260709 13:12:27.749861 31424 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.644740 32030 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:27.778846 27835 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:27.848685 27298 rpcz_store.cc:276] 0709 13:12:26.414981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.584607 (+169626us) service_pool.cc:224] Handling call
0709 13:12:27.750653 (+1166046us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540031c9d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:27.750806 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616712448}
I20260709 13:12:27.820183 27231 rpcz_store.cc:276] 0709 13:12:26.239608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.298610 (+ 59002us) service_pool.cc:224] Handling call
0709 13:12:26.636053 (+337443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.640721 (+  4668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.742930 (+1102209us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002283d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:27.743084 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761228032}
I20260709 13:12:27.778566 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.669709 31943 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.782547 32057 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:27.787933 32345 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.759s	user 0.003s	sys 0.000s
I20260709 13:12:27.798045 27297 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:27.803145 27154 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:27.785648 32264 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:27.785386 32357 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:27.812386 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 246159us
I20260709 13:12:27.820533 27837 raft_consensus.cc:2410] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:27.799072 32318 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:27.821995 27834 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:27.820298 27832 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:27.852759 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:27.853713 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.872850 27833 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:27.854389 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:27.862372 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.873730 27841 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:27.873961 27157 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:27.789124 32248 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:12:27.876801 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.869843 27837 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:27.877854 27837 pending_rounds.cc:85] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 7
I20260709 13:12:27.878151 27837 pending_rounds.cc:107] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:27.850860 32297 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.878463 27837 raft_consensus.cc:2889] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:27.877424 27840 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:27.800812 32288 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.811236 32189 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:12:27.880550 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.852339 32299 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:27.811478 32085 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.886073 32297 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.891623 32014 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:27.899027 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:27.899866 27157 raft_consensus.cc:2410] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:27.859683 32264 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.819820 32232 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.897119 27152 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:27.903057 27152 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:27.900655 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:27.876325 32265 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.893236 32057 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:27.894093 32156 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.000s
W20260709 13:12:27.912386 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.859153 32030 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.904024 27152 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.909404 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2238) took 2146 ms. Trace:
W20260709 13:12:27.906278 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 321002us
I20260709 13:12:27.918776 27152 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:27.914611 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.920303 27836 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:27.923259 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:27.923951 27840 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:27.932462 27298 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:27.933887 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.927775 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:27.938848 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:27.939606 27298 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:27.944605 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:27.946225 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 163843us
I20260709 13:12:27.948828 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.902320 32264 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:27.877553 32318 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:27.956884 27839 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:27.960536 27841 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
W20260709 13:12:27.961709 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.963562 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.964366 27152 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:27.989212 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:27.990567 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 62863.3us
W20260709 13:12:27.991554 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47210us
W20260709 13:12:27.967590 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 183943us
I20260709 13:12:27.918670 27303 rpcz_store.cc:276] 0709 13:12:25.762823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.774891 (+ 12068us) service_pool.cc:224] Handling call
0709 13:12:25.775329 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:25.775811 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.775850 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:25.776563 (+   713us) log.cc:844] Serialized 52 byte log entry
0709 13:12:25.977949 (+201386us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:25.977990 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:25.978087 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.644769 (+1666682us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:27.896227 (+251458us) raft_consensus.cc:1685] finished
0709 13:12:27.896249 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.909338 (+ 13089us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10840,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":57482,"spinlock_wait_cycles":37748608,"thread_start_us":200933,"threads_started":1,"wal-append.queue_time_us":337500}
I20260709 13:12:27.993443 27195 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:28.003508 27832 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:27.911258 32364 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:28.009413 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:27.925490 32261 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:28.023545 27298 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:27.911093 32265 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:27.922909 32231 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:12:27.917917 32156 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.031303 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:28.010854 27807 connection.cc:256] RPC call timeout handler was delayed by -1.1860781299999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:12:28.034348 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:27.994526 32014 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:12:28.037000 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.008868 32178 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:28.012060 32364 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.043229 32365 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:28.048138 32364 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.048305 32365 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.008294 32362 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:28.050482 32362 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.050947 32362 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.044235 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:28.042112 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.043895 32178 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.052649 32178 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:28.047565 32360 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:12:28.042673 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:27.905479 32359 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.013003 32057 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:28.029145 32260 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.031629 32259 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.040478 32277 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.058007 32231 consensus_queue.cc:1243] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:28.054234 32365 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.054711 32166 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:28.064364 32160 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.065788 32227 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:28.075649 32359 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.010998 32299 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.076193 32249 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.066097 32209 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:12:28.065131 32057 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.084590 32365 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.080447 32277 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:28.083479 32231 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:28.092975 32297 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:28.095752 32005 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.083243 32166 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:28.133188 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 169708us
I20260709 13:12:28.093429 32261 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.108997 32231 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:28.146318 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.091181 32356 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:12:28.147243 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 137941us
I20260709 13:12:28.150607 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:28.152192 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:28.127895 32249 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.119197 32085 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:28.152606 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 146311us
I20260709 13:12:28.160154 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.128180 32374 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:28.183981 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:28.191977 27197 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Timed out: RequestConsensusVote RPC to 127.25.109.131:37965 timed out after 1.627s (SENT)
I20260709 13:12:28.138160 32378 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:28.146036 32232 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.152616 32030 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.255818 32361 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:28.258920 32385 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:28.183326 32318 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.198566 32378 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.260408 32378 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:28.263680 31943 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:28.264111 31943 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:28.265017 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.264905 31943 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.265812 27832 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:28.201309 32248 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.266999 32248 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:28.202868 32377 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:28.269129 32248 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.203943 32057 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.204738 32265 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.271871 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.272177 32178 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.273245 27840 raft_consensus.cc:1240] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:28.274197 32178 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.274729 27841 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:28.275378 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:28.275615 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.276185 27841 raft_consensus.cc:1813] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Handling vote request from an unknown peer 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.276526 31206 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:28.277069 31206 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.277458 31206 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.278821 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:28.279517 32364 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.280241 27833 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:28.279659 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.281714 32364 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:28.231352 32166 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.232362 32389 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.322516 32232 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:28.239554 32264 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.243655 27301 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:28.323032 32232 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.324383 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.325125 32232 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.325539 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:28.244673 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60798.4us
I20260709 13:12:28.306288 32231 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.245682 27300 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:28.327765 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:28.328258 27300 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.328316 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.329452 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:28.250695 32369 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:12:28.251453 32370 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:12:28.251914 32339 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.123s	user 0.004s	sys 0.000s
I20260709 13:12:28.253227 32373 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.253574 27303 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:28.276713 27841 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:28.226286 32156 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.281741 27837 raft_consensus.cc:2410] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:28.282289 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:28.339175 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 296603us
I20260709 13:12:28.339721 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.341045 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:28.211215 32367 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:12:28.282991 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.283591 31943 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:28.285305 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:28.352298 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.353188 27298 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:28.285524 27302 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:28.285349 32319 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:28.290388 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.290408 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:28.360307 27297 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.297508 32249 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.392472 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.193591 32297 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:28.306269 32288 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:28.209478 32362 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.301631 31206 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.320233 32030 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.320894 32265 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:28.358366 32232 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.431514 31424 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.360469 32259 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.321974 32015 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.329988 27833 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.326038 27301 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.438128 31206 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:28.426124 32339 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:28.334556 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:28.334841 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 142898us
I20260709 13:12:28.345330 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.345939 27807 leader_election.cc:400] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9.
W20260709 13:12:28.350512 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.425549 31906 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.443624 27841 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:28.447527 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:28.352173 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.287712 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.353890 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.354993 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.357144 27300 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:28.450299 27298 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
W20260709 13:12:28.450608 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 95700.2us
I20260709 13:12:28.450796 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.451411 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:28.451872 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.452385 27807 leader_election.cc:403] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:28.453025 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.390486 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:28.395221 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:28.453961 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108139us
I20260709 13:12:28.396195 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.395953 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.454394 27154 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.454851 27157 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:28.333742 32014 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.406926 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:28.457116 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:28.457432 27150 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:28.457653 27837 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:28.458110 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:28.460041 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 114797us
I20260709 13:12:28.460992 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.461365 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.462934 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:28.463122 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:28.397053 27055 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 14 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.339000 32373 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:28.423472 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.424000 27303 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:28.431010 32209 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.320691 32378 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.432165 31424 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.321425 32332 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.332389 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.542171 27837 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:28.542348 27838 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:28.395901 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.455260 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:28.455801 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.464672 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.467795 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.468024 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.469614 27150 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:28.425041 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:28.545385 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:28.470778 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:28.471292 31206 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:28.472446 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:28.475430 27197 leader_election.cc:400] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10.
W20260709 13:12:28.547995 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 72739.6us
I20260709 13:12:28.477836 32365 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.552959 27149 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:28.479643 27301 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
W20260709 13:12:28.556607 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 100901us
I20260709 13:12:28.482183 32389 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.484182 32104 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.410975 32156 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:12:28.490321 32384 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:28.491075 32057 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.444018 32015 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.456455 31906 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.507858 32231 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:28.509359 32362 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.515153 32264 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.518676 32248 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:28.518987 32014 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.519763 32364 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:28.430505 32030 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.468552 32227 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:28.525483 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1015) took 1254 ms. Trace:
I20260709 13:12:28.655673 27155 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:28.468330 32359 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:12:28.439435 32288 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.668124 27304 raft_consensus.cc:1813] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Handling vote request from an unknown peer 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.471158 27272 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.538420 27298 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:28.710521 27304 raft_consensus.cc:2410] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:28.540149 27297 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
W20260709 13:12:28.711097 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 239994us
I20260709 13:12:28.659945 27299 rpcz_store.cc:276] 0709 13:12:27.270765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.354576 (+ 83811us) service_pool.cc:224] Handling call
0709 13:12:27.354868 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:27.431027 (+ 76159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.431074 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:27.438897 (+  7823us) log.cc:844] Serialized 52 byte log entry
0709 13:12:27.897110 (+458213us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:27.897173 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.897288 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:28.525174 (+627886us) raft_consensus.cc:1685] finished
0709 13:12:28.525203 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:28.525388 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46081,"raft.queue_time_us":61493,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11029,"thread_start_us":276115,"threads_started":1,"wal-append.queue_time_us":517731}
I20260709 13:12:28.711881 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:28.548149 27051 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 381) took 19757 ms (client timeout 15000 ms). Trace:
I20260709 13:12:28.465488 27055 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 3 to 13, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:28.549188 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 76811.6us
I20260709 13:12:28.715391 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:28.587822 32104 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:28.717083 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:28.550283 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:28.443281 32387 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.481320 27154 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:28.579587 27833 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:28.433379 32265 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.583863 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:28.719380 27838 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.437788 32232 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.586993 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:28.536593 32189 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:28.640825 32260 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:28.551966 32366 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:12:28.636696 27195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.015s	sys 0.010s
W20260709 13:12:28.730827 27195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.015s	sys 0.010s
W20260709 13:12:28.731138 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 737724us
I20260709 13:12:28.567828 32391 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:28.646075 31424 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.648499 31206 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:28.732213 31206 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.581360 32178 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:28.486575 32373 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:28.633172 32229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.030s	sys 0.086s
I20260709 13:12:28.468725 32318 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9.
W20260709 13:12:28.669489 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.547256 32209 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.717918 32104 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:28.643457 32021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.007s	sys 0.020s
I20260709 13:12:28.719902 27055 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:28.820468 27306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.049s
W20260709 13:12:28.820896 27306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.049s
I20260709 13:12:28.738440 32365 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:28.820822 27055 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:28.714016 27051 rpcz_store.cc:269] 0709 13:12:08.791195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.791420 (+   225us) service_pool.cc:224] Handling call
0709 13:12:09.043248 (+251828us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:12:28.548083 (+19504835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:25.171872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:25.172577 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:25.172631 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:12:25.172649 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:25.230620 (+ 57971us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:25.277903 (+ 47283us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:25.279805 (+  1902us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:12:25.291921 (+ 12116us) tablet.cc:701] Row locks acquired
0709 13:12:25.291970 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:12:25.292150 (+   180us) write_op.cc:270] Start()
0709 13:12:25.292345 (+   195us) write_op.cc:276] Timestamp: P: 1783602745292075 usec, L: 0
0709 13:12:25.292393 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:12:25.295735 (+  3342us) log.cc:844] Serialized 8345 byte log entry
0709 13:12:26.090434 (+794699us) op_driver.cc:464] REPLICATION: finished
0709 13:12:26.323184 (+232750us) write_op.cc:301] APPLY: starting
0709 13:12:26.336650 (+ 13466us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:26.616101 (+279451us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:26.616313 (+   212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:26.875506 (+259193us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:26.875914 (+   408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:12:26.875985 (+    71us) write_op.cc:312] APPLY: finished
0709 13:12:26.876509 (+   524us) log.cc:844] Serialized 188 byte log entry
0709 13:12:26.876708 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:26.876933 (+   225us) write_op.cc:454] Released schema lock
0709 13:12:26.877009 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:26.877470 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:26.877503 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":166605,"reported_tablets":45,"spinlock_wait_cycles":16224128,"child_traces":[["op",{"apply.queue_time_us":201117,"apply.run_cpu_time_us":32185,"apply.run_wall_time_us":567178,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":792644,"prepare.run_cpu_time_us":25715,"prepare.run_wall_time_us":320529,"raft.queue_time_us":337563,"raft.run_cpu_time_us":12704,"raft.run_wall_time_us":156676,"replication_time_us":797885,"thread_start_us":858355,"threads_started":4,"wal-append.queue_time_us":325971,"wal-append.run_cpu_time_us":29028,"wal-append.run_wall_time_us":2264066}]]}
W20260709 13:12:28.720105 27305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.021s
W20260709 13:12:28.606276 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.551754 32332 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.724388 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:28.726305 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:28.726959 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 176770us
I20260709 13:12:28.828191 27226 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:28.728346 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:28.668509 32251 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.018s
I20260709 13:12:28.733938 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:28.734874 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 147993us
I20260709 13:12:28.829401 27227 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:28.829691 27838 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:28.735235 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:28.670209 32227 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:28.737653 27269 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:28.730540 32260 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:28.716334 32277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.017s
I20260709 13:12:28.729646 32005 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:28.740869 32229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.030s	sys 0.086s
I20260709 13:12:28.844974 32005 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:28.788715 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:28.718371 32387 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.845876 32005 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.847666 32387 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:28.726468 32279 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:28.792487 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 60778.3us
I20260709 13:12:28.733574 32189 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.848861 32279 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.850324 27300 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:28.850428 32189 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.850646 31906 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.733920 32319 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.851167 31906 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:28.851773 32279 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.851761 31906 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.852556 32279 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:28.853018 32279 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:28.853797 32279 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:28.867436 32392 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:28.828457 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:28.729286 32362 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:12:28.824935 27305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.022s
I20260709 13:12:28.719422 32288 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:28.833709 27839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.023s	sys 0.025s
I20260709 13:12:28.832116 27055 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 14 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:28.814834 32363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.021s	sys 0.016s
W20260709 13:12:28.884568 32363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.021s	sys 0.016s
I20260709 13:12:28.884949 27055 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 2 to 10, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:28.885720 32363 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.886229 32363 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.886385 27055 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.888306 32363 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.667760 32248 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:28.841987 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.887848 27055 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 13, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:28.843032 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:28.890121 27839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.023s	sys 0.025s
W20260709 13:12:28.889904 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46941.6us
I20260709 13:12:28.890966 32248 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:28.889606 27055 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 6 to 8, term changed from 7 to 8, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to <none>, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:28.825834 31206 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:28.893549 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.894006 31206 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:28.840806 32227 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:28.840104 32277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.011s	sys 0.022s
I20260709 13:12:28.829842 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:28.905759 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 76045us
I20260709 13:12:28.906744 27807 leader_election.cc:400] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:28.791258 32391 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:28.819873 32021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.007s	sys 0.020s
I20260709 13:12:28.893072 27055 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.894512 27156 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:28.834717 32251 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.010s	sys 0.019s
I20260709 13:12:28.825872 32077 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.894506 31206 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:28.900329 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.917855 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:28.917752 27153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.013s
W20260709 13:12:28.921627 27153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.010s	sys 0.013s
I20260709 13:12:28.901918 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.902595 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:28.902590 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:28.912637 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 461071us
I20260709 13:12:28.922683 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.918236 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:28.923682 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.925796 31424 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:28.927332 31424 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:28.934718 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.913637 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.936455 31424 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:28.936854 27838 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:28.900465 27227 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:28.921489 27837 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:28.916041 27055 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.946880 27224 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:28.947086 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.896672 32384 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:28.953009 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:28.954005 27833 raft_consensus.cc:2393] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:28.942890 27055 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 8, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 8 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:28.953791 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.918928 31206 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.948663 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.956342 27231 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:28.906277 32104 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:28.967469 27224 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:28.955192 27055 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:28.969877 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:28.919440 32382 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:28.990274 27302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.001s	sys 0.024s
I20260709 13:12:28.968772 27055 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:28.911875 32264 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:28.868399 32260 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:28.989758 27271 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:28.996441 27223 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:28.910918 32284 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:28.937104 31917 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.006551 27055 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.010667 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:28.952898 31906 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.014107 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:28.911336 32057 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:12:28.919131 32365 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:12:29.021451 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.018265 27055 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.026090 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.027053 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.029150 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.030448 27225 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:29.002619 32389 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:28.997711 32384 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:29.019028 32015 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.032296 27055 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 12, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 12 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:29.030795 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:29.038615 27055 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 7, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 7 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:29.043231 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.048660 27231 raft_consensus.cc:2410] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:29.020615 32299 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:29.058009 32299 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.058482 32299 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.014621 32382 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:29.063148 32382 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.063856 32057 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:29.064388 32057 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:29.006796 32264 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:29.066807 32264 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.067858 32264 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.071116 32288 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:29.036051 32014 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:29.074200 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2473) took 1678 ms. Trace:
I20260709 13:12:29.075934 32299 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.074759 27305 rpcz_store.cc:276] 0709 13:12:27.395769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.570252 (+174483us) service_pool.cc:224] Handling call
0709 13:12:27.570482 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:27.810276 (+239794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.810321 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:28.214171 (+403850us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:28.214627 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:12:28.892642 (+678015us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:28.933776 (+ 41134us) log.cc:844] Serialized 14 byte log entry
0709 13:12:28.934045 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.934172 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.073815 (+139643us) raft_consensus.cc:1685] finished
0709 13:12:29.073944 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.074128 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53915,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":20545,"raft.queue_time_us":121686,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":27378304,"thread_start_us":877774,"threads_started":2,"wal-append.queue_time_us":791447}
I20260709 13:12:29.049849 27055 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 9 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:29.032671 31906 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.079304 27055 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 10, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 10 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:29.082289 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.090413 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:29.100940 31943 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.740s	user 0.003s	sys 0.006s
I20260709 13:12:29.080128 31906 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:29.101663 32259 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.662s	user 0.004s	sys 0.004s
I20260709 13:12:29.101917 31906 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.107570 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:29.109547 27836 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:12:29.109817 27225 raft_consensus.cc:2410] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:29.086964 27055 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 11 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:29.080555 32365 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:29.129693 32365 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:29.130621 32365 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.065405 32057 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.116129 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2266) took 1882 ms. Trace:
I20260709 13:12:29.118397 32405 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:29.134272 32057 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:29.134449 32390 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
I20260709 13:12:29.134121 32405 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.119590 32373 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.123627 32030 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.125133 32384 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.126330 32332 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.081207 32378 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:29.126974 32395 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:12:29.128394 32401 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:12:29.105554 32265 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.128762 27839 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:29.104755 32397 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:29.162683 32232 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.163043 32397 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.163123 31906 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.164951 32209 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:29.165218 32397 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.080961 32288 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.165913 32288 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.140661 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:29.135627 27306 rpcz_store.cc:276] 0709 13:12:27.234248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:27.257071 (+ 22823us) service_pool.cc:224] Handling call
0709 13:12:27.257404 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:27.274287 (+ 16883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:27.274318 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:28.256699 (+982381us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:28.257068 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:12:28.821510 (+564442us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:28.821570 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:28.821676 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.115852 (+294176us) raft_consensus.cc:1685] finished
0709 13:12:29.115872 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.116072 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22711,"raft.queue_time_us":18412,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11634,"spinlock_wait_cycles":4705536,"thread_start_us":564008,"threads_started":1,"wal-append.queue_time_us":776581}
I20260709 13:12:29.114064 32259 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:29.175450 27231 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:29.149493 32405 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.150692 27228 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:29.152794 27223 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:29.107352 32156 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:29.161396 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 312367us
W20260709 13:12:29.149152 32231 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:12:29.168094 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:29.182255 27839 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.186475 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:29.197182 27225 raft_consensus.cc:2368] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:29.167151 32365 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.166718 31906 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.203722 27152 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:29.205694 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:29.206089 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 468458us
I20260709 13:12:29.206595 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.207106 27149 raft_consensus.cc:1813] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Handling vote request from an unknown peer 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.207690 27149 raft_consensus.cc:2393] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:29.209362 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.212275 32260 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.213129 27839 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:29.213779 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.214223 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:29.214566 27151 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:29.215659 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.216320 27151 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:29.217344 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.219385 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.222023 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.223667 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:29.224534 27155 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.230964 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.236050 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:29.236841 27148 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.240100 27151 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:29.240564 32104 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:29.241549 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.241267 32104 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.244148 32104 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.244974 27151 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:29.246204 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.247037 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.251767 27149 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:29.250985 27152 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:29.257076 32261 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.257731 32261 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.258774 32104 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:29.260087 32189 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:29.260170 32261 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.260854 32189 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:29.261888 32189 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.264511 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.265136 27225 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:12:29.267215 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 542881us
W20260709 13:12:29.303315 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.272115 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.290920 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.291492 27195 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:29.307082 27156 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:29.269304 27148 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:29.272671 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.273087 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:29.310305 27149 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:29.270229 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56087.6us
I20260709 13:12:29.271924 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.305718 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:29.306102 27151 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:29.316335 27155 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:29.317606 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:29.321092 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:29.184787 32156 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.327772 27225 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:29.332463 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.013s	sys 0.020s
W20260709 13:12:29.323140 27805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.051s
W20260709 13:12:29.329438 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57799.8us
W20260709 13:12:29.333073 27805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.051s
W20260709 13:12:29.332834 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.013s	sys 0.020s
I20260709 13:12:29.334208 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:29.265440 32366 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:29.336517 27156 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:12:29.337388 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:29.338018 27839 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.199832 32387 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.119s
I20260709 13:12:29.318811 31943 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:29.342845 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:29.343413 27225 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.324995 32378 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.323745 32394 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.360791 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:29.409930 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 484451us
I20260709 13:12:29.378028 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.393625 27839 raft_consensus.cc:2468] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:29.205838 32284 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:12:29.332263 32297 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.345918 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.347803 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.430382 27148 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:29.335294 31906 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:29.335773 32359 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:29.410704 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:29.412475 27271 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:29.421628 27232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.018s	sys 0.058s
I20260709 13:12:29.432145 32359 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.432741 32359 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.422447 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:29.338699 32299 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:29.423171 32369 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:29.440296 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:29.441130 27839 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:29.458236 27838 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:29.442515 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:29.327836 32391 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:12:29.443920 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.342262 32014 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.448159 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.450439 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:29.452644 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:29.454775 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.478185 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:29.455657 27225 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:29.437080 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:29.457064 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:29.440354 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:29.397109 32378 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:29.460475 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:29.462510 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.470806 27153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.016s	sys 0.011s
W20260709 13:12:29.471705 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.458940 32005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.017s
I20260709 13:12:29.344511 32248 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.112s
W20260709 13:12:29.503010 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 168853us
I20260709 13:12:29.503809 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:29.487510 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:29.504725 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 67733.1us
W20260709 13:12:29.458674 32277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.021s	sys 0.025s
I20260709 13:12:29.506306 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:29.435444 31943 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.446960 32265 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:29.481236 32251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.005s	sys 0.013s
I20260709 13:12:29.514715 32209 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:29.514858 32319 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:29.515486 32366 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.524010 32363 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:29.524076 32232 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:29.528301 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:29.529143 32411 raft_consensus.cc:2804] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.530738 32364 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:29.531744 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.532768 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.618789 27301 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:29.620064 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.533938 27303 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:29.534610 32408 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:29.524456 32227 consensus_meta.cc:287] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
I20260709 13:12:29.534979 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:29.514606 32005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.010s	sys 0.018s
I20260709 13:12:29.536166 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:29.536491 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49097.6us
I20260709 13:12:29.536667 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.629477 27299 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:29.504276 31906 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:29.525404 31943 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.528553 32288 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:29.615458 32232 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:29.514307 32392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.023s
W20260709 13:12:29.541742 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.542743 32231 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:29.556526 32189 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.428937 32394 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.504375 32378 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.635990 32318 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:29.654985 27301 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 7.
I20260709 13:12:29.504580 32260 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.445302 32297 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.660842 32297 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.568887 32299 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.661614 32299 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:29.662745 32406 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.156s	user 0.000s	sys 0.007s
I20260709 13:12:29.487320 32014 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.664001 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2478) took 1291 ms. Trace:
I20260709 13:12:29.665697 32014 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:29.664484 27302 rpcz_store.cc:276] 0709 13:12:28.372806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.384141 (+ 11335us) service_pool.cc:224] Handling call
0709 13:12:28.384596 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:28.413694 (+ 29098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:28.413737 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:28.428095 (+ 14358us) log.cc:844] Serialized 26 byte log entry
0709 13:12:29.001986 (+573891us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:29.002040 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.002162 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.663696 (+661534us) raft_consensus.cc:1685] finished
0709 13:12:29.663731 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.663930 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28622,"raft.queue_time_us":30173,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15146,"thread_start_us":533897,"threads_started":1,"wal-append.queue_time_us":881224}
I20260709 13:12:29.575696 27297 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:12:29.664017 32299 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.577491 27148 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:29.673237 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3328) took 1283 ms. Trace:
I20260709 13:12:29.673681 27153 rpcz_store.cc:276] 0709 13:12:28.391154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.391785 (+   631us) service_pool.cc:224] Handling call
0709 13:12:28.405832 (+ 14047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:28.921962 (+516130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:28.921990 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:28.922403 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:12:29.485370 (+562967us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:29.485425 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.485514 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.673013 (+187499us) raft_consensus.cc:1685] finished
0709 13:12:29.673036 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.673179 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1289,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":1031739,"threads_started":2,"wal-append.queue_time_us":748811}
W20260709 13:12:29.674952 32057 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:12:29.585250 32209 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:29.582665 27230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.002s	sys 0.027s
W20260709 13:12:29.720835 27230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.002s	sys 0.027s
W20260709 13:12:29.582324 32382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.023s
I20260709 13:12:29.624394 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.573613 32259 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:29.626140 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:29.630722 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 94628.8us
I20260709 13:12:29.584491 32363 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.633455 27223 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:29.540167 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63673.3us
I20260709 13:12:29.737700 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.628641 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.623173 32408 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.641001 32232 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:29.639637 32231 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:29.635933 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 297728us
I20260709 13:12:29.652496 32394 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:29.581857 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 55654.4us
I20260709 13:12:29.632647 32411 raft_consensus.cc:697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:29.626586 32265 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:29.638959 32392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.000s	sys 0.024s
I20260709 13:12:29.626446 32227 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.634462 31943 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:29.739228 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 110668us
I20260709 13:12:29.767690 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.771116 27302 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:29.747620 32408 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:29.721174 32178 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.001s
I20260709 13:12:29.752394 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:29.816656 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64374.7us
I20260709 13:12:29.817350 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.755918 31424 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:29.756601 32259 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:29.754590 32260 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:29.758893 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 418728us
I20260709 13:12:29.727013 32364 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.720062 32014 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:29.764837 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 352425us
I20260709 13:12:29.759405 32231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:29.749117 32363 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:29.812692 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.754976 32318 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.772038 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:29.814558 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.813274 27807 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.833216 27807 leader_election.cc:400] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:29.833510 27807 leader_election.cc:403] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:12:29.833603 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61664.6us
I20260709 13:12:29.813126 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:29.749013 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 244569us
W20260709 13:12:29.728801 32382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.023s
I20260709 13:12:29.819545 27150 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:29.819932 31424 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.834786 31424 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:29.835253 31424 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.838305 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:29.777431 27149 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:29.821810 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:29.821341 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:29.769691 32288 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:29.827795 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.819149 32319 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:12:29.832947 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:29.856664 27197 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:29.855304 32414 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:29.869237 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47936.2us
I20260709 13:12:29.823578 32178 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.823153 32394 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:29.942356 32394 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.945029 32394 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:29.873571 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:29.879403 27195 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:29.945992 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66668.9us
W20260709 13:12:29.946543 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108305us
I20260709 13:12:29.946955 32434 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.810765 32251 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:29.947813 32299 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:29.947741 32251 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.948390 32299 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.890952 32382 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14.
I20260709 13:12:29.890990 31424 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.949725 32394 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.891666 32359 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.810899 31906 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.879240 32057 consensus_queue.cc:1059] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:29.906692 32429 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:29.908443 32414 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:29.910508 32435 raft_consensus.cc:3060] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.912822 27836 raft_consensus.cc:3060] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.925226 32408 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.926103 32209 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:29.829113 32364 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.889346 32265 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:29.928506 32411 consensus_queue.cc:237] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:29.832032 32014 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:29.819190 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47570.8us
I20260709 13:12:29.939265 32227 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:29.952292 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 78818.3us
I20260709 13:12:30.064685 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:29.830513 32332 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:29.955647 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.957298 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.975328 31424 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:29.975418 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 220001us
I20260709 13:12:29.989493 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:29.769968 32021 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.217s
I20260709 13:12:29.990813 32057 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:29.980190 32429 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.984097 32414 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.000495 32005 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:29.958077 32279 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:12:30.073683 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.093392 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:29.951224 32394 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:30.075512 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.080462 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 247534us
I20260709 13:12:29.995253 32189 raft_consensus.cc:2804] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:30.083983 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 266675us
I20260709 13:12:29.997438 32387 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.070019 32014 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:30.086586 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 139467us
W20260709 13:12:30.089586 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 256492us
I20260709 13:12:30.114349 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:30.119859 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:30.120519 27299 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:30.122185 32284 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:30.122615 32284 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:30.123561 32284 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.130733 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.146190 32288 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:30.146687 32288 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:30.147514 32288 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.148706 32288 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.155112 32284 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:30.083914 32299 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.172364 27195 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:30.172989 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56622.7us
I20260709 13:12:30.175922 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:30.177790 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58822.9us
I20260709 13:12:30.072491 32209 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:30.087677 32429 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:30.183501 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69241.1us
I20260709 13:12:30.224352 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:30.224565 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 48710.9us
I20260709 13:12:30.092978 32440 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.106947 32407 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.087500 32414 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.117242 32057 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:30.223685 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 51400.7us
I20260709 13:12:30.184217 27841 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:12:30.114116 32332 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:30.235702 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.235328 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.229256 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:30.246414 27841 pending_rounds.cc:85] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 11
I20260709 13:12:30.288683 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:30.246491 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.247030 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.251896 31424 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.252111 27838 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:30.171105 32260 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:30.287408 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 221260us
I20260709 13:12:30.288995 27841 pending_rounds.cc:107] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:12:30.293589 27841 raft_consensus.cc:2889] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:30.179913 32189 raft_consensus.cc:697] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:30.241546 32425 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:12:30.254834 27832 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:30.042035 32259 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.174261 32439 raft_consensus.cc:3055] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:30.293489 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.245414 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:30.235462 32156 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.290416 27833 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:30.290679 27840 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:30.290733 31424 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.182807 32319 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:30.234532 32229 raft_consensus.cc:2764] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:30.240003 32391 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:30.255813 32015 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.251611 32251 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.284638 32412 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:30.185844 32365 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.983s	user 0.015s	sys 0.003s
I20260709 13:12:30.347591 32384 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:30.346765 31424 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:30.348551 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 103203us
W20260709 13:12:30.357721 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 128526us
W20260709 13:12:30.349092 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 55680.4us
W20260709 13:12:30.308243 32373 consensus_meta.cc:287] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.158s	user 0.011s	sys 0.011s
I20260709 13:12:30.286506 32447 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:30.171562 32416 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.190s
I20260709 13:12:30.363814 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:30.374343 27149 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.305411 32361 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.223644 32014 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:12:30.368942 31424 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.288106 32430 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.311687 32021 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:30.173141 32387 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.301577 32288 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.310216 32439 raft_consensus.cc:740] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:30.398752 27150 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:12:30.381412 27224 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:12:30.400395 31424 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.385545 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:30.285694 32209 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.412082 27149 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:30.382758 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:30.425416 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 195889us
I20260709 13:12:30.310726 32227 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:12:30.469290 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:30.257031 32440 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.364756 32005 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.368202 32104 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:30.404433 32178 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:30.468668 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 178570us
W20260709 13:12:30.467682 32421 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.517s	user 0.005s	sys 0.000s
I20260709 13:12:30.504545 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.375523 32447 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:30.495097 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.471297 27299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b895e250184ee283d78483d5fcae92"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:30.506335 27299 raft_consensus.cc:606] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:30.499524 27836 consensus_meta.cc:287] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:12:30.404692 32365 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.507876 32297 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.507696 32365 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.257198 32407 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.366973 32015 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.478415 32279 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:30.507100 27836 raft_consensus.cc:2468] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
W20260709 13:12:30.505908 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.871s (SENT) [suppressed 43 similar messages]
I20260709 13:12:30.533282 32440 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.537142 31424 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.365705 32319 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.478180 32359 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.484651 32449 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.471971 32366 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:30.499239 32104 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.485877 32446 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:30.491257 32057 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.475670 32021 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:30.550493 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45981.5us
I20260709 13:12:30.555614 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:30.502750 32178 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.356438 32391 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.367637 32412 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.621479 32439 consensus_queue.cc:260] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.484819 32288 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.508692 32297 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.512336 32447 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:30.535385 32408 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:30.590760 32437 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.499s	user 0.000s	sys 0.001s
W20260709 13:12:30.633507 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 271800us
I20260709 13:12:30.635007 27305 raft_consensus.cc:606] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:30.404524 32361 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.559176 32279 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.590889 32014 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:30.591979 32364 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.538549 32260 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:12:30.666870 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.626691 32104 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:30.503868 32189 consensus_queue.cc:237] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.683437 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.467059 32430 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.663923 32178 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.662124 32057 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.636595 32462 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.663244 32394 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:30.719580 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52873us
I20260709 13:12:30.735078 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:30.721457 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:30.722654 32014 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:30.727190 32443 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:12:30.727900 32444 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:12:30.756289 27834 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:12:30.677440 32384 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:30.627322 32366 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:30.732506 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49153.4us
I20260709 13:12:30.716436 32439 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:30.738449 27230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.003s	sys 0.002s
W20260709 13:12:30.772065 27230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.003s	sys 0.002s
I20260709 13:12:30.772768 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2285) took 1874 ms. Trace:
W20260709 13:12:30.740073 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.773249 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 100838us
W20260709 13:12:30.740464 27198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.000s	sys 0.009s
W20260709 13:12:30.775641 27198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.000s	sys 0.010s
I20260709 13:12:30.773103 27230 rpcz_store.cc:276] 0709 13:12:28.898722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.898840 (+   118us) service_pool.cc:224] Handling call
0709 13:12:28.936685 (+ 37845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:28.936880 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:29.729671 (+792791us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.086445 (+356774us) log.cc:844] Serialized 14 byte log entry
0709 13:12:30.347240 (+260795us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b1800424060. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a55c0b58f 00007f9a4ec4a571 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd
0709 13:12:30.772403 (+425163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.772455 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:30.772497 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.772569 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.772703 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56390,"prepare.queue_time_us":737456,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":81,"raft.queue_time_us":71617,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":54818,"spinlock_wait_cycles":430852096,"thread_start_us":1771660,"threads_started":3,"wal-append.queue_time_us":510614}
W20260709 13:12:30.776172 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.776522 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:30.624657 32449 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.781553 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:30.641549 32446 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.764732 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:30.767937 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:30.787727 27305 raft_consensus.cc:606] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:30.728915 32229 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.672178 32454 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:12:30.716048 32433 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.736616 32365 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.788439 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:30.759311 32227 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:30.796900 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2490) took 1260 ms. Trace:
I20260709 13:12:30.760802 32005 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:30.791147 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:12:30.795725 32459 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:12:30.796195 32407 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.846796 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:30.797299 27304 rpcz_store.cc:276] 0709 13:12:29.536037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.536907 (+   870us) service_pool.cc:224] Handling call
0709 13:12:29.537200 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.537549 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.537591 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.538079 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:12:29.767031 (+228952us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:29.767088 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.767178 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:30.796677 (+1029499us) raft_consensus.cc:1685] finished
0709 13:12:30.796697 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.796843 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1427,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":228549,"threads_started":1,"wal-append.queue_time_us":456036}
I20260709 13:12:30.799371 32454 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:30.800302 32394 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:30.797998 32265 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:30.800928 32384 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.802501 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:30.803020 27305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:30.870328 27305 raft_consensus.cc:606] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:30.803349 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:30.792451 32363 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.000s
W20260709 13:12:30.837105 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 46010.4us
I20260709 13:12:30.776664 32461 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:30.845024 27153 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:12:30.849017 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:30.871644 32441 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:12:30.871855 27225 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:30.872104 32387 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.872766 32472 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.873219 32472 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:30.873570 32472 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.849416 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:30.874979 27230 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:30.875201 32015 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.876299 32412 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.876252 32461 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.878093 27304 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:30.878742 32461 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.849562 32456 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.879674 32363 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.879756 32456 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.882324 27300 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:30.882381 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:30.881912 32363 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.883242 27302 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:30.887003 32232 consensus_meta.cc:287] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.124s	user 0.010s	sys 0.000s
I20260709 13:12:30.887395 32232 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.888432 27839 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:30.889472 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.759963 32021 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.870424 32209 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.890275 27840 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:30.850373 32366 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:30.836658 32460 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:12:30.860929 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:30.898964 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:30.839401 32464 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:12:30.807377 32433 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:30.862423 32454 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:30.837750 32359 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.870674 27305 raft_consensus.cc:614] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:30.883093 32466 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.889586 32232 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.891034 27154 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 13:12:30.855914 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 145616us
I20260709 13:12:30.868333 32265 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:30.869251 32227 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.897684 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:30.864156 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 358160us
I20260709 13:12:30.983984 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:30.984831 27227 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:30.851372 32229 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:30.901960 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.902674 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.951202 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.902340 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.954561 32433 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:30.908964 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:30.900817 32456 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.900574 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.054538 27839 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
W20260709 13:12:30.992899 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.959600 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 178095us
I20260709 13:12:31.056842 27841 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
W20260709 13:12:30.851312 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 62946.5us
I20260709 13:12:30.974686 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:30.901768 32279 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.978694 32319 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:30.934473 32446 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:31.052021 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58032.4us
I20260709 13:12:31.052237 27301 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:30.932950 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:30.982900 32265 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.056586 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:30.962548 27122 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:30.904753 32387 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:30.988579 32391 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:30.906840 32412 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:31.061223 27148 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:30.935953 32430 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.061708 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:31.094956 27227 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:12:31.126659 27227 pending_rounds.cc:85] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 9
I20260709 13:12:31.126981 27227 pending_rounds.cc:107] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:31.127210 27227 raft_consensus.cc:2889] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:31.063865 32361 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.060240 27832 raft_consensus.cc:2410] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:31.095943 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:30.870446 32394 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.092401 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:31.129690 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 68063.8us
I20260709 13:12:31.130174 27156 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 6.
I20260709 13:12:31.104537 32450 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.105005 32319 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.058319 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:31.113751 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 151307us
I20260709 13:12:31.133947 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.134765 27839 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 7.
I20260709 13:12:31.096681 32229 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:30.979818 32015 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:12:31.100265 32454 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.114742 32387 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:31.116729 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 60316.2us
I20260709 13:12:31.122714 32446 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:31.059511 32251 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:31.124413 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.124495 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:30.972525 32359 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.133538 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.132284 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:31.160744 27227 raft_consensus.cc:2410] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:31.161238 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:31.117417 31943 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.303s	user 0.012s	sys 0.000s
I20260709 13:12:31.052265 32227 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:30.966668 32457 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.186s
I20260709 13:12:31.146450 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.145174 27148 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:12:31.154182 32284 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.994s	user 0.009s	sys 0.004s
I20260709 13:12:31.149789 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.054754 32408 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.156152 27232 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:31.124393 32412 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.156704 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.152465 32387 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:30.981618 32466 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.154814 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:31.164510 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.175050 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.178553 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.159101 32464 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:31.237112 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.191673 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:31.284994 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.285395 27839 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:31.197914 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.286949 27306 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:31.143250 32478 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:31.202886 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.204993 27227 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:31.148267 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.206759 32470 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:31.202591 32412 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:31.209740 32429 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.002s
I20260709 13:12:31.150465 32319 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.210140 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:31.195662 32104 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.211246 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.211344 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:31.212000 32435 consensus_meta.cc:287] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.218s	user 0.010s	sys 0.000s
W20260709 13:12:31.213163 32231 consensus_meta.cc:287] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.381s	user 0.006s	sys 0.005s
I20260709 13:12:31.205266 32462 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:31.214191 27833 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:12:31.214602 32378 consensus_meta.cc:287] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.562s	user 0.010s	sys 0.003s
I20260709 13:12:31.190678 32457 consensus_queue.cc:1243] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:31.219117 32466 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.315526 32279 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.220826 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.343384 27841 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
W20260709 13:12:31.221331 32483 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:12:31.346766 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.221911 32229 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.223627 32394 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.225013 32209 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:31.190474 32468 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.175527 32449 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.231894 32477 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.232043 32359 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.147156 32450 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:31.369912 32452 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.799s	user 0.006s	sys 0.000s
I20260709 13:12:31.371819 32450 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.236555 32227 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.237306 32464 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.374948 32464 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.181910 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.375856 32297 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.204006 32408 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.379235 32408 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.248641 27304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:31.381115 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:31.249101 27836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 1063) took 1809 ms (client timeout 1774 ms). Trace:
W20260709 13:12:31.382205 27836 rpcz_store.cc:269] 0709 13:12:29.439273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.442308 (+  3035us) service_pool.cc:224] Handling call
0709 13:12:31.248947 (+1806639us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400721854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:31.249039 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044056960}
I20260709 13:12:31.383391 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.383699 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1892) took 1199 ms. Trace:
I20260709 13:12:31.383970 27836 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:31.384063 27837 rpcz_store.cc:276] 0709 13:12:30.184588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.184720 (+   132us) service_pool.cc:224] Handling call
0709 13:12:30.185071 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:30.637235 (+452164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.637279 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:30.637332 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:30.637374 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:31.383479 (+746105us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400660dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:31.383523 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:31.383649 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039330048}
I20260709 13:12:31.384845 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.379299 32318 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:31.163653 32433 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.385514 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.385495 32318 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:31.386993 32318 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.195425 32454 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:31.389654 32319 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.391100 32104 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.269490 32057 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.164203 32251 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.278649 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2488) took 1744 ms. Trace:
I20260709 13:12:31.394331 27300 rpcz_store.cc:276] 0709 13:12:29.534568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.534746 (+   178us) service_pool.cc:224] Handling call
0709 13:12:31.278466 (+1743720us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400267fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:31.278592 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895963008}
I20260709 13:12:31.395613 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.395941 32251 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.396705 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.288352 27832 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:31.398679 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.399266 27832 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:31.399461 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.400061 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.303037 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.400606 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.400869 27839 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:31.401376 27838 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 17 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:12:31.327737 27157 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:31.326673 32429 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.328413 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.403002 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.327646 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.330663 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.403872 32429 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.404161 27297 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:31.405049 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.406095 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.332408 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.375851 27301 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
W20260709 13:12:31.406265 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 507987us
I20260709 13:12:31.299085 31917 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:31.335865 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.336210 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.302496 32014 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:31.315659 32414 consensus_meta.cc:287] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.030s	user 0.006s	sys 0.006s
I20260709 13:12:31.337981 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.265663 32472 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.339769 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.455183 27230 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:31.341344 27223 raft_consensus.cc:2393] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:31.179311 31943 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.326352 32430 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.299465 32470 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.329347 32299 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:31.333138 32485 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:31.349390 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.333736 32462 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:31.348554 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 198833us
I20260709 13:12:31.464658 27155 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:31.335302 32231 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.336848 32435 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:31.359122 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.341209 32284 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:31.363036 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.366593 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.480907 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.481470 27148 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:31.403889 27231 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:31.377743 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.382211 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.484023 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:31.407914 27837 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:31.385478 27836 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 7.
I20260709 13:12:31.400633 27832 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:31.412726 27299 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:31.486539 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.487113 27299 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:31.487938 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.488456 27299 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:31.460930 32178 consensus_meta.cc:287] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.706s	user 0.004s	sys 0.008s
I20260709 13:12:31.417424 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.494652 27841 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:31.364434 32209 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:31.419598 27834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1895) took 1184 ms (client timeout 1529 ms). Trace:
I20260709 13:12:31.447453 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.340770 32378 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.397838 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.502456 27300 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:31.503595 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.432113 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.463672 32446 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.455718 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.345968 32279 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:31.462857 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 124961us
W20260709 13:12:31.495458 32439 consensus_meta.cc:287] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:12:31.472361 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:31.481530 27230 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:31.420625 31917 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
W20260709 13:12:31.478907 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 115970us
I20260709 13:12:31.575522 27841 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:31.489159 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:31.406710 27150 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:31.491052 27840 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:31.578240 27299 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:31.493100 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:31.578996 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 85971.5us
W20260709 13:12:31.419561 27224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2303) took 2396 ms (client timeout 3005 ms). Trace:
I20260709 13:12:31.494594 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.581310 27228 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:31.497665 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.454702 32397 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:31.581085 27224 rpcz_store.cc:269] 0709 13:12:29.019119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.021149 (+  2030us) service_pool.cc:224] Handling call
0709 13:12:31.415274 (+2394125us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000951d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:31.415426 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3107842304}
I20260709 13:12:31.485750 32408 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.500058 27834 rpcz_store.cc:269] 0709 13:12:30.234935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.235080 (+   145us) service_pool.cc:224] Handling call
0709 13:12:31.415004 (+1179924us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54008912d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:31.419534 (+  4530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074700160}
I20260709 13:12:31.501526 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.504971 27304 raft_consensus.cc:606] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:31.461814 32470 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:31.408111 32477 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.414314 32387 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.509593 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.612955 27156 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:31.613338 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:31.512859 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.455627 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.515071 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:31.493680 32457 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:31.516801 32407 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.500236 32362 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:31.520316 32496 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:12:31.541599 32209 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.486788 32014 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:31.547426 32472 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.548945 32231 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.476249 32299 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.474865 32462 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.556720 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:31.631283 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 74624.9us
I20260709 13:12:31.633384 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:31.469583 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.634411 27157 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:31.639799 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.563694 27269 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.157948 32260 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:12:31.568352 27154 raft_consensus.cc:2410] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:12:31.570683 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 98608.7us
I20260709 13:12:31.582556 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:31.499245 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.643496 27155 raft_consensus.cc:2393] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:31.454388 32414 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.479681 32485 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.595822 27304 raft_consensus.cc:614] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:31.584685 27226 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:31.595836 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.599663 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.596922 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.595104 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.500744 32434 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:12:31.571250 32436 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:12:31.595391 32319 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.594146 32359 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:31.556277 32464 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:12:31.620343 32362 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:31.604871 32453 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.881s	user 0.002s	sys 0.003s
I20260709 13:12:31.605567 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.605671 31943 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.505337 32178 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.608042 32477 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.608680 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.611817 32408 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.610352 27225 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:31.583314 32489 log.cc:927] Time spent T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:31.467707 32430 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.685003 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.686287 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.649710 32391 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:31.659147 32394 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:31.598117 32397 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.623574 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:31.622529 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 267506us
I20260709 13:12:31.707471 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.708477 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.625999 27301 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:31.711333 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.621335 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.712884 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.712975 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.621779 27148 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:12:31.622591 32447 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.002s
I20260709 13:12:31.619953 32457 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.620070 32480 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:31.652777 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 55920.7us
I20260709 13:12:31.653143 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.653334 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.652957 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.691202 32365 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.604151 32279 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.659374 27157 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:31.628693 32014 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:31.652112 32265 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:12:31.672222 27835 raft_consensus.cc:2393] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:31.673872 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.686815 27227 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:31.746524 32265 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.747153 27155 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.747882 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.748719 32265 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.654465 32209 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:31.749466 32209 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.749840 32209 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:31.654345 32319 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.754281 32319 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.624958 32407 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.760038 32407 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.698119 27836 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:31.617666 27300 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
W20260709 13:12:31.651086 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 87456us
I20260709 13:12:31.572081 27229 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:31.761449 32429 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.761978 32429 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.764981 32429 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.665198 32362 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.664286 32231 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:31.703812 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.767586 27230 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:31.768711 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.769421 27230 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:31.675426 32359 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:31.498464 32284 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.770807 32359 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.771714 32284 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.655081 32384 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:12:31.715763 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.773696 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.774863 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.775146 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.776046 27230 raft_consensus.cc:2410] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:31.717753 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.719381 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.719544 27231 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:31.777268 27156 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
W20260709 13:12:31.777377 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 58063.3us
I20260709 13:12:31.655200 27298 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:31.778046 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.721123 32480 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.778913 32480 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:31.772578 27224 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:31.781188 31906 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:31.781595 31906 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.783116 27149 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.795040 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.797974 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.723730 27301 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:31.672778 32472 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:12:31.822546 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.702600 32394 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.859556 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.718012 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.703024 32391 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:31.720386 32449 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.716676 32430 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.721365 32457 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:31.742951 32485 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.748636 27227 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:31.648916 32378 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:31.701063 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 161644us
I20260709 13:12:31.772387 32178 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.776763 32414 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:31.831122 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.852797 32284 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:31.852110 32297 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:31.893527 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.871861 32394 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.781983 31906 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.821097 32384 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:31.870514 27155 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:31.903069 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:31.727917 27232 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:31.873098 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:31.875191 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 157232us
I20260709 13:12:31.696755 32412 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.778383 32435 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.729964 32227 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.730755 31943 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:31.786258 32014 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.884006 27122 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.729838 32466 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:31.721804 32447 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.853535 32231 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:31.899326 27157 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:31.898200 32297 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:31.732147 32365 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.876442 32251 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:31.906594 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.910665 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.912642 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:31.852752 32434 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:12:31.916325 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.893136 32284 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.919920 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:31.933359 27150 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:31.933938 27231 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:12:31.923418 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.934141 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:31.784793 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:31.923645 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:31.935050 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 150339us
I20260709 13:12:31.920598 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:31.911098 32384 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:31.928680 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:31.930351 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:31.916057 32429 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.928318 32260 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:31.937067 27123 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:31.925921 27305 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:31.938256 32430 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:31.938619 32397 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:31.938957 32505 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:12:31.922271 32227 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.962405 32227 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.918479 32435 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.963351 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.964407 32435 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.941326 32447 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.944007 32365 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.935987 32284 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:31.945974 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:31.924717 32466 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.935804 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:31.946759 32382 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:31.929131 32503 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:12:31.936403 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.951524 32384 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.926731 31917 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:31.953639 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.002425 27227 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:32.003413 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.004503 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.005414 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:32.005875 27835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1894) took 1782 ms (client timeout 1986 ms). Trace:
I20260709 13:12:31.981807 32382 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.006587 32382 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:32.006316 27835 rpcz_store.cc:269] 0709 13:12:30.223194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.224072 (+   878us) service_pool.cc:224] Handling call
0709 13:12:32.005709 (+1781637us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400336154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.005824 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3319580032}
I20260709 13:12:31.928208 32297 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.007408 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.007957 27835 raft_consensus.cc:2376] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13. Re-sending same reply.
I20260709 13:12:31.953907 32178 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:31.966001 27832 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:32.010842 27837 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:32.011054 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:32.011603 27832 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:32.012092 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1445) took 1060 ms. Trace:
I20260709 13:12:32.012372 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:32.012470 27837 rpcz_store.cc:276] 0709 13:12:30.952096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.496761 (+544665us) service_pool.cc:224] Handling call
0709 13:12:32.010619 (+513858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.011227 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.011943 (+   716us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400336150. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.012047 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180836224}
I20260709 13:12:32.013013 27832 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:32.013610 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.932941 32449 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:31.977329 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:31.978514 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:32.014786 27231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.015071 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.015285 27195 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.016093 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.016350 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:32.017071 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.017236 32433 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:32.017766 27150 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:31.980914 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1436) took 1080 ms. Trace:
I20260709 13:12:32.022069 27833 rpcz_store.cc:276] 0709 13:12:30.900533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.901653 (+  1120us) service_pool.cc:224] Handling call
0709 13:12:31.980739 (+1079086us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400510754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:31.980840 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362735872}
I20260709 13:12:32.022576 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.023134 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:32.023458 32466 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.023737 27833 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:31.951242 32446 raft_consensus.cc:2764] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:12:32.024842 27150 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:31.984460 32447 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.026458 32447 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.026798 32447 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:31.955056 32299 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:31.967927 32414 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:32.028038 32414 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:31.931058 32231 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.036356 32231 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.038605 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.040387 27838 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:32.040853 32470 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.042289 32397 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:32.042979 32397 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:32.044150 32397 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:31.990739 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.045456 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2493) took 2508 ms. Trace:
I20260709 13:12:31.992455 32412 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.045791 27298 rpcz_store.cc:276] 0709 13:12:29.536996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.538570 (+  1574us) service_pool.cc:224] Handling call
0709 13:12:29.538889 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.778270 (+2239381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.045218 (+266948us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54000e9054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.045404 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4866377984}
I20260709 13:12:31.973272 32509 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:32.049641 32435 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:32.050305 32509 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.050863 32509 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:31.933089 32391 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.021713 32457 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.013759 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:31.956168 32429 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.060127 32429 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.927999 32387 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.017717 32433 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.062819 32433 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.018381 32378 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.018877 32408 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:31.955309 32260 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:32.019521 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.021207 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.021586 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:32.096866 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1447) took 1144 ms. Trace:
I20260709 13:12:32.097749 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.097358 27836 rpcz_store.cc:276] 0709 13:12:30.952657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.493812 (+541155us) service_pool.cc:224] Handling call
0709 13:12:31.494129 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.760922 (+266793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.096487 (+335565us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540051ead4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.096794 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468511488}
I20260709 13:12:32.099231 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.100530 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:31.947347 32248 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.065868 27227 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:32.102380 27231 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:32.078581 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:32.103451 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:32.090585 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.095029 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.238588 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1075) took 1022 ms. Trace:
I20260709 13:12:32.238915 27232 raft_consensus.cc:2410] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:12:32.239003 27835 rpcz_store.cc:276] 0709 13:12:31.216100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.237799 (+1021699us) service_pool.cc:224] Handling call
0709 13:12:32.238117 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.238288 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.238310 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.238350 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:32.238386 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.238438 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.238540 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.239293 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 135938us
I20260709 13:12:32.242439 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:32.245360 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.247447 27231 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:32.247673 27225 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:32.248061 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1127) took 1059 ms. Trace:
I20260709 13:12:32.248538 27231 rpcz_store.cc:276] 0709 13:12:31.188174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.246966 (+1058792us) service_pool.cc:224] Handling call
0709 13:12:32.247176 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.247831 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.248011 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.237012 32445 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.628s	user 0.000s	sys 0.008s
I20260709 13:12:32.104261 32260 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.088461 32470 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.236976 32248 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.243744 32408 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.244794 32435 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:32.017274 32362 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.246548 32477 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.291636 32509 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.294036 32509 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.295722 31906 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.298316 32439 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:32.301379 32480 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:12:32.303748 32362 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:32.277721 32248 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.253816 32264 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:32.308375 27229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3435) took 1507 ms (client timeout 1594 ms). Trace:
W20260709 13:12:32.308849 27229 rpcz_store.cc:269] 0709 13:12:30.800788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.802273 (+  1485us) service_pool.cc:224] Handling call
0709 13:12:32.308204 (+1505931us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540037a854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.308317 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614281600}
I20260709 13:12:32.101907 32319 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.264397 32229 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.310832 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2315) took 1059 ms. Trace:
I20260709 13:12:32.315438 27229 rpcz_store.cc:276] 0709 13:12:31.251615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.309846 (+1058231us) service_pool.cc:224] Handling call
0709 13:12:32.310241 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.310449 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.310483 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.310539 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.310582 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.310649 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.310770 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.317359 27229 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:12:32.317732 27229 pending_rounds.cc:85] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 10
I20260709 13:12:32.317982 27229 pending_rounds.cc:107] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:12:32.319036 27229 raft_consensus.cc:2889] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:32.307212 32414 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:32.306035 32462 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.651s	user 0.000s	sys 0.007s
I20260709 13:12:32.321682 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3449) took 1067 ms. Trace:
I20260709 13:12:32.328171 27229 rpcz_store.cc:276] 0709 13:12:31.254463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.316584 (+1062121us) service_pool.cc:224] Handling call
0709 13:12:32.316935 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.319643 (+  2708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.321616 (+  1973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.330607 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3451) took 1075 ms. Trace:
I20260709 13:12:32.282984 32435 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:32.271564 32454 consensus_queue.cc:1059] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:12:32.311621 32264 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:32.281286 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 557753us
I20260709 13:12:32.335621 27834 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:32.251880 27232 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.388150 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2313) took 1137 ms. Trace:
I20260709 13:12:32.301916 32480 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:32.325361 32469 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.476s	user 0.006s	sys 0.015s
W20260709 13:12:32.331765 32209 consensus_meta.cc:287] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
I20260709 13:12:32.306633 32408 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.334405 32509 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.338191 32462 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.333024 31906 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.378484 32288 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.381336 32435 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.398487 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1074) took 1182 ms. Trace:
I20260709 13:12:32.248694 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1135) took 1056 ms. Trace:
I20260709 13:12:32.389490 27232 rpcz_store.cc:276] 0709 13:12:31.251113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.251309 (+1000196us) service_pool.cc:224] Handling call
0709 13:12:32.251649 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.387881 (+136232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.388095 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:32.363411 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 601824us
I20260709 13:12:32.384850 32264 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.399596 27225 rpcz_store.cc:276] 0709 13:12:31.192122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.247092 (+1054970us) service_pool.cc:224] Handling call
0709 13:12:32.247448 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.248321 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.248628 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.401706 27837 raft_consensus.cc:1275] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:32.402395 27153 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:32.400929 27269 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:32.408890 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 163585us
I20260709 13:12:32.371004 27229 rpcz_store.cc:276] 0709 13:12:31.255225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.329219 (+1073994us) service_pool.cc:224] Handling call
0709 13:12:32.329567 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.330205 (+   638us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:32.330245 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.330301 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:32.330343 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.330415 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.330546 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1496,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5087}
I20260709 13:12:32.385720 32414 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:32.413389 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.415673 27229 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:32.417768 27229 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:32.421137 32362 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:32.421658 32480 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:32.423269 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:32.391757 32297 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.431887 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:32.431964 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2769) took 2071 ms. Trace:
I20260709 13:12:32.432217 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.432515 27151 rpcz_store.cc:276] 0709 13:12:30.360742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.362126 (+  1384us) service_pool.cc:224] Handling call
0709 13:12:30.362553 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:30.362835 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:30.362878 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:30.366923 (+  4045us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.635116 (+268193us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:30.635166 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.635265 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.261466 (+1626201us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:32.415507 (+154041us) raft_consensus.cc:1685] finished
0709 13:12:32.415535 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.431883 (+ 16348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4645248,"thread_start_us":230671,"threads_started":1,"wal-append.queue_time_us":367291}
I20260709 13:12:32.439304 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.434391 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.445703 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.410123 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.397833 32509 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.451121 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.395963 32209 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.413507 31906 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.453533 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:32.454761 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.452893 27232 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:12:32.428615 32014 consensus_meta.cc:287] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.001s
W20260709 13:12:32.458482 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48434.8us
I20260709 13:12:32.458633 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.414590 32447 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.565860 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:32.573175 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:32.428435 32231 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:32.495589 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.436848 32362 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:12:32.497574 32527 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.523458 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42282 (request call id 43) took 1299 ms. Trace:
I20260709 13:12:32.583554 27304 rpcz_store.cc:276] 0709 13:12:31.224045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.248488 (+ 24443us) service_pool.cc:224] Handling call
0709 13:12:32.523267 (+1274779us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000587d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d31853 00007f9a56cff60a 00007f9a502857d4 00007f9a50285762 00007f9a50285691 00007f9a5028560c 00007f9a502848c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.523374 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286537472}
W20260709 13:12:32.500351 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.526271 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 882626us
I20260709 13:12:32.514758 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1071) took 1330 ms. Trace:
I20260709 13:12:32.585613 27833 rpcz_store.cc:276] 0709 13:12:31.184091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.024363 (+840272us) service_pool.cc:224] Handling call
0709 13:12:32.024614 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.029338 (+  4724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.029366 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.029406 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:32.029441 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.514453 (+485012us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b5400336b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.514499 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.514659 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10473344}
I20260709 13:12:32.587960 27833 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:12:32.588308 27833 pending_rounds.cc:85] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
I20260709 13:12:32.588557 27833 pending_rounds.cc:107] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:32.588835 27833 raft_consensus.cc:2889] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:32.508910 32284 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.003s
I20260709 13:12:32.515583 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1035) took 1178 ms. Trace:
I20260709 13:12:32.525936 27836 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:32.508841 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:32.457190 32288 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:32.522511 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:32.516079 27223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3434) took 1715 ms (client timeout 1917 ms). Trace:
I20260709 13:12:32.489502 31906 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.422721 32414 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.535637 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1913) took 1254 ms. Trace:
I20260709 13:12:32.539831 32462 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:32.540601 32394 consensus_meta.cc:287] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:12:32.513368 32378 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:32.542320 32408 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.499521 32509 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:32.543582 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 278726us
W20260709 13:12:32.534921 32382 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
I20260709 13:12:32.401407 32433 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.527913 32319 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.570606 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2311) took 1394 ms. Trace:
I20260709 13:12:32.648047 31906 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.571309 27227 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:32.589622 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1080) took 1255 ms. Trace:
I20260709 13:12:32.648418 32231 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:32.668781 27833 rpcz_store.cc:276] 0709 13:12:31.334204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.587179 (+1252975us) service_pool.cc:224] Handling call
0709 13:12:32.587528 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.589309 (+  1781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.589557 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
I20260709 13:12:32.603343 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.626298 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.626788 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.669992 27298 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:32.670358 27297 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:32.615883 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.644254 27834 rpcz_store.cc:276] 0709 13:12:31.281843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.534769 (+1252926us) service_pool.cc:224] Handling call
0709 13:12:32.535116 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.535310 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.535337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.535388 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:32.535421 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.535479 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.535586 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.601816 27299 rpcz_store.cc:276] 0709 13:12:31.337467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.625969 (+288502us) service_pool.cc:224] Handling call
0709 13:12:31.626237 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.701746 (+ 75509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.701793 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.701849 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:31.701895 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.515349 (+813454us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54001ca7d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.515399 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.515518 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173100288}
I20260709 13:12:32.671864 27302 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:32.632417 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.672458 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.672487 27300 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.673672 27306 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.673535 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:32.556245 32259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.036s	sys 0.047s
I20260709 13:12:32.652377 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.676079 27304 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:32.579221 32454 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.581662 32391 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:32.644666 32439 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:32.664466 27228 raft_consensus.cc:2410] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:12:32.665518 27224 rpcz_store.cc:276] 0709 13:12:31.176583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.599386 (+422803us) service_pool.cc:224] Handling call
0709 13:12:32.570432 (+971046us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400125cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.570549 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291305728}
I20260709 13:12:32.561617 32260 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.643503 32434 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:32.648167 32284 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.671090 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.677240 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:32.645946 27223 rpcz_store.cc:269] 0709 13:12:30.800510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.802203 (+  1693us) service_pool.cc:224] Handling call
0709 13:12:32.515859 (+1713656us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400095bd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.516013 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126704384}
I20260709 13:12:32.678612 27834 pending_rounds.cc:85] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 10
I20260709 13:12:32.679616 27297 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:32.673592 32387 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:32.679904 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1914) took 1099 ms. Trace:
I20260709 13:12:32.680420 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1912) took 1444 ms. Trace:
I20260709 13:12:32.579119 32014 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.571126 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.704417 27835 rpcz_store.cc:276] 0709 13:12:31.235674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.246884 (+1011210us) service_pool.cc:224] Handling call
0709 13:12:32.247161 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.247356 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:32.534575 (+287219us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.680101 (+145526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.680145 (+    44us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:32.680189 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.680249 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.680360 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26356,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2849,"raft.queue_time_us":2574,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":8744,"thread_start_us":424999,"threads_started":2}
I20260709 13:12:32.701831 27302 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
I20260709 13:12:32.707085 27150 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:12:32.683435 32391 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:32.708456 27150 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:32.684952 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.683419 32231 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:32.683616 32439 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:32.709416 27232 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:32.691030 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:32.679095 32259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.036s	sys 0.048s
I20260709 13:12:32.715054 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:32.666538 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 81849.2us
I20260709 13:12:32.657428 32394 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:32.679836 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 106753us
I20260709 13:12:32.720117 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:32.702768 32509 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:32.702646 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:32.723333 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.724436 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.702747 27152 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:32.704282 27833 rpcz_store.cc:276] 0709 13:12:31.580191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.679141 (+1098950us) service_pool.cc:224] Handling call
0709 13:12:32.679415 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.679581 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.679612 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.679652 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:32.679689 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.679757 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.679851 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.666373 32382 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.709674 27306 raft_consensus.cc:2410] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:12:32.582664 32397 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:12:32.685029 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.729772 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.730166 27224 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:32.708468 32391 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.712913 27841 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:32.716050 27300 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:32.721293 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.713203 32260 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.733603 27807 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.734077 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.734578 32439 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.726987 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:32.735615 32439 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.737133 32537 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:32.727169 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1450) took 1023 ms. Trace:
I20260709 13:12:32.683553 32248 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.739576 32248 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.740163 27833 rpcz_store.cc:276] 0709 13:12:31.703432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.725764 (+1022332us) service_pool.cc:224] Handling call
0709 13:12:32.726505 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.726751 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.726790 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.726848 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:32.726903 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.726973 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.727100 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.740684 32435 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.741977 27225 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:32.683374 32454 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.744588 32454 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.746536 32288 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:32.731038 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:32.712459 32014 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:32.734936 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.701649 27834 pending_rounds.cc:107] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:12:32.751730 27834 raft_consensus.cc:2889] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:32.742779 27833 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:32.752892 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1451) took 1049 ms. Trace:
I20260709 13:12:32.753224 27833 rpcz_store.cc:276] 0709 13:12:31.703715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.742019 (+1038304us) service_pool.cc:224] Handling call
0709 13:12:32.742303 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.752654 (+ 10351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.752840 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.754745 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1452) took 1050 ms. Trace:
I20260709 13:12:32.755074 27833 rpcz_store.cc:276] 0709 13:12:31.703959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.753954 (+1049995us) service_pool.cc:224] Handling call
0709 13:12:32.754248 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.754421 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.754448 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.754492 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:32.754527 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.754579 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.754695 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.756556 27833 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:12:32.756846 27833 pending_rounds.cc:85] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 10
I20260709 13:12:32.757054 27833 pending_rounds.cc:107] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:12:32.757287 27833 raft_consensus.cc:2889] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:32.759091 32014 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:32.759474 32394 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.759858 32014 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:32.760736 32209 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.761579 32014 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:32.735451 32408 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.709255 32297 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.769578 27223 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:32.757889 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1082) took 1041 ms. Trace:
I20260709 13:12:32.699517 32434 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:32.770802 27833 rpcz_store.cc:276] 0709 13:12:31.716932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.755938 (+1039006us) service_pool.cc:224] Handling call
0709 13:12:32.756227 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.757685 (+  1458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.757844 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:32.778786 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:32.779089 32397 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:32.782956 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:32.766978 32523 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:12:32.709491 32387 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.794499 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:32.790592 32408 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:32.796970 32408 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.730607 32509 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.797345 32408 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:32.799073 32509 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.803532 27833 raft_consensus.cc:1275] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:32.795864 32447 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:32.801558 32456 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:32.806334 32231 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:32.817229 32528 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:12:32.803861 32435 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.819314 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1434) took 1922 ms. Trace:
I20260709 13:12:32.826924 27305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2299) took 1767 ms. Trace:
I20260709 13:12:32.835883 27305 rpcz_store.cc:276] 0709 13:12:31.059186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.059323 (+   137us) service_pool.cc:224] Handling call
0709 13:12:31.059594 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.959173 (+899579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.826704 (+867531us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54000bac54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.826871 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991940864}
I20260709 13:12:32.831485 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.813144 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:32.842519 27305 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:32.835376 27840 rpcz_store.cc:276] 0709 13:12:30.897248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:30.897442 (+   194us) service_pool.cc:224] Handling call
0709 13:12:32.819109 (+1921667us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54005e6854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.819256 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164449664}
I20260709 13:12:32.844914 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.845481 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3458) took 1435 ms. Trace:
I20260709 13:12:32.845825 27225 rpcz_store.cc:276] 0709 13:12:31.410161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.401903 (+991742us) service_pool.cc:224] Handling call
0709 13:12:32.402733 (+   830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.742317 (+339584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.834765 (+ 92448us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001da6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.845425 (+ 10660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779760384}
I20260709 13:12:32.846926 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.847466 27305 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.843128 27195 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:32.847453 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 96117.3us
I20260709 13:12:32.853619 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.854820 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.855939 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:32.857162 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:32.858564 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.862852 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.864913 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:32.865792 27150 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:32.818248 32517 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
W20260709 13:12:32.821859 32384 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.783s	user 0.002s	sys 0.008s
I20260709 13:12:32.871791 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2314) took 1620 ms. Trace:
I20260709 13:12:32.874768 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.879622 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.880775 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.881156 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.883332 27155 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:32.885737 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.832701 32359 raft_consensus.cc:3055] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:32.826617 32538 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:32.826754 32456 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.891024 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.829978 32434 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:32.891578 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.888201 27297 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:32.887086 27306 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:32.888666 27150 raft_consensus.cc:1240] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:32.888075 27122 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:32.914152 32435 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:12:32.897028 27305 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:32.886749 27231 rpcz_store.cc:276] 0709 13:12:31.251375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.249792 (+998417us) service_pool.cc:224] Handling call
0709 13:12:32.250165 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:32.250801 (+   636us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:32.272455 (+ 21654us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.360174 (+ 87719us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b18001dea80. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:32.452339 (+ 92165us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:32.457436 (+  5097us) log.cc:844] Serialized 52 byte log entry
0709 13:12:32.457617 (+   181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:32.457665 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.457856 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.816676 (+358820us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:32.871519 (+ 54843us) raft_consensus.cc:1685] finished
0709 13:12:32.871548 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.871722 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19002,"prepare.queue_time_us":21363,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":28043,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":41663,"spinlock_wait_cycles":19200256,"thread_start_us":106260,"threads_started":1,"wal-append.queue_time_us":336304}
I20260709 13:12:32.889079 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:32.924505 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1123) took 3493 ms. Trace:
I20260709 13:12:32.897856 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.823794 32229 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:32.817408 32284 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.826306 32382 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:32.831367 32387 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.899798 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.886200 32542 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:12:32.908643 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 95556.8us
I20260709 13:12:32.891916 32359 raft_consensus.cc:740] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:32.886616 32439 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:32.820363 32264 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.925220 27226 rpcz_store.cc:276] 0709 13:12:29.430087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.430244 (+   157us) service_pool.cc:224] Handling call
0709 13:12:29.430542 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.644714 (+2214172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.923115 (+1278401us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400226fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.923282 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4953491840}
I20260709 13:12:32.926352 27840 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:32.923187 27841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1070) took 1745 ms. Trace:
I20260709 13:12:32.939502 27841 rpcz_store.cc:276] 0709 13:12:31.178209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.620614 (+442405us) service_pool.cc:224] Handling call
0709 13:12:31.637164 (+ 16550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.734115 (+1096951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.922952 (+188837us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400661a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:32.923129 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473535360}
I20260709 13:12:32.891464 32021 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:32.931483 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:32.944912 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:32.912483 32456 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.934908 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.924388 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.937780 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1167) took 1233 ms. Trace:
I20260709 13:12:32.948127 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.914585 32248 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:32.950853 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.921654 32318 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:32.966543 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.931134 32229 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:32.949419 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:32.931653 32545 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:32.899200 32384 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.950928 27836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1076) took 1734 ms. Trace:
I20260709 13:12:32.912940 32538 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.972530 27836 rpcz_store.cc:276] 0709 13:12:31.216358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.238133 (+1021775us) service_pool.cc:224] Handling call
0709 13:12:32.525746 (+287613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.603191 (+ 77445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.950697 (+347506us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54008912d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:32.950860 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660750080}
I20260709 13:12:32.973726 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.948313 27157 rpcz_store.cc:276] 0709 13:12:31.704731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.939141 (+234410us) service_pool.cc:224] Handling call
0709 13:12:31.939422 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.939609 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.939634 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.940044 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.253482 (+313438us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:32.253520 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.253689 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.817704 (+564015us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:32.929911 (+112207us) raft_consensus.cc:1685] finished
0709 13:12:32.929931 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.937707 (+  7776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4635008,"thread_start_us":313085,"threads_started":1,"wal-append.queue_time_us":385386}
I20260709 13:12:32.952057 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:32.931787 32447 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.954783 32259 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:32.955500 32536 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:32.933565 32539 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:32.967655 32284 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:32.968791 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.970999 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:32.973795 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:32.950582 32156 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:32.951388 32248 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.966611 31943 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:33.000187 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.016286 27836 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:33.000481 27841 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:33.001350 27298 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:33.021409 32264 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.021553 32433 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.021997 32284 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:33.022322 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.022981 27841 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:32.986902 32509 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:32.987196 32021 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:32.969708 32439 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:32.969377 32525 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:32.979177 32545 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.037086 32414 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.037557 32545 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.039067 32384 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:32.992527 32544 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:33.040874 32544 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.041237 32544 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:33.044540 32533 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:12:33.046723 32231 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:33.047824 32231 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:33.048200 32231 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:33.048938 32359 consensus_queue.cc:260] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.050310 32359 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:33.054783 32534 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:12:33.016763 32248 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:32.989029 32468 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:33.056535 32414 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:33.057058 32414 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.059768 32414 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:33.060068 32532 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:12:33.017156 32536 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:33.062647 32536 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.063500 32538 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.027802 32408 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.064710 32536 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.066043 32408 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.066174 32391 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.979055 32447 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:33.030591 32457 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.049037 32231 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.023000 32284 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.070338 32447 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.070528 32468 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:33.086012 32546 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:12:33.086764 32468 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:33.127990 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 146534us
W20260709 13:12:33.141669 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 1.18485e+06us
I20260709 13:12:33.148849 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2780) took 1649 ms. Trace:
I20260709 13:12:33.149010 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:33.149500 27148 rpcz_store.cc:276] 0709 13:12:31.498951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.501157 (+  2206us) service_pool.cc:224] Handling call
0709 13:12:31.621394 (+120237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.713864 (+ 92470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.148367 (+1434503us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b540012c5d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.148610 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117790464}
W20260709 13:12:32.975349 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61935.5us
I20260709 13:12:32.983750 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:32.982378 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:33.168646 32231 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:32.977964 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:33.055738 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1915) took 1475 ms. Trace:
I20260709 13:12:33.175375 27834 rpcz_store.cc:276] 0709 13:12:31.580508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.678092 (+1097584us) service_pool.cc:224] Handling call
0709 13:12:32.678396 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:32.839389 (+160993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.839435 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:32.847070 (+  7635us) log.cc:844] Serialized 52 byte log entry
0709 13:12:32.938952 (+ 91882us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:32.938996 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.939059 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.055389 (+116330us) raft_consensus.cc:1685] finished
0709 13:12:33.055422 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.055656 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11682,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":178203,"threads_started":2,"wal-append.queue_time_us":125139}
I20260709 13:12:33.177016 32462 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.067117 32021 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.178732 32021 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.178341 32544 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.399487 27838 rpcz_store.cc:276] 0709 13:12:31.215818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.041179 (+825361us) service_pool.cc:224] Handling call
0709 13:12:32.066473 (+ 25294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.066722 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:12:32.237270 (+170548us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.396885 (+159615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:32.396952 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:32.398181 (+  1229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.398268 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.398419 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172541,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3151,"raft.queue_time_us":111,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2791,"thread_start_us":159140,"threads_started":1}
I20260709 13:12:33.164383 27229 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:33.150693 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.165652 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 1164) took 1466 ms. Trace:
I20260709 13:12:33.167783 32456 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:32.967288 27232 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:12:33.170931 27225 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:33.193284 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.201508 27152 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:33.204021 27835 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:33.206290 32156 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:12:33.207710 32391 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.208120 32156 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:33.208451 32470 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:33.208636 32156 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.209781 32470 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.211637 27156 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:33.190656 27153 rpcz_store.cc:276] 0709 13:12:31.699410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.708258 (+  8848us) service_pool.cc:224] Handling call
0709 13:12:33.165035 (+1456777us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540037f5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.165385 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594077568}
I20260709 13:12:33.215930 32260 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:12:33.218210 32559 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:33.219759 32559 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.220288 32559 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.222258 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:33.235466 31906 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
W20260709 13:12:33.236250 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.239559 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2300) took 2144 ms. Trace:
I20260709 13:12:33.209820 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.240231 27303 rpcz_store.cc:276] 0709 13:12:31.094931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.095064 (+   133us) service_pool.cc:224] Handling call
0709 13:12:31.095341 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:31.145784 (+ 50443us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:31.284638 (+138854us) log.cc:844] Serialized 14 byte log entry
0709 13:12:31.504778 (+220140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:31.504823 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:31.504868 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.238711 (+1733843us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54000587d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:33.238820 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.239199 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10278,"prepare.queue_time_us":225443,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":22878,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":115461504,"thread_start_us":337732,"threads_started":2,"wal-append.queue_time_us":367069,"wal-append.run_cpu_time_us":1249,"wal-append.run_wall_time_us":1082159}
I20260709 13:12:33.253026 27123 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.184893 32462 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.252696 32391 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.221931 32559 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.283957 32559 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:33.294345 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 85093.3us
I20260709 13:12:33.293708 32156 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.295967 32156 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:33.296482 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3357) took 1778 ms. Trace:
I20260709 13:12:33.296777 32470 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.296978 27156 rpcz_store.cc:276] 0709 13:12:31.517777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.777926 (+260149us) service_pool.cc:224] Handling call
0709 13:12:33.185559 (+1407633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.223843 (+ 38284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.296221 (+ 72378us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540037f5d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.296415 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3193152768}
W20260709 13:12:33.299536 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 115314us
I20260709 13:12:33.303359 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:33.304639 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2321) took 1528 ms. Trace:
I20260709 13:12:33.304880 27832 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:33.305008 27230 rpcz_store.cc:276] 0709 13:12:31.775992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.776957 (+   965us) service_pool.cc:224] Handling call
0709 13:12:33.302681 (+1525724us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:33.304509 (+  1828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28026240}
I20260709 13:12:33.236271 31906 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.306440 27272 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:33.307806 27299 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:33.308760 31906 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:33.309317 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.314479 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45802 (request call id 3351) took 1888 ms. Trace:
I20260709 13:12:33.315026 27154 rpcz_store.cc:276] 0709 13:12:31.425855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.447114 (+ 21259us) service_pool.cc:224] Handling call
0709 13:12:33.313949 (+1866835us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.314249 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156053376}
W20260709 13:12:33.317209 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:33.306468 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1922) took 1354 ms. Trace:
I20260709 13:12:33.256906 32378 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:33.326592 27832 rpcz_store.cc:276] 0709 13:12:31.951736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.013557 (+ 61821us) service_pool.cc:224] Handling call
0709 13:12:33.306190 (+1292633us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400753d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.306371 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869038336}
I20260709 13:12:33.342447 32394 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:33.348850 32229 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.352377 27841 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:33.355010 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:33.363619 32457 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:33.367302 27228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1128) took 2178 ms (client timeout 2411 ms). Trace:
W20260709 13:12:33.362418 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56394.4us
I20260709 13:12:33.367957 32462 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:33.367976 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 70855.5us
I20260709 13:12:33.369832 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1126) took 2181 ms. Trace:
I20260709 13:12:33.374897 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1440) took 2425 ms. Trace:
I20260709 13:12:33.376314 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1911) took 2149 ms. Trace:
I20260709 13:12:33.382923 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.384979 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.355559 32391 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.388319 27834 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:33.391721 27837 rpcz_store.cc:276] 0709 13:12:31.227015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.243902 (+1016887us) service_pool.cc:224] Handling call
0709 13:12:32.244177 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.402037 (+157860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.375805 (+973768us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400646254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:33.376133 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361467136}
I20260709 13:12:33.399283 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.399848 32456 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.399887 27837 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:33.400473 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.400945 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:33.401996 27832 raft_consensus.cc:2393] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 8: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:33.402434 27301 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:33.388463 27228 rpcz_store.cc:269] 0709 13:12:31.188403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.790739 (+602336us) service_pool.cc:224] Handling call
0709 13:12:32.508620 (+717881us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800004b98. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:33.366823 (+858203us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54000951d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.367099 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148534784}
I20260709 13:12:33.406008 27305 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:33.391309 27227 rpcz_store.cc:276] 0709 13:12:31.187955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.248977 (+1061022us) service_pool.cc:224] Handling call
0709 13:12:32.571082 (+322105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:32.668491 (+ 97409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.369261 (+700770us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400125cd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.369545 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737810560}
I20260709 13:12:33.390120 32457 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:33.411319 32457 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.390261 32260 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:33.414979 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1916) took 1834 ms. Trace:
I20260709 13:12:33.415038 32544 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.415496 27835 rpcz_store.cc:276] 0709 13:12:31.581509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.706700 (+1125191us) service_pool.cc:224] Handling call
0709 13:12:32.706910 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:33.204708 (+497798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.414734 (+210026us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54004a5454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:33.414909 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040812288}
I20260709 13:12:33.391368 27839 rpcz_store.cc:276] 0709 13:12:30.949496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.401451 (+451955us) service_pool.cc:224] Handling call
0709 13:12:31.489629 (+ 88178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.493575 (+  3946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.493609 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.494099 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.511729 (+1017630us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18004cf5a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:12:32.584738 (+ 73009us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:32.651803 (+ 67065us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.767372 (+115569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.767458 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.059488 (+292030us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:33.061356 (+  1868us) raft_consensus.cc:1685] finished
0709 13:12:33.061391 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.075319 (+ 13928us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b18004cf5a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:33.374468 (+299149us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b5400720bd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:33.374651 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3458,"prepare.queue_time_us":64271,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":20326,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":9210,"spinlock_wait_cycles":234236672,"thread_start_us":187173,"threads_started":2,"wal-append.queue_time_us":1182776}
W20260709 13:12:33.418361 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 241591us
I20260709 13:12:33.419611 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.314530 32542 consensus_queue.cc:1059] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:12:33.422415 27833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1923) took 1450 ms. Trace:
I20260709 13:12:33.423671 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.425307 27298 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:33.425275 32470 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:33.430406 32391 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:33.431176 32260 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.362548 32248 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.434167 27299 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.434562 32248 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:33.355139 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 371349us
I20260709 13:12:33.437129 27298 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.438570 27836 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:33.439599 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.440322 27832 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.438762 27303 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:33.425649 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:33.438640 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:33.457784 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66295.6us
I20260709 13:12:33.459429 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:33.460676 32412 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:33.461102 32412 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.461439 32412 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:33.422808 27833 rpcz_store.cc:276] 0709 13:12:31.972257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:32.807493 (+835236us) service_pool.cc:224] Handling call
0709 13:12:32.870359 (+ 62866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:32.908026 (+ 37667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:32.908072 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:32.914327 (+  6255us) log.cc:844] Serialized 26 byte log entry
0709 13:12:33.295124 (+380797us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b18003eeba0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a518df4bc 00007f9a4ec2d48b 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1
0709 13:12:33.385670 (+ 90546us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5400600520. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51cae6b8 00007f9a51d3792b 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c
0709 13:12:33.385902 (+   232us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:33.386001 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:33.391300 (+  5299us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.391359 (+    59us) raft_consensus.cc:1685] finished
0709 13:12:33.391382 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.422227 (+ 30845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23598,"raft.queue_time_us":41031,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8892,"spinlock_wait_cycles":101997568,"thread_start_us":243533,"threads_started":1,"wal-append.queue_time_us":159473}
I20260709 13:12:33.465580 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.455673 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.473994 27837 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:33.475135 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:33.477787 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.478101 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:33.478617 27838 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.478758 27300 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:33.477808 32260 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.483961 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.485281 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.485890 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.486131 27306 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:33.487438 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.488161 27304 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:33.494848 27300 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:33.495476 32378 raft_consensus.cc:3055] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:33.495869 32378 raft_consensus.cc:740] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:33.499269 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 47760.5us
I20260709 13:12:33.499394 32229 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.500705 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.504074 27298 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.504245 32556 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:33.514755 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:33.519651 27837 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:33.520112 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.496915 32378 consensus_queue.cc:260] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.557814 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.558878 32378 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:33.559538 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.560387 27297 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:33.560750 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.524827 32470 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:33.563086 32470 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:33.563576 32470 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.520982 31906 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:33.570015 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69475.5us
I20260709 13:12:33.570994 27271 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.571883 32394 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:33.574885 32359 consensus_meta.cc:287] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.005s
I20260709 13:12:33.580286 32457 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:33.582768 32447 consensus_meta.cc:287] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.010s
I20260709 13:12:33.583375 32447 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.584511 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.584630 32561 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:33.585443 27306 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:33.585513 32561 consensus_queue.cc:1243] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:12:33.586131 32265 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:33.586562 32462 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:33.586927 32265 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.586184 32561 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:33.588423 32561 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.589124 32265 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.532622 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:33.534390 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 108882us
I20260709 13:12:33.535908 27150 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:12:33.533819 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:33.590396 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.550807 32434 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:33.591828 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:33.554415 27303 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:33.557245 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.587975 32259 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:33.527084 27839 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:33.593109 27305 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:33.592859 32259 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.592204 32561 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.594324 27148 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.594291 32259 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.595098 32561 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.591902 32434 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.596189 32434 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:33.596525 32434 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:33.554865 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 133162us
I20260709 13:12:33.598942 32509 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:33.599061 27050 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 8 to 6, term changed from 8 to 7, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131), VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) added. New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:33.600394 32560 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.601032 32560 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.598412 32434 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.602272 32434 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:33.602319 32560 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.603160 32509 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:33.604151 32560 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.606180 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:33.606549 27041 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet d87c41315a07486aa13067ad7c47c34a consensus state has no leader
I20260709 13:12:33.601490 27050 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 7 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:33.610273 32260 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:33.612792 32260 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:33.613854 32260 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.615444 27298 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:33.617388 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.621620 27304 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:33.582660 32457 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.638839 27836 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:33.641234 27838 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:33.643028 27833 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:33.605664 32509 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:12:33.648276 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.649019 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.651144 27832 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:33.648815 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.585556 32447 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.658566 27300 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:33.634904 31906 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:33.662056 32542 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:33.663815 32299 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:33.663932 32412 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.666131 27232 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:12:33.666553 32412 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.666702 27232 pending_rounds.cc:85] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 10
I20260709 13:12:33.667147 27232 pending_rounds.cc:107] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:12:33.667491 27232 raft_consensus.cc:2889] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:33.669859 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.670545 27298 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:33.674423 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:33.675374 27229 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:33.675264 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:33.676054 27154 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:33.676239 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 163068us
I20260709 13:12:33.677098 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:33.678895 32544 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:33.679675 32544 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.682157 32231 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:33.683820 32231 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:33.684257 32231 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:33.684819 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.685878 27150 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:33.686615 32454 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:12:33.686910 32373 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:33.687624 32373 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:33.687819 32542 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:33.688269 32542 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:33.689100 27155 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.688817 32373 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.689145 32542 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.690620 32542 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.691584 27300 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:33.669116 32394 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:33.707971 32231 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.714110 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:33.715508 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.716326 27841 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.716742 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:33.717417 27832 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.718611 32259 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:33.722384 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 151515us
I20260709 13:12:33.723465 27297 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:33.724344 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.727325 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.732115 27300 raft_consensus.cc:1240] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:33.709899 32231 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.660552 31906 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.737277 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.738775 27298 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:33.642797 32021 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:33.745774 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 151844us
I20260709 13:12:33.746277 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:33.746886 27841 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:33.751724 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.752806 32394 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:33.753893 27157 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:33.753893 32394 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:33.733657 32373 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.762617 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.765766 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.744735 31906 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:33.777380 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.783406 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.784188 27297 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:33.779521 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:33.776557 32447 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:12:33.788179 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:33.780668 32412 raft_consensus.cc:2764] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:33.794659 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.796725 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:33.798985 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63613us
I20260709 13:12:33.765816 32318 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:33.800724 27229 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:12:33.767656 32021 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.803603 27232 raft_consensus.cc:2393] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:33.817338 27050 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 5 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 11 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:33.822724 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:33.825659 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:33.830318 27300 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.832769 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:33.823865 32299 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:33.857708 27832 raft_consensus.cc:2410] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:12:33.854085 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:33.861977 27229 raft_consensus.cc:3060] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:33.832020 32542 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:33.833534 32318 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.860731 32412 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:33.844400 32156 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:33.857810 32454 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.879562 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50427.7us
I20260709 13:12:33.862610 32456 consensus_queue.cc:1048] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:12:33.893962 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.895174 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.896447 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 160144us
W20260709 13:12:33.898010 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.883730 32542 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:33.899320 32574 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:12:33.882246 32260 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:12:33.890501 32447 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:12:33.910872 32284 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:12:33.887586 32454 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.914470 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.907871 32540 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:33.918120 32544 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.926836 27297 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:33.887410 32527 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:12:33.926270 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 103644us
I20260709 13:12:33.928200 32584 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.922649 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.905289 32470 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:33.935889 32454 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.938045 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.941143 27300 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
W20260709 13:12:33.939258 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 76739.7us
I20260709 13:12:33.943943 32318 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.945779 32527 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:33.950536 32527 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:33.951465 32527 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.949307 32462 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:33.952940 32462 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:33.955232 32462 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:33.922185 32540 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:33.955951 32540 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:33.956069 27050 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:33.959013 32542 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:33.961670 27229 raft_consensus.cc:2468] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:33.957741 27050 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 8 to 9, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:33.968259 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:33.971902 27155 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:33.964445 27806 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:33.936712 32260 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:33.975363 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.976734 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:33.942852 32454 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:33.979568 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.981346 32585 raft_consensus.cc:2804] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:33.982111 32585 raft_consensus.cc:697] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:33.983261 32585 consensus_queue.cc:237] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:33.987100 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 101264us
I20260709 13:12:33.987412 32590 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:33.988513 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.989379 27148 raft_consensus.cc:2393] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:33.990640 27055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 386) took 9365 ms. Trace:
W20260709 13:12:33.994736 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56406.5us
W20260709 13:12:33.995649 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 90680.4us
I20260709 13:12:33.996099 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.988059 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:33.997188 32259 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.003461 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.004451 27149 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:33.936688 32156 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
W20260709 13:12:34.008638 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 100090us
I20260709 13:12:34.010133 27050 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:34.012377 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:33.970345 32318 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:12:34.013007 27152 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:34.015295 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.016835 32470 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:34.018589 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.018750 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.019517 27149 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:34.021073 32394 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:34.022745 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet d87c41315a07486aa13067ad7c47c34a with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46398
I20260709 13:12:34.023391 27050 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 11 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 12 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.024336 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.025766 32259 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:34.026394 32259 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.027319 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.027549 32259 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.028927 32593 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.029290 32259 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:34.029862 32373 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:34.032315 32373 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.032388 32462 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:34.033418 32373 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.033962 32265 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:34.035409 32265 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:34.036230 32509 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:34.036653 32265 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:34.036978 32318 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:34.037088 32265 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.037485 32318 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:34.038405 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.038305 32265 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.039099 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.039644 32021 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:34.039840 32265 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.040217 32021 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.039546 32560 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:34.041460 32462 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:34.041213 32021 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.041854 32462 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.042384 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.042650 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:34.043357 27300 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.042848 32462 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.043913 27150 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:12:34.044157 32462 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:34.051517 27298 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:34.070545 27303 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:34.071058 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:34.072758 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.074386 32284 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:12:34.077085 32156 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:34.077701 27300 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:12:34.079447 27299 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:34.081431 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 66176.9us
I20260709 13:12:34.082849 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:34.086302 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.088951 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.093554 27301 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:34.100606 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.098616 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.102124 27303 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:34.102169 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 82398.3us
W20260709 13:12:34.104007 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.100701 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.076170 32590 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:34.107088 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.107517 27303 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:34.109036 27298 raft_consensus.cc:2393] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.113808 32598 tablet_replica.cc:333] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:12:33.991029 27055 rpcz_store.cc:276] 0709 13:12:24.625003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.625272 (+   269us) service_pool.cc:224] Handling call
0709 13:12:33.990420 (+9365148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:29.906737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:29.907467 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:29.907524 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:12:29.907557 (+    33us) tablet.cc:662] Decoding operations
0709 13:12:29.909789 (+  2232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:29.909861 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:29.909901 (+    40us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:12:29.916032 (+  6131us) tablet.cc:701] Row locks acquired
0709 13:12:29.916060 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:12:29.916250 (+   190us) write_op.cc:270] Start()
0709 13:12:29.916392 (+   142us) write_op.cc:276] Timestamp: P: 1783602749916181 usec, L: 0
0709 13:12:29.916420 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:12:29.917252 (+   832us) log.cc:844] Serialized 8266 byte log entry
0709 13:12:31.260702 (+1343450us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:31.773094 (+512392us) op_driver.cc:464] REPLICATION: finished
0709 13:12:31.942840 (+169746us) write_op.cc:301] APPLY: starting
0709 13:12:31.942924 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:32.246240 (+303316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:32.250954 (+  4714us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:32.821849 (+570895us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b180038de80. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a51a760ec 00007f9a51ac2c0a 00007f9a51ac24f7 00007f9a51ac2490 00007f9a51a79f48 00007f9a5578e1bb 00007f9a557d55d4 00007f9a556818da 00007f9a556843cb
0709 13:12:32.832184 (+ 10335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:32.832516 (+   332us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:12:32.832566 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:32.832967 (+   401us) log.cc:844] Serialized 188 byte log entry
0709 13:12:32.867469 (+ 34502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:32.867714 (+   245us) write_op.cc:454] Released schema lock
0709 13:12:32.867793 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:32.908530 (+ 40737us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:32.914475 (+  5945us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12132,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":169502,"apply.run_cpu_time_us":34897,"apply.run_wall_time_us":948956,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":671883,"prepare.run_cpu_time_us":18702,"prepare.run_wall_time_us":195591,"raft.queue_time_us":350062,"raft.run_cpu_time_us":7628,"raft.run_wall_time_us":194294,"replication_time_us":1856481,"spinlock_wait_cycles":29528832,"thread_start_us":1075227,"threads_started":5,"wal-append.queue_time_us":638799,"wal-append.run_cpu_time_us":27174,"wal-append.run_wall_time_us":3182486}]]}
I20260709 13:12:34.105369 32509 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:34.092787 32447 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:12:34.115490 32589 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.134886 27050 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 11 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 12 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.139169 27050 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 9 to 10, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.139963 32527 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.141635 32560 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:34.142040 32560 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.106475 31906 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.142567 32561 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:34.143035 32561 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.142894 32560 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.143949 31906 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:34.144232 32560 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:34.144661 27297 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:12:34.117297 32509 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.122417 32587 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:34.123270 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49144.1us
I20260709 13:12:34.123760 32594 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.103063 32318 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.106786 32156 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:34.101125 32412 consensus_queue.cc:1048] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:12:34.108428 32021 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:34.131704 32231 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:34.131944 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.107333 32590 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:34.151624 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:34.154107 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 71323.2us
I20260709 13:12:34.141453 27050 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.164592 32318 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.172796 27299 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:34.172881 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.175025 32435 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.175638 32435 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.175701 32412 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:34.176829 31906 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:34.177120 32412 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:34.150873 32509 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.186524 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.219301 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.221513 32509 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.222158 27223 raft_consensus.cc:2410] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:34.218376 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.218817 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.223352 32412 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.223529 27227 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:34.223708 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:34.197154 32156 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:12:34.219745 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.225643 32156 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:34.217839 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.226035 32156 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.225993 32544 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.226518 32412 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:34.218935 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57216.7us
I20260709 13:12:34.202595 32594 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:34.177974 32435 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.191567 32447 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:12:34.229408 32596 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:12:34.178217 32591 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:12:34.229614 32559 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:34.202381 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 70543.7us
I20260709 13:12:34.230134 32559 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.226553 27231 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.231041 32559 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.194358 32456 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:34.232122 32559 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.232237 32456 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.169364 32590 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.233218 32456 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.231395 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.211848 32394 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:12:34.227308 32156 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.211565 32561 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.234638 32594 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:34.235078 32394 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:34.235519 32561 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.236029 32585 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.236414 32456 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:34.235550 32394 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.217301 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.216372 27226 pending_rounds.cc:85] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 9
I20260709 13:12:34.238529 32156 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.238651 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.240912 27226 pending_rounds.cc:107] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:34.241204 27226 raft_consensus.cc:2889] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:34.241250 27224 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.209192 32598 raft_consensus.cc:2243] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:34.237921 32394 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.182236 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.211635 32457 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:12:34.246940 32394 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.247175 32587 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:34.247751 32587 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.248777 32587 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.249892 32587 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.250416 32592 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.251014 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.251842 27232 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:34.251019 32592 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.253051 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.254966 32592 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.255136 27230 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:34.255671 32585 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.255787 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.256153 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.256321 32585 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.256942 27227 raft_consensus.cc:2410] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:34.223150 27804 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.258379 32530 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.259052 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.258916 32530 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.259703 32585 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.260381 32585 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.260959 32598 raft_consensus.cc:2272] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:34.261023 32530 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.210021 27149 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:34.259625 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.263767 27232 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:34.264410 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.186551 27050 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:34.267917 27224 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:34.268944 27148 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:34.228039 32412 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.269732 27228 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:34.268673 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.270697 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.260393 27804 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.277158 27231 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:34.275050 27150 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:34.278954 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.279377 27223 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:34.281675 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.282635 27301 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.283145 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.283553 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.280025 27050 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:34.283424 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.284560 27149 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:34.278754 32231 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:34.186944 32583 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
I20260709 13:12:34.294281 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.269846 32598 ts_tablet_manager.cc:1916] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:34.298808 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.302243 27232 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.303066 27227 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:34.305814 32544 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:34.306345 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 46040.4us
I20260709 13:12:34.307040 27230 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:34.307459 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.308339 32592 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.308955 32592 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.309216 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.299345 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.312691 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:34.313467 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 138802us
I20260709 13:12:34.190943 32265 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:12:34.296353 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.317401 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.290302 31906 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.314338 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.199918 32540 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.320982 32584 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.321138 32373 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:34.321940 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.298956 32318 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.324584 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.290529 32527 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:34.321846 27050 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 9 to 10, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.332832 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.326663 32544 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.325763 32373 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.337363 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.338762 27228 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.333665 32284 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:34.339773 32373 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.340101 32284 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:34.339577 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.340538 32284 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.335140 27050 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:34.345786 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.336305 32434 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:34.350577 27228 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:34.351516 32447 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:34.351913 32447 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.352769 32447 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.353875 32447 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:34.358333 32597 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:34.358906 32434 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.362471 32544 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:34.362936 32544 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.347510 32584 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:12:34.363339 32544 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.363404 32434 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.367929 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.370990 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.356882 32595 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.379379 27231 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
W20260709 13:12:34.391264 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 45518us
I20260709 13:12:34.392411 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:34.409579 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.381903 32456 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:34.411595 32602 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:12:34.421228 27232 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:34.422838 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.426278 32318 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:34.441756 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48523.9us
I20260709 13:12:34.442294 27223 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:12:34.426703 32231 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.430830 32540 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:34.435798 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64861.8us
W20260709 13:12:34.436358 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.433410 32284 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.439953 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.444334 32592 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.455327 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.460424 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.464664 32559 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:34.464996 32601 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:12:34.465257 32559 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.469224 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:34.476905 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 54154.2us
I20260709 13:12:34.477389 32248 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:34.477684 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.478900 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.479008 32559 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:34.480773 32605 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:34.470830 32595 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:34.492983 32595 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.494136 32595 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.461576 32594 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:34.477893 32248 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.500010 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.471815 32584 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:34.501098 27271 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:34.504714 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.503974 27306 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:34.507655 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:34.508968 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.497679 32318 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.509183 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.513983 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.514175 32397 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:12:34.515834 32594 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:34.520612 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:34.520654 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.523602 27156 raft_consensus.cc:2410] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:12:34.524591 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.525084 32284 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.499260 32391 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:34.529527 27306 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:34.530591 32248 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.471028 32231 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.538401 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.544337 27156 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.543105 27228 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:12:34.546754 32318 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.508723 31906 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:34.557577 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.558341 27228 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:34.532758 32584 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.562633 32231 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.563196 32231 raft_consensus.cc:2764] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:12:34.570962 32373 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.562672 32584 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:34.573561 32373 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.548735 32585 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:34.578426 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 69503.5us
I20260709 13:12:34.582907 27271 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.584190 27271 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.585053 32457 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.585737 32457 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:34.586216 32457 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.587301 32457 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.556149 32318 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.581050 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.590692 27306 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:34.591799 32318 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.593703 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:34.594933 27301 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:34.596329 32584 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:34.596711 32584 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.597060 32584 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:34.597160 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:34.598137 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.599593 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.599402 27156 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:34.602514 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:34.533166 32559 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.602800 27195 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.502838 32586 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:34.610841 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 101729us
I20260709 13:12:34.612361 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.544168 32391 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:34.613288 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.555076 32299 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.555271 32540 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:34.625924 27156 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:34.626004 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.628293 27836 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:34.547876 32265 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:12:34.639242 32265 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:34.639640 32265 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.640607 32265 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.606506 32231 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:34.642614 27297 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:34.643194 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.644081 32412 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:34.644563 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:34.645017 27041 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet d87c41315a07486aa13067ad7c47c34a consensus state has no leader
I20260709 13:12:34.644613 32412 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.645259 32585 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.645581 32447 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:34.645853 32585 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.646416 32447 consensus_queue.cc:1243] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:12:34.646188 32412 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.646945 32447 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:34.647297 32447 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:34.648015 32585 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:34.648077 32447 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.651901 32590 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.650465 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.651304 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:34.653739 32589 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:34.655139 27832 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:12:34.655573 32589 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:34.656227 27834 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:34.656494 32589 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.654546 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:34.659574 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.661190 27231 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:34.661515 32584 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:34.645613 32560 consensus_meta.cc:287] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 13:12:34.662930 27152 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:34.652529 32447 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.664065 27232 raft_consensus.cc:1275] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:12:34.597920 32530 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.664060 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:34.666360 32530 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.668678 32530 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.670087 32584 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.673537 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.637912 27195 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.665661 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.666922 27223 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:34.678246 27838 raft_consensus.cc:2393] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.664990 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.679271 27835 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:34.608966 32559 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.615751 32586 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:34.697434 27148 raft_consensus.cc:1240] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:34.641872 32265 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:34.699584 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 67229.7us
I20260709 13:12:34.700788 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.703038 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.630787 32456 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:34.714167 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.715245 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.717720 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.719607 32231 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:34.594040 32544 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.697165 32559 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.727578 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.724340 27148 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:34.729013 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.731237 27832 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:34.731918 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:34.732496 27156 raft_consensus.cc:2393] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:34.699524 32586 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.730538 27835 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:34.733297 27195 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:34.738085 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.738379 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.738672 27838 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:34.739696 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.734305 32156 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:34.743162 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.744701 32594 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.745272 32594 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.681769 32391 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:34.748950 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64042.1us
I20260709 13:12:34.749715 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.751441 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.752022 27835 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:34.756350 27836 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:34.726024 32456 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.762713 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.763104 27832 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:34.749476 32592 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:34.764667 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.759521 32359 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:34.769186 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:34.783041 27832 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:34.771975 32391 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:34.774240 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:34.788141 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.791630 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.756981 32560 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.754200 32590 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:34.800004 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.802783 27299 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.802942 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:34.806031 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.738734 32610 consensus_queue.cc:1048] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:12:34.810775 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.779263 32592 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:34.814172 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49622.7us
I20260709 13:12:34.819269 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.824648 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.828259 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.832221 27304 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:34.810340 32509 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:12:34.812997 32591 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:34.836037 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:34.836462 27301 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:34.836829 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.841496 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:34.841845 27300 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:34.813890 32556 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:34.823056 32592 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:34.842980 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:34.836215 32589 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:34.846740 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:34.822280 32462 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:34.846107 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54593.3us
I20260709 13:12:34.864315 27297 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:34.835454 32560 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:34.871214 27123 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.855302 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:34.841017 32584 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.838275 32435 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:34.840958 32591 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:34.872109 32527 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:34.847048 32597 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:34.845908 32468 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:34.853593 32359 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:34.889278 32462 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:34.856721 32556 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.885324 32591 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:34.901729 27123 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:34.910919 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 86332.1us
W20260709 13:12:34.914880 32616 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:12:34.916155 32561 consensus_meta.cc:287] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.003s
W20260709 13:12:34.916239 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:34.916769 27150 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:34.922274 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:34.923075 27302 raft_consensus.cc:2393] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:34.900414 32618 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:34.922771 32556 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.901760 32468 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:34.927135 27838 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
W20260709 13:12:34.930889 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.926920 32468 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:34.895963 32585 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.887679 32527 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:34.898901 32359 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.899992 32597 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:34.992976 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 53918.2us
I20260709 13:12:34.997941 27271 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
W20260709 13:12:34.989066 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 115697us
I20260709 13:12:34.885830 32284 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:12:34.885990 32584 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.873461 32456 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.996582 32544 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.002094 32600 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.012895 32597 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.013475 32626 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.014071 32626 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.020006 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 118381us
I20260709 13:12:35.020824 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:34.993031 32527 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:34.992847 32462 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:34.993021 32585 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:34.993098 32359 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.028676 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.000437 32610 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:35.023146 32412 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:12:35.039415 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.041585 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.040288 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.054512 27303 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:35.055786 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.056006 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:35.057147 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.057521 27299 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:35.032030 32318 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:35.032174 32600 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:35.064325 32620 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:35.066112 32584 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:35.072939 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73155us
W20260709 13:12:35.074000 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.075594 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:35.078498 27228 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:35.079802 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.038160 32462 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:35.103464 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.069471 32561 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:35.123031 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.123905 27224 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:35.125715 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50111.8us
I20260709 13:12:35.081122 32509 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:35.081862 32318 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:35.140659 27225 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:12:35.130403 32412 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:35.147430 32412 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.154861 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.157809 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.125670 32561 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.171324 27835 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:35.137928 32544 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.130896 32626 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.054481 32610 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.174957 32561 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.153266 32462 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.173831 32560 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:35.192348 32622 log.cc:927] Time spent T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:35.181509 32544 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.202171 27103 placement_policy_util.cc:248] tablet d87c41315a07486aa13067ad7c47c34a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:12:35.185094 32626 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:12:35.203671 32632 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:12:35.222615 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.208536 32594 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:35.191160 32447 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.006s
W20260709 13:12:35.215216 32609 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:12:35.244414 27103 placement_policy_util.cc:248] tablet 9e466225c5a147b9b31f11fea1bcf893: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:12:35.247224 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.248261 32318 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.249980 32610 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:35.261130 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 99662.5us
W20260709 13:12:35.264859 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 98363.8us
W20260709 13:12:35.268395 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 111409us
I20260709 13:12:35.269364 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:35.270838 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.277442 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:35.278208 32231 consensus_meta.cc:287] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 13:12:35.278633 32231 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:35.278666 32391 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:35.280822 32560 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:35.281410 32560 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:35.282712 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:35.282392 32560 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.283895 27224 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:35.283869 32391 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.286175 32391 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:35.286581 32391 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.286823 32591 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.288959 32591 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.274356 32447 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:35.226931 32559 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.293749 27155 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:12:35.297511 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.297652 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.299880 32644 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:35.300627 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.301375 32654 consensus_queue.cc:1059] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:12:35.302248 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.302825 27155 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:35.239063 32586 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.306951 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:35.312160 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.322747 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.308295 32654 raft_consensus.cc:3055] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:35.285926 32527 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.343024 32619 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:35.352207 32592 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.329267 32654 raft_consensus.cc:740] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:35.354811 32654 consensus_queue.cc:260] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.356061 32654 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:35.313169 32610 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:12:35.359313 32359 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.360582 32544 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.361328 32592 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.361577 32359 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.362252 32559 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.362835 32651 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:35.363360 32651 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.363806 32561 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.365514 32651 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.368198 27150 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:35.374958 27232 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:35.359841 32610 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:35.375655 27156 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:35.376312 27149 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:35.377482 27157 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:12:35.377609 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.380596 27157 pending_rounds.cc:85] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 7
I20260709 13:12:35.380923 27157 pending_rounds.cc:107] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:12:35.380971 27306 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.381350 27157 raft_consensus.cc:2889] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.380127 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.383206 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.383791 27298 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.386003 32586 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.359308 32397 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.387245 32397 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.387794 27228 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:35.388411 32434 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.388943 32434 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.389343 32603 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:35.379568 32610 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:35.392068 32610 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.393260 32610 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:35.393468 27228 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:35.394935 32434 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.374537 32652 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.395258 32653 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:35.395920 32652 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.365890 32561 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.397511 32653 consensus_queue.cc:1059] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:35.398765 32653 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:35.399124 32653 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:35.400751 27840 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:35.401458 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.402105 27837 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:35.402228 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.403971 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.404557 27228 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:35.406705 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.408507 27155 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:35.400115 32653 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.425239 27151 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:35.419564 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.402835 27835 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:35.420472 32412 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:35.427644 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.422163 32652 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.422596 27148 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:35.424041 27272 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:35.428467 27303 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:12:35.430536 27150 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:35.389286 32397 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.432996 27298 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:35.400029 32391 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.443385 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.380162 32265 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.444573 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.442831 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:35.455116 27148 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:35.448432 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:35.451942 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:35.460269 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 140402us
I20260709 13:12:35.441571 32644 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.461011 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:35.481441 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:35.432032 32394 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:12:35.483032 27804 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:35.488667 32231 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:35.494714 32231 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:35.494827 32649 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:35.495121 32231 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.495363 32649 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.495801 32649 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:35.446914 32598 ts_tablet_manager.cc:1929] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:12:35.499460 32598 log.cc:1199] T d87c41315a07486aa13067ad7c47c34a P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/d87c41315a07486aa13067ad7c47c34a
I20260709 13:12:35.460532 32527 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.480654 32603 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:35.508277 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.508864 27835 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:35.486889 32318 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.518519 27232 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:35.520263 27835 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:35.482569 32561 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:35.458976 32265 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.489193 32156 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.532254 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.533351 27840 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.501083 32654 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:35.536602 32391 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.536784 32653 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:35.537916 27841 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:35.506871 32603 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.544574 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.547646 32603 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.555591 27148 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:35.502332 32644 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.559954 32412 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:35.540481 32561 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:35.564438 32561 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.556725 32654 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:35.566859 32654 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.568262 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.568885 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.591820 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.551103 32600 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.597071 32644 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.602636 32619 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:35.603227 32619 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:35.604171 32619 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.604177 32584 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.610493 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.540586 32156 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.605795 27103 auto_rebalancer.cc:629] Failed to schedule move for tablet 54a3803047aa4a85bd0d761bdb45cead: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:35.614727 32592 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:35.622611 32265 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.622402 32592 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.610574 32598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46398 (request call id 84) took 1597 ms. Trace:
I20260709 13:12:35.623113 32585 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.623353 32598 rpcz_store.cc:276] 0709 13:12:34.009427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.022328 (+ 12901us) service_pool.cc:224] Handling call
0709 13:12:34.112387 (+ 90059us) ts_tablet_manager.cc:1151] Deleting tablet d87c41315a07486aa13067ad7c47c34a
0709 13:12:34.113380 (+   993us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:12:35.154117 (+1040737us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:35.432773 (+278656us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:35.593020 (+160247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76023,"tablet-delete.queue_time_us":88609,"thread_start_us":81355,"threads_started":1}
I20260709 13:12:35.624607 32592 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.626498 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.628829 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet d87c41315a07486aa13067ad7c47c34a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:12:35.633086 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.633765 27154 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:35.634231 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.634672 32434 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.634953 27299 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:35.635233 32434 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.636420 32595 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:35.637323 32434 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.638312 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:35.638796 32299 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.639317 32299 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.640669 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:35.640676 32470 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:35.641309 32299 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.641845 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1469) took 1029 ms. Trace:
I20260709 13:12:35.641988 32651 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:35.642266 32470 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:35.597718 32397 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.639519 27807 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:35.597836 32610 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:35.654560 27833 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:35.653697 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.655622 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.628527 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.657111 27156 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.658540 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.658636 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.659344 27298 raft_consensus.cc:2393] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:35.658636 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.659722 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.642270 27839 rpcz_store.cc:276] 0709 13:12:34.612902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.613118 (+   216us) service_pool.cc:224] Handling call
0709 13:12:34.613374 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:34.748780 (+135406us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:35.034981 (+286201us) log.cc:844] Serialized 14 byte log entry
0709 13:12:35.141032 (+106051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:35.141090 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:35.141141 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:35.640171 (+499030us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b180036e440. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419
0709 13:12:35.641658 (+  1487us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54004bc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:35.641700 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:35.641796 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63741,"prepare.queue_time_us":126965,"prepare.run_cpu_time_us":197,"prepare.run_wall_time_us":196,"raft.queue_time_us":18297,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":317698560,"thread_start_us":310851,"threads_started":2,"wal-append.queue_time_us":152181}
I20260709 13:12:35.662591 27832 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 7.
I20260709 13:12:35.663276 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.664319 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.666122 27300 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:35.620388 32594 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:35.671558 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.605852 32584 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.675825 27835 raft_consensus.cc:3060] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.683418 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.670497 32594 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.666392 32610 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.691068 32594 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:35.663625 32592 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.672868 27155 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:35.677455 27156 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:35.695484 27156 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:35.689476 27306 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:35.641821 32299 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.662185 32434 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:35.727835 32434 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.728257 32434 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.691113 27834 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:35.662118 32318 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:35.692556 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.676287 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.732153 32156 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.722314 32592 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.734579 32661 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:35.736220 32592 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:35.737419 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.740415 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.741097 27298 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:35.742579 32462 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.742805 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.743089 32462 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.744799 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.745414 27306 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
W20260709 13:12:35.677057 32658 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:12:35.697527 32664 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:12:35.748574 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.749447 27834 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:35.745527 32462 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.751291 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:35.752379 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:35.680269 27041 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6 failed: Not found: failed to reset TS proxy: No leader found: Tablet d87c41315a07486aa13067ad7c47c34a consensus state has no leader
W20260709 13:12:35.700268 32660 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.192s	user 0.000s	sys 0.003s
I20260709 13:12:35.767758 32156 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:35.768181 32156 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.768571 32156 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:35.674870 32248 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:12:35.702510 32637 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:35.663383 32600 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:35.770344 32600 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.667685 32231 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.670921 32530 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:35.674263 32656 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.724977 32587 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.784022 32587 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.784926 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.778035 32592 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.786104 32587 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.786453 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.726352 32603 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.726718 27148 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:35.786602 32592 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:35.787199 27230 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:35.743413 27839 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:35.753052 32462 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:35.753597 27840 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:35.762320 32468 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:35.788352 32603 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.788601 32656 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.789284 32592 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.790874 32656 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.791535 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.791834 32462 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:35.792580 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.793432 27232 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:12:35.792972 32462 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.795676 27305 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:35.795827 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.798482 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.799571 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.800640 32231 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:35.800848 32659 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:12:35.801697 27227 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:35.802165 32626 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:35.803097 27155 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:12:35.803431 27155 pending_rounds.cc:85] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 6
I20260709 13:12:35.803618 27155 pending_rounds.cc:107] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:12:35.803829 27155 raft_consensus.cc:2889] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.764564 32584 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:35.765179 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.806419 27834 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:35.766139 32610 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:35.678804 32652 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:12:35.771937 27157 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 6.
I20260709 13:12:35.806442 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.810519 27300 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:35.811342 32600 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.666218 32397 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:35.811914 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 70536.7us
I20260709 13:12:35.813261 32397 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.773635 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.814343 27228 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:35.692965 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.816445 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.811748 27303 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:35.777211 27835 raft_consensus.cc:2468] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
W20260709 13:12:35.778436 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75279.1us
I20260709 13:12:35.778496 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.825201 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.825901 27840 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:35.826874 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.786166 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.827517 27839 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.829118 27834 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:35.831382 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:35.817889 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.835594 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.834211 32265 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:35.838629 32265 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.838989 32265 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:35.772733 32649 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.833122 32156 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.843155 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:35.843708 27157 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:35.844048 32649 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.844147 32156 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:35.847606 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.848191 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.848898 27840 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 7: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:35.848198 27156 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:35.850970 27836 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.852253 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:35.856640 27839 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:35.859432 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:35.860162 27303 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:35.862798 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.863353 27303 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:35.847151 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:35.864260 27150 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:35.870599 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.871155 27839 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:35.869699 27303 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:35.857533 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.880021 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:35.882495 27841 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:35.886214 27148 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:35.871821 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:35.914472 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 59994.6us
I20260709 13:12:35.907908 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:35.921360 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 63896.7us
I20260709 13:12:35.922132 27195 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:35.925978 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 54249.2us
I20260709 13:12:35.829077 32318 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.916230 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.930450 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:35.927165 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.930874 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.854754 32600 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:35.835683 32637 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.936328 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:35.934751 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:35.936357 27195 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:35.940843 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:35.942210 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:35.942996 27833 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:35.948614 27836 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:35.929962 32156 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:35.929745 32468 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:35.955355 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.963442 27839 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:35.989076 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.993106 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:35.944821 32649 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:35.935752 32600 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.995905 27227 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:35.935866 32248 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:35.935708 32644 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.947103 32556 raft_consensus.cc:2804] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:35.947777 32394 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:35.939981 32637 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.944064 32592 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:35.952574 32603 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:35.941730 32318 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:35.950681 32359 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:12:35.950642 32642 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:12:36.055609 27157 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:35.996871 32397 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:35.956432 32560 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:36.004220 32600 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:35.954264 32412 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
W20260709 13:12:36.057034 32629 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:36.022253 32231 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:35.953760 32527 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
W20260709 13:12:36.077519 27837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.016s
I20260709 13:12:36.022816 32394 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.005129 31906 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.054517 32556 raft_consensus.cc:697] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:36.075829 32397 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.006913 32649 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:36.088145 27837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.016s
I20260709 13:12:36.061782 32637 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.064472 32359 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:36.000880 32530 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:12:36.023094 32644 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.005281 32434 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.089339 32394 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:36.090687 32654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.025s
I20260709 13:12:36.095705 32397 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.106973 32561 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:36.164875 27298 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:36.151103 32654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.013s	sys 0.025s
I20260709 13:12:36.095825 31906 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.170822 32556 consensus_queue.cc:237] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.186735 32644 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:36.188325 32670 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:12:36.191083 27833 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:36.202509 32649 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.123175 32594 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.220353 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:36.247428 32610 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:36.492241 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.045s
W20260709 13:12:36.493448 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.017s	sys 0.045s
W20260709 13:12:36.494103 27224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.019s
W20260709 13:12:36.494378 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 552380us
W20260709 13:12:36.494549 27224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.019s
I20260709 13:12:36.500065 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:36.500912 27841 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:36.368381 32156 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:36.489229 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67907.4us
I20260709 13:12:36.432866 32412 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.515590 27840 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:36.529855 27123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.004s
W20260709 13:12:36.530201 27123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.004s
I20260709 13:12:36.509322 27271 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:36.509754 32585 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.487505 32644 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.532720 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:36.533610 27195 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.023s	sys 0.022s
W20260709 13:12:36.536074 27195 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.023s	sys 0.022s
W20260709 13:12:36.563491 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.013s	sys 0.035s
I20260709 13:12:36.564785 27156 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:12:36.536369 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 591057us
W20260709 13:12:36.569172 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.035s
I20260709 13:12:36.569506 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:36.575135 27835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.003s	sys 0.022s
W20260709 13:12:36.576395 27835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.003s	sys 0.022s
W20260709 13:12:36.576300 27270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.062s
W20260709 13:12:36.578472 27270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.024s	sys 0.062s
I20260709 13:12:36.531883 32592 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:36.536612 32590 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:36.528337 32603 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:36.586880 32594 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:36.506093 32610 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.592427 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 665290us
I20260709 13:12:36.526957 32412 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.567422 32644 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.565263 32585 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.586365 32359 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:36.571935 32470 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:36.596474 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:36.639669 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:36.654942 27155 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:36.590912 32468 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
I20260709 13:12:36.661957 27836 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:12:36.668845 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:36.704327 27836 pending_rounds.cc:85] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 13
I20260709 13:12:36.705672 27836 pending_rounds.cc:107] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:12:36.645305 32590 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:36.711001 27836 raft_consensus.cc:2889] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:36.630635 32675 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:12:36.626714 32682 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:36.658463 32359 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.660167 32391 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:36.643725 32231 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:36.640749 32527 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:36.713140 27302 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:36.707705 32468 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:36.629964 32678 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 13:12:36.641299 32667 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.420s	user 0.001s	sys 0.009s
W20260709 13:12:36.619284 32683 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:12:36.618692 32673 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:12:36.623842 32689 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.736642 32231 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:36.658732 32470 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.631641 32397 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.741902 27155 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
W20260709 13:12:36.742110 32299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.014s	sys 0.057s
I20260709 13:12:36.589248 32156 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.656816 32394 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.736956 32600 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
I20260709 13:12:36.724798 32359 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:36.714377 32688 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:36.703336 32462 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:36.626950 32434 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:36.774104 27231 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:36.726806 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:36.780055 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:36.739477 32693 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.720166 32654 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:12:36.786674 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e37f81c47354aae99c01542f682acef"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:36.806668 27302 raft_consensus.cc:606] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:36.807111 27302 raft_consensus.cc:614] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:36.787961 32610 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:36.809270 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1957) took 1292 ms. Trace:
I20260709 13:12:36.780048 32468 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:36.779068 32603 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.782756 32299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.057s
I20260709 13:12:36.809789 27837 rpcz_store.cc:276] 0709 13:12:35.517164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.517879 (+   715us) service_pool.cc:224] Handling call
0709 13:12:35.518253 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.518574 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.518604 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.519047 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.096493 (+577446us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:36.096546 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.096635 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.809064 (+712429us) raft_consensus.cc:1685] finished
0709 13:12:36.809082 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.809214 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1388,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5219,"thread_start_us":577044,"threads_started":1,"wal-append.queue_time_us":727759}
I20260709 13:12:36.779269 32689 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.764686 32695 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.790078 32585 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:36.756466 32527 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.760061 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:36.778712 32470 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:36.770886 32592 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.812379 32686 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:36.802433 32600 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.812323 32265 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.973s	user 0.009s	sys 0.003s
I20260709 13:12:36.822124 27103 placement_policy_util.cc:248] tablet d87c41315a07486aa13067ad7c47c34a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:12:36.863330 32447 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:36.867799 32397 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:36.868269 32699 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:12:36.869354 32644 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:36.815812 32468 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.813921 32693 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:36.874207 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 118754us
I20260709 13:12:36.875450 32394 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.803503 32590 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.877067 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:36.877720 32637 consensus_meta.cc:287] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.001s
I20260709 13:12:36.878806 32470 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.932706 27103 placement_policy_util.cc:248] tablet 9e466225c5a147b9b31f11fea1bcf893: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:12:36.867139 32701 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:36.850898 32692 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:36.865214 32556 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.864678 32585 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.808035 32688 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.886255 32299 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.952258 27150 raft_consensus.cc:1217] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-14.11]   Dedup: 11.9->[12.10-14.11]
I20260709 13:12:36.975883 27150 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: [11.9-14.11]
I20260709 13:12:36.958972 27837 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:36.935524 32447 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:36.947780 32462 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.937297 32412 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.862785 32695 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.936446 32265 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:36.979316 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:36.956081 32703 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:36.963270 32654 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:36.969616 32692 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:36.984563 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 204570us
I20260709 13:12:36.977335 32585 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.998857 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.001051 32585 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:36.987294 32470 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.975116 32556 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.990317 32695 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.993067 32688 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.996806 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 1967) took 1167 ms. Trace:
I20260709 13:12:36.998322 32447 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.003688 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:37.004586 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 277883us
I20260709 13:12:36.930961 32686 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.014415 32447 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.015364 32693 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.016044 32686 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.008626 27835 rpcz_store.cc:276] 0709 13:12:35.829483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.830180 (+   697us) service_pool.cc:224] Handling call
0709 13:12:35.853001 (+ 22821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.879349 (+ 26348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.879381 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.879856 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.577072 (+697216us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:36.577112 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.577184 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:36.996606 (+419422us) raft_consensus.cc:1685] finished
0709 13:12:36.996626 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:36.996750 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1284,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":44599,"thread_start_us":622399,"threads_started":1,"wal-append.queue_time_us":841941}
I20260709 13:12:37.009939 27302 raft_consensus.cc:606] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.019855 32359 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.022504 32527 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.023293 32703 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:37.024464 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1111) took 1386 ms. Trace:
I20260709 13:12:37.024294 32703 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.010897 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:36.988059 32299 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.027876 32299 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.028961 32584 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:37.029631 32687 log.cc:927] Time spent T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:12:37.030126 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:36.968055 32637 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:36.949785 32391 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:37.041893 32584 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.042347 32391 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.043872 32468 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.043766 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.024816 27838 rpcz_store.cc:276] 0709 13:12:35.637998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.638193 (+   195us) service_pool.cc:224] Handling call
0709 13:12:35.638526 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:35.763467 (+124941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.763501 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:35.764037 (+   536us) log.cc:844] Serialized 52 byte log entry
0709 13:12:36.006725 (+242688us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:36.006774 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.024052 (+1017278us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54006c02d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:37.024105 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.024168 (+    63us) raft_consensus.cc:1685] finished
0709 13:12:37.024182 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.024406 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1767,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":286450560,"thread_start_us":242338,"threads_started":1,"wal-append.queue_time_us":411467}
I20260709 13:12:37.046190 32584 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:37.051021 32677 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260709 13:12:37.051321 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.045703 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:37.050956 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:37.053798 32584 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.054208 32584 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.061129 32692 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:37.062327 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1174) took 1289 ms. Trace:
I20260709 13:12:37.062876 32637 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.062700 27224 rpcz_store.cc:276] 0709 13:12:35.772725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.772891 (+   166us) service_pool.cc:224] Handling call
0709 13:12:35.784554 (+ 11663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.833758 (+ 49204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.833787 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.863667 (+ 29880us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.495098 (+631431us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:36.495137 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.882704 (+387567us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b540037a854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:36.882754 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.029077 (+146323us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:37.062124 (+ 33047us) raft_consensus.cc:1685] finished
0709 13:12:37.062146 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.062272 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14629,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":82564736,"thread_start_us":543915,"threads_started":1,"wal-append.queue_time_us":846858}
I20260709 13:12:37.064649 32556 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:36.997915 32654 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.067480 32654 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.068481 32600 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.069257 32265 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.070154 31906 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.070389 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:36.997326 32462 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.086524 27837 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:37.088238 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.089337 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.089915 27835 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
W20260709 13:12:37.090715 32680 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.502s	user 0.003s	sys 0.000s
I20260709 13:12:37.093381 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3406) took 1448 ms. Trace:
I20260709 13:12:37.093758 27154 rpcz_store.cc:276] 0709 13:12:35.645341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.646107 (+   766us) service_pool.cc:224] Handling call
0709 13:12:35.646396 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.789879 (+143483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:35.789907 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:35.790339 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.096873 (+306534us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:36.096919 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.027770 (+930851us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400069fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:37.027819 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.090129 (+ 62310us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:37.093159 (+  3030us) raft_consensus.cc:1685] finished
0709 13:12:37.093181 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.093322 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":433,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":474336384,"thread_start_us":306168,"threads_started":1,"wal-append.queue_time_us":736264}
I20260709 13:12:37.098178 32265 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.098722 32265 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:37.100914 32265 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:37.021972 32359 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.054620 32584 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.056195 32701 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.118882 27271 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.085733 32654 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:37.102762 32318 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.127851 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.117802 32359 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.117728 32265 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.140146 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.140857 27156 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:37.138710 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.143136 27155 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.134728 27154 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:37.135413 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.144486 27150 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.136509 27148 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:37.146284 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.141846 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.148564 27156 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.125885 32591 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.150031 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.129336 32637 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.130569 32394 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:37.131815 32434 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:37.157801 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.118507 32701 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.124234 32654 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.142249 32530 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.138687 32468 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.139508 32600 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.154426 32397 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:37.188004 32394 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:37.167472 32434 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.153843 32719 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.177354 27156 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:37.178772 32720 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.158002 32559 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.179617 32705 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:37.159932 32688 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:37.190231 32703 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.212368 32391 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.189322 32600 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.212275 32703 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.213079 32391 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.214522 32600 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.167290 32561 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.215181 32561 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.157085 32265 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.216248 32720 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:37.216818 32689 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.217295 32561 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.217041 32559 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.151098 32359 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.215847 32703 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:37.217602 32265 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.216691 32720 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:37.218552 32685 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.568s	user 0.004s	sys 0.000s
I20260709 13:12:37.219410 32359 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.220456 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3509) took 1390 ms. Trace:
I20260709 13:12:37.221824 32719 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.222362 32559 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:37.223317 32674 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.712s	user 0.001s	sys 0.003s
I20260709 13:12:37.224023 32719 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.226159 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3411) took 1479 ms. Trace:
I20260709 13:12:37.215710 32391 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.226503 27149 rpcz_store.cc:276] 0709 13:12:35.747059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.749029 (+  1970us) service_pool.cc:224] Handling call
0709 13:12:35.749359 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.749715 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:35.749997 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.106966 (+356969us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.122373 (+ 15407us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.126184 (+  3811us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:36.126245 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.126338 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.222643 (+1096305us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:37.225843 (+  3200us) raft_consensus.cc:1685] finished
0709 13:12:37.225959 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.226101 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":872,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":115142,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":46346,"spinlock_wait_cycles":3233664,"thread_start_us":356595,"threads_started":1,"wal-append.queue_time_us":618491}
I20260709 13:12:37.229321 32231 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.220850 27228 rpcz_store.cc:276] 0709 13:12:35.830170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.830304 (+   134us) service_pool.cc:224] Handling call
0709 13:12:35.830570 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:35.846309 (+ 15739us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:35.854016 (+  7707us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.267401 (+413385us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.267664 (+   263us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:36.279622 (+ 11958us) log.cc:844] Serialized 26 byte log entry
0709 13:12:36.279770 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:36.279811 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:36.279893 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.217992 (+938099us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:37.220244 (+  2252us) raft_consensus.cc:1685] finished
0709 13:12:37.220267 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.220398 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4659,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":9767,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":10707,"spinlock_wait_cycles":5589888,"thread_start_us":281356,"threads_started":1,"wal-append.queue_time_us":652035}
I20260709 13:12:37.231503 32610 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.232160 32231 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.231985 32610 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.232347 32470 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.156700 32591 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.232864 32470 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.234283 32591 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.162447 32637 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.185351 32530 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.235010 32610 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:37.236604 32637 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.238567 32462 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.239558 32530 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.192740 32434 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.239912 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3516) took 1283 ms. Trace:
I20260709 13:12:37.197237 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.172060 27155 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
W20260709 13:12:37.244305 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 50497us
I20260709 13:12:37.252480 27833 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:37.159780 32695 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:37.255569 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:37.258319 27303 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.259135 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3514) took 1309 ms. Trace:
I20260709 13:12:37.247015 27231 rpcz_store.cc:276] 0709 13:12:35.956364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.957199 (+   835us) service_pool.cc:224] Handling call
0709 13:12:36.002551 (+ 45352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.805333 (+802782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.239678 (+434345us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001266d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:37.239856 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773575936}
W20260709 13:12:37.256469 32726 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:12:37.256342 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:37.272094 27305 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:37.244840 32724 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:37.279071 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.262842 27838 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:37.281342 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:37.282186 27833 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.266584 27303 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:37.259603 27226 rpcz_store.cc:276] 0709 13:12:35.949550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:35.949678 (+   128us) service_pool.cc:224] Handling call
0709 13:12:37.258884 (+1309206us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001257d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:37.259063 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2681531776}
I20260709 13:12:37.272855 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.190400 32394 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.287910 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:37.273157 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 76030.5us
I20260709 13:12:37.262087 32265 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.274797 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.299819 27298 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:37.299881 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.288460 27299 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:37.300804 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.275620 32654 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:37.305799 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 134836us
I20260709 13:12:37.307752 27833 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:37.276803 32603 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:37.309119 27302 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:37.322578 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.310487 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.323625 27838 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:37.261487 32689 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.315528 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.324759 27297 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
W20260709 13:12:37.325557 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 169543us
I20260709 13:12:37.314555 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.326385 27156 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:37.189595 32468 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.318787 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.319336 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.313143 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.310228 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.191267 32397 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.288863 32695 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:12:37.318878 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.336436 27148 raft_consensus.cc:2393] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:37.325778 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.310133 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.327325 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.328418 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.328608 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.339521 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.327648 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.299203 32462 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.356909 32462 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.357326 32468 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.359057 32462 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.359773 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.360453 27223 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:37.360890 32719 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:37.361444 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.363445 32710 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.364034 32710 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.365300 32584 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.360189 32434 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.368688 32434 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.329509 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:37.368971 32720 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.369592 27298 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:37.257084 32509 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:37.329985 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:37.371340 27297 raft_consensus.cc:606] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.371683 27297 raft_consensus.cc:614] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:37.331408 27154 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.372852 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:37.373380 27838 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.374295 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.330865 27149 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 8: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:37.375739 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.376806 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.377436 27229 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:37.330458 27122 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:37.298918 32686 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:37.378382 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 48592.7us
I20260709 13:12:37.378463 32686 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.379079 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.379200 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:37.379652 27232 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:37.380467 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.332964 27195 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.381016 27232 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:37.381174 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48332.4us
I20260709 13:12:37.381863 27195 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.382236 32695 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:37.382387 32708 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.382825 32695 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:37.382920 32708 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.383708 32695 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.308590 32447 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.385026 32708 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.385604 32708 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:37.339479 27224 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.386693 32591 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:37.387236 32591 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:37.388098 32591 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.389549 32530 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:37.389945 32530 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:37.392915 32530 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.394357 32530 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:37.394295 32691 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:37.394794 32397 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.313138 32701 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.385452 32447 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.318418 32561 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.339000 27228 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:37.348371 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.337795 27300 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:37.418874 27227 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:37.349423 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.312276 32265 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.352223 27153 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:37.354359 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.324645 32689 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:37.428208 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 75182.5us
I20260709 13:12:37.355252 27226 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:37.374212 31906 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:37.396976 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.331727 27155 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:37.343003 27303 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:37.385993 32708 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.398684 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:37.450641 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 52031.3us
W20260709 13:12:37.399287 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.400939 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 57661.6us
I20260709 13:12:37.419144 32509 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.452742 32509 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.453485 32156 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:37.453783 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.454167 32156 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:37.454442 27153 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:37.454748 32156 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.455396 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:37.456887 32156 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.456820 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.457377 32689 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.328691 32637 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:12:37.418835 32600 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.458930 32600 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.381800 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.459300 32600 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.459561 27232 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:37.460391 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.460511 27303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:37.461113 27303 raft_consensus.cc:606] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:37.461454 27303 raft_consensus.cc:614] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:37.461406 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.402246 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.403327 27224 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:37.462132 31906 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.463142 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.463231 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.463835 27229 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:37.463977 27224 raft_consensus.cc:2410] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:12:37.464178 31906 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.425848 32559 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:12:37.465183 27224 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:37.465636 27226 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:37.465667 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.457971 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.468350 27224 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:37.381978 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.412868 27154 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:37.417456 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.469578 27148 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:37.467463 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:37.417670 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 90108.5us
I20260709 13:12:37.333380 32688 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:37.479487 32688 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.429337 27149 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:37.482321 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:37.483044 27837 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:37.483121 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.429028 32561 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.436159 32265 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.380681 32686 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.436527 32391 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:37.439090 32720 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:37.440284 27150 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:37.440631 32619 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.440762 32710 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.441020 27838 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:37.442165 32470 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:37.442495 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.378327 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.502626 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.448789 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.503307 27156 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:37.464651 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.403609 27305 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:37.467054 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.504321 27229 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:12:37.475041 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 93125.5us
I20260709 13:12:37.475127 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.504882 27301 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:37.505532 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.476454 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.483906 27149 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:37.433934 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:37.486847 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.487347 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.471287 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.488041 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:37.489768 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.490180 27302 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:37.491966 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.498267 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.445060 32590 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:37.516583 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 67879.1us
I20260709 13:12:37.517400 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.500415 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:37.518342 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.474916 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.504878 31906 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.506536 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.506835 27154 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:37.447185 32651 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:37.469901 32708 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:37.522405 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 55013.4us
I20260709 13:12:37.519345 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.527753 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.528412 31906 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:37.525609 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:37.454792 32509 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.535410 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:37.489274 32391 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:37.486479 32462 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.539891 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:37.560837 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.563730 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:37.599396 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73872.1us
I20260709 13:12:37.600099 27149 raft_consensus.cc:1240] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:12:37.601854 27834 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:37.609525 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 90255.5us
W20260709 13:12:37.617548 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 89862.4us
I20260709 13:12:37.523991 32689 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:12:37.637650 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 95232.2us
I20260709 13:12:37.618602 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:37.625016 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.628170 27833 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:37.539465 32594 raft_consensus.cc:2764] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:37.535578 32711 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:37.564180 32592 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.535401 32561 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.540494 32717 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:37.596799 32391 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:37.646608 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.647188 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.643218 27195 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:37.653977 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 147447us
I20260709 13:12:37.656769 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.520749 32619 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.624990 32652 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:37.657624 27838 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:37.534549 32156 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:12:37.523650 32265 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:12:37.678586 27195 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.561502 32559 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:12:37.622663 32610 raft_consensus.cc:2764] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:12:37.636864 32689 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.563817 32651 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:37.647150 32509 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:37.652794 32592 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.677772 27833 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:37.680335 27838 raft_consensus.cc:1275] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:37.680568 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.647962 32711 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.682650 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.534799 32590 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.923496 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:37.862475 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 95015us
I20260709 13:12:37.652334 32717 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:37.864421 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 176421us
I20260709 13:12:37.873025 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.648734 32705 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:12:37.909122 32231 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.720798 32716 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:37.719220 32697 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:37.721287 32636 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.662918 32691 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.876480 27227 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:37.919173 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:37.646286 32585 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:12:37.865029 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:38.051273 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 375607us
I20260709 13:12:37.910115 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:37.908735 32730 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:37.876168 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.719041 32359 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:37.941051 27840 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:37.940932 27804 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:37.941937 27834 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
I20260709 13:12:37.870527 32695 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:37.952034 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 412240us
I20260709 13:12:37.948804 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.970546 32731 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.971560 32600 consensus_meta.cc:287] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
I20260709 13:12:37.977814 27835 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:37.974200 27837 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:37.980120 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:37.939865 32710 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.082902 32695 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:37.986624 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:37.931419 32584 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:38.082988 32600 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:38.083756 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 97215.3us
I20260709 13:12:38.083129 32710 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.084918 32561 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.946038 32447 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.085428 32561 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.085938 32447 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:38.086143 32710 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.086494 32447 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.087023 32710 consensus_queue.cc:1059] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:38.087456 32561 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.954172 32689 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.088505 32447 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.089093 32688 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:38.089449 32688 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:38.089816 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:37.992179 32740 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:12:38.090236 32688 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.091383 32688 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.092489 32731 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.093600 27225 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:37.995779 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.094375 27229 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:38.094666 32731 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:37.986442 32717 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.994913 32509 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:38.096053 32509 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:37.992655 32594 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.025059 32697 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.098384 32697 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.098317 32594 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.100634 32594 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.043668 32651 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:38.102025 32695 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.075363 32716 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:38.076126 32359 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.103964 32359 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.047184 32590 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:38.048211 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.031963 32636 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.107539 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.108193 32636 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:38.108840 27841 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:38.110386 32708 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:37.972680 32747 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:38.072860 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 132052us
I20260709 13:12:38.112080 27804 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.112450 32708 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:38.113128 27152 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:38.113246 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.051365 32748 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:38.075737 27230 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.997916 32231 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.076948 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.077838 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.121498 27226 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:38.083806 32631 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:37.977167 32592 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:37.977443 32711 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.118738 27225 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:38.132141 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:38.124622 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47763.3us
I20260709 13:12:38.135562 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.136109 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.114288 32748 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.136638 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.139839 27156 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:38.139839 27151 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:38.125586 32631 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:38.142544 32636 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:38.142916 32636 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.143378 32636 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.142971 32631 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.144279 32631 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.146095 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:38.142016 32764 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:38.119578 32530 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.725s	user 0.002s	sys 0.015s
I20260709 13:12:38.204043 27230 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:38.232549 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:38.233161 27230 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:38.204896 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 68336.1us
I20260709 13:12:38.205610 27153 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:38.127935 32747 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.204636 32559 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.210733 32761 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.277516 32761 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:38.278414 32761 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:38.279974 32751 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.366s	user 0.003s	sys 0.000s
I20260709 13:12:38.279719 32359 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.267472 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:38.119302 32691 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:12:38.213460 32636 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:38.215114 32391 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:12:38.110685 32689 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.129128 32708 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:38.219455 32231 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.205224 32265 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:38.223781 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.231741 32748 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.225401 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.132903 27227 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:38.228550 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:38.229331 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:38.234400 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 96313.9us
I20260709 13:12:38.235504 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.302188 27156 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:38.262100 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.258564 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.303578 27839 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
W20260709 13:12:38.259192 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 173757us
I20260709 13:12:38.258812 27231 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:38.268703 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.304015 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.274749 27230 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:38.276626 32749 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:12:38.230672 32585 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.221320 32705 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:38.233269 32764 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.292063 32610 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.291846 32318 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:38.304839 27839 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:38.305749 27834 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:38.294013 32716 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:38.306710 27839 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:38.310293 32764 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.311805 27840 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:38.313076 32764 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.309299 32585 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.314000 27839 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:38.316048 32585 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.316874 32610 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.319665 32610 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.323587 27151 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:38.323587 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:38.325702 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 90306us
I20260709 13:12:38.329255 27148 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:38.330463 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.331509 27837 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:38.076804 32730 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.273247 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.333838 27148 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:38.335134 27149 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:38.336393 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:38.341137 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.341825 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.301527 32391 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.345018 32636 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.346158 32391 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:38.347302 32747 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.351504 32689 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:38.354368 32737 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:12:38.259518 32697 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.360172 32697 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:38.363358 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.366189 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.367560 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.371925 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.295794 32559 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.322651 32265 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:38.342106 32749 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:38.379524 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.369071 32359 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:38.387672 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:38.388688 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.389408 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:38.357735 32592 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.389302 27832 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:38.393955 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:38.394847 27154 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:38.397002 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:38.389302 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.401127 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.375113 32708 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:38.377140 32265 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.406780 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.379215   302 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:38.428362 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:38.428759 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:38.434381 27157 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.430878 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.440559 32559 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:38.444383 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:38.402504 32527 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:38.448951 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.451579 27157 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
W20260709 13:12:38.452678 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 834096us
I20260709 13:12:38.436740 32584 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:38.386509 32705 consensus_queue.cc:1048] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:12:38.414831 32708 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:38.430723   302 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.436529 32716 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:38.464190 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81307.9us
W20260709 13:12:38.465627 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.467236 27804 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.391716 32686 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 13:12:38.472374 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 90555.3us
I20260709 13:12:38.473188 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.474093 27154 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:38.474895 27300 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:38.474993 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:38.475617 27832 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.475914 32559 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:38.473914 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.477820 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.443619 32359 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:12:38.447136 32689 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.468863 32470 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.469628 32708 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:38.518206 27300 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:38.469628   302 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:38.534188 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:38.535017 27224 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.474077 32600 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.470232 32652 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:38.467890 32584 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.516005 32610 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:38.478493 32764 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:38.469952 32716 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.640427 27832 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:38.555230 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.624681 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:38.649389 27227 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:38.516291 32686 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:38.517863   301 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.476447 32559 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:38.536553   307 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:12:38.533694 32585 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:38.552989 32470 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:38.736310 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 103256us
I20260709 13:12:38.737485 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:38.708706 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 169846us
W20260709 13:12:38.659214 27123 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.660s (SENT) [suppressed 15 similar messages]
I20260709 13:12:38.719826 32767 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.500515 32731 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:12:38.733675 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:38.624773 32584 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:38.478725 32717 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.631461 32610 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.747504 27224 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:38.710194 32716 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.761170 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:38.718956 32686 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:38.737097 32559 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:38.727562 32636 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.787189 27226 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:38.745126 32727 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:38.633562 32728 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:12:38.792404 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.807466 32692 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.768489 32585 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:38.774534 32610 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:38.809456 32697 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:12:38.768339 32394 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:12:38.859822 32631 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.000s
W20260709 13:12:38.831187   305 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:12:38.832383 32717 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.800979 32652 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.774837 32391 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.799269 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:38.853602 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:38.786088 32653 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:38.856123 32470 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:38.859957   304 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 13:12:38.830202   310 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:12:38.791215 32730 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:38.860894   306 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:12:38.788036 32592 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.738178   301 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:38.836587 32636 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.890195 32585 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.890759 32717 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:38.891132 32756 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:12:38.890087 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:38.909216 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 170508us
I20260709 13:12:38.909612 27301 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:38.903558 27300 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:38.910208 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:38.810618 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:38.919195 27223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.005s	sys 0.004s
W20260709 13:12:38.919556 27223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.005s	sys 0.004s
I20260709 13:12:38.920023 27297 raft_consensus.cc:606] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:38.860937   322 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:12:38.925120 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:38.936437 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 420588us
W20260709 13:12:38.937410   311 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:12:38.938457   314 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:12:38.940178 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42282 (request call id 48) took 1457 ms. Trace:
W20260709 13:12:38.944959 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 134430us
I20260709 13:12:38.945979 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:38.902626 32686 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.948259 32686 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.942469 27297 rpcz_store.cc:276] 0709 13:12:37.483018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.487896 (+  4878us) service_pool.cc:224] Handling call
0709 13:12:38.939995 (+1452099us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001cb1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d31853 00007f9a56cff60a 00007f9a502857d4 00007f9a50285762 00007f9a50285691 00007f9a5028560c 00007f9a502848c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:38.940084 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3248384896}
I20260709 13:12:38.920804 32717 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.952425 32717 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.953100 32717 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:38.894872 32391 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.971750 32391 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.974074   329 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.974599   329 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.948661   301 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.958694 32692 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:38.960323 32636 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.976717   329 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:38.977378 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.953698 32717 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:38.966140 32711 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 13:12:38.966420 27223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1195) took 1321 ms. Trace:
I20260709 13:12:38.978912 32610 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:38.967878 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 57735.7us
I20260709 13:12:38.985909 32559 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.964112   318 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:38.967279 32730 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:38.990552   318 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.990751 32730 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:38.991003   318 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:38.991827   329 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.979539 32711 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.980129   302 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:38.981230 32717 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:38.979513 27223 rpcz_store.cc:276] 0709 13:12:37.645301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.645455 (+   154us) service_pool.cc:224] Handling call
0709 13:12:37.659751 (+ 14296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.660011 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:12:38.257852 (+597841us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.966073 (+708221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:38.966131 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:38.966181 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.966254 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:38.966364 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46080,"prepare.queue_time_us":326918,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":46947,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":991564,"threads_started":2,"wal-append.queue_time_us":697549}
W20260709 13:12:38.981941 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.940232   312 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:12:38.993723 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:38.994256 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.003697 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:39.006276 32644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.032s	sys 0.033s
I20260709 13:12:39.007803 32689 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:39.016983 32642 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:39.017580 32642 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.019536 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:39.019913 32642 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.022473 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:39.023069 27836 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 9.
W20260709 13:12:39.022964 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 363588us
I20260709 13:12:39.023821 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:39.026640 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.030095 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:39.026765 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 80867.7us
I20260709 13:12:39.032997 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:38.991690 32730 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.054855 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.055552 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.056253 27154 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:39.057979 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.002015 32692 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.031062 32265 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.002s
I20260709 13:12:39.060973 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:39.069757 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.026677 32717 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:39.029871 32603 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:39.032101 32394 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:39.073383 27154 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:12:39.078673 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:39.080307 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.083930 27157 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:39.088383 27123 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:39.089259 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:38.981256 32716 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.093195 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.093551 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.108170 27301 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:39.110625 27227 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
W20260709 13:12:39.039740 27041 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet d87c41315a07486aa13067ad7c47c34a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 8
I20260709 13:12:39.020872   329 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.116205 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.080724 32689 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:39.072516   327 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.121376 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:39.130533 27299 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:39.124480 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 131939us
I20260709 13:12:39.135186 27838 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:39.140429 27223 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:39.142334 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.143392 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:39.126456 27041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 88145.6us
I20260709 13:12:39.116746   322 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.085215 32265 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.076016 32692 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.086387 32717 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.167181 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:39.162995 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48668.8us
I20260709 13:12:39.089104 32394 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.163437 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.168360 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.171262 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:39.172899 27303 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:39.178227 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.179937 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.183121 27227 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:39.184638 27150 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:39.186517 32686 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:39.187011 32686 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.187476 32686 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:39.191570 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.193758 27223 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:39.190310 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:39.182821 32748 consensus_meta.cc:287] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.847s	user 0.012s	sys 0.000s
I20260709 13:12:39.144444 32689 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.196075 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:39.193692 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.204906 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:39.210661 27303 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:39.211505 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:39.211977 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 65844us
I20260709 13:12:39.213171 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.192962 32652 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.223491 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.224148 27298 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:39.150223   327 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.226043 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.229264 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.215945   342 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:39.230165 27303 raft_consensus.cc:2410] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:39.232800 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.198954 32637 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:12:39.162998   322 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.239748 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.227190   302 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.208031 32748 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.229008 32619 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.229416 32610 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:39.246616 32717 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:39.250144   321 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:12:39.257668 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:39.258466 27298 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.235093 32711 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.236079   320 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:39.222326 32584 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.260963 27151 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:39.262298   336 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:39.226208 32652 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.270539 32692 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.272305   329 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.270598   340 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:39.254320   328 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.295145 27153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2890) took 1826 ms (client timeout 1537 ms). Trace:
W20260709 13:12:39.295758 27153 rpcz_store.cc:269] 0709 13:12:37.453084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.455185 (+  2101us) service_pool.cc:224] Handling call
0709 13:12:39.279095 (+1823910us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54003a0cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:39.279292 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600493824}
W20260709 13:12:39.297811   338 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:39.298264 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2550) took 1967 ms. Trace:
I20260709 13:12:39.301595 27303 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:39.273377   340 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:39.264338 32394 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.308708 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.309618 27153 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:39.310873 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.267730 32689 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.298723 27306 rpcz_store.cc:276] 0709 13:12:37.314599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.315641 (+  1042us) service_pool.cc:224] Handling call
0709 13:12:37.315942 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:37.390523 (+ 74581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:37.390556 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:37.391078 (+   522us) log.cc:844] Serialized 52 byte log entry
0709 13:12:37.608155 (+217077us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:37.871612 (+263457us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.892958 (+1021346us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.893256 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.281514 (+388258us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54001ca2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:39.281581 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.281729 (+   148us) raft_consensus.cc:1685] finished
0709 13:12:39.281751 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.281964 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623276,"prepare.queue_time_us":622907,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":15030,"raft.queue_time_us":657533,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":12348,"spinlock_wait_cycles":170688896,"thread_start_us":847364,"threads_started":4,"wal-append.queue_time_us":659952}
I20260709 13:12:39.311599 27153 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:39.314994 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.236720   342 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.319669 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:39.322259 27153 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:39.323725 27153 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:39.329536   349 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.329872 32584 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.330148   349 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.331398   322 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.332352   349 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.333033   349 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.333539 32652 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.333721 32748 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.335090   327 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:39.332409 32708 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.001s
I20260709 13:12:39.268018 32716 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.308339 32265 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.333503   349 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.350335 27299 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
W20260709 13:12:39.353667 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 178948us
I20260709 13:12:39.356621 27298 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
W20260709 13:12:39.361466 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 190407us
I20260709 13:12:39.362730 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:39.367570 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.369139 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:39.350219   322 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.410876 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:39.416489 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52482.7us
I20260709 13:12:39.419077 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:39.420185 27835 raft_consensus.cc:2410] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:12:39.343235 32708 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.417924 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:39.425173   319 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.426153 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.406315 32654 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:39.314457   328 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.424108 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:39.433722 27231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2353) took 2100 ms (client timeout 1660 ms). Trace:
W20260709 13:12:39.434185 27231 rpcz_store.cc:269] 0709 13:12:37.333325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.349171 (+ 15846us) service_pool.cc:224] Handling call
0709 13:12:39.433503 (+2084332us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400217d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:39.433648 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919589120}
I20260709 13:12:39.412353   340 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.435437 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.436305 27231 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:12:39.511456 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 72524.4us
W20260709 13:12:39.512444 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 84734.2us
I20260709 13:12:39.430497 32654 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.519583   324 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:12:39.409897   349 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.523336 27840 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:39.422039   322 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.524986 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:39.515447 32705 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:39.554287   326 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:39.554826 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2900) took 1219 ms. Trace:
I20260709 13:12:39.554840 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2879) took 2164 ms. Trace:
I20260709 13:12:39.555272 27151 rpcz_store.cc:276] 0709 13:12:38.335957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.336107 (+   150us) service_pool.cc:224] Handling call
0709 13:12:39.554615 (+1218508us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003e0b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:39.554762 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116583168}
I20260709 13:12:39.555725 27152 rpcz_store.cc:276] 0709 13:12:37.390724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.395844 (+  5120us) service_pool.cc:224] Handling call
0709 13:12:37.396127 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:38.113676 (+717549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.554594 (+1440918us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002e77d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:39.554762 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648526208}
I20260709 13:12:39.556741   326 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.557260   326 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.559716 27152 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:39.527300 32654 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.558925   346 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:39.563076 27149 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.022s
W20260709 13:12:39.570338 27149 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.023s
W20260709 13:12:39.568467 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 473854us
I20260709 13:12:39.582758 27224 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:12:39.583354 27224 pending_rounds.cc:85] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 6
I20260709 13:12:39.583127 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:39.583868 27224 pending_rounds.cc:107] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:12:39.584512 27224 raft_consensus.cc:2889] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:39.586911 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:39.587996 27231 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:39.591202 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:39.593389 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 242428us
I20260709 13:12:39.592839 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:39.592401 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.512027   319 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:39.598678 27157 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 18: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:39.602499 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.608603 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:39.589846   349 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.566247   346 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.581735 32686 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.609813 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:39.663766 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.626029 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:39.744839 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 153747us
I20260709 13:12:39.747222 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:39.743561 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.747898 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:39.745128 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 117031us
I20260709 13:12:39.749410 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:39.749915 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:39.751106 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.752425 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:39.753388 27152 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:39.681613   314 log.cc:927] Time spent T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:12:39.760401 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:39.749300   366 log.cc:927] Time spent T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:39.644413 32462 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:39.774758   364 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:12:39.775436   320 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:39.776305 32559 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:39.780663   318 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.789s	user 0.001s	sys 0.011s
I20260709 13:12:39.700788 32708 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.778779 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:39.788022   320 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:39.748449   342 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.761911 32394 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:39.783037   346 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.748961   349 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:39.791567 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 51838.9us
W20260709 13:12:39.802877   357 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.081s	user 0.003s	sys 0.002s
I20260709 13:12:39.799546   360 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:39.776654   328 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.812310 32584 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:39.815420 27157 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:39.817143 27306 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:12:39.818500 27306 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:12:39.819434   308 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.095s	user 0.010s	sys 0.005s
I20260709 13:12:39.803776   320 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:39.800835   317 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:39.823061 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:39.793395   318 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.824853 27302 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:39.825918   318 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.812670 32394 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.806959   322 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.814036 32686 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.838730 27156 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:39.843076   349 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:39.800340   358 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:39.839689 27299 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:39.837404 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2365) took 1757 ms. Trace:
I20260709 13:12:39.838801   317 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:39.855387 27299 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:39.846450 27228 rpcz_store.cc:276] 0709 13:12:38.080207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.091536 (+ 11329us) service_pool.cc:224] Handling call
0709 13:12:38.091816 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.113635 (+ 21819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.113663 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.114143 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.378929 (+264786us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:38.382539 (+  3610us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.382720 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.382803 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.802905 (+1420102us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:39.821668 (+ 18763us) raft_consensus.cc:1685] finished
0709 13:12:39.837182 (+ 15514us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.837326 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95556,"prepare.queue_time_us":3331,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":22532,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":26367,"spinlock_wait_cycles":27014912,"thread_start_us":264379,"threads_started":1,"wal-append.queue_time_us":364129}
I20260709 13:12:39.834259   326 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.844090   358 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.830029 32394 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:39.852716   317 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:39.856416 32654 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:39.887646 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 127334us
I20260709 13:12:39.841813 32584 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:39.898404 32412 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:39.865422   317 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:39.902388 27156 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:39.899362   320 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:39.899536 32412 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:39.899657   358 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:39.915210 27303 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:39.915803 32697 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:39.920543 32654 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:39.934657   316 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.208s	user 0.001s	sys 0.010s
I20260709 13:12:39.949168 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1229) took 1577 ms. Trace:
I20260709 13:12:39.949678 27148 rpcz_store.cc:276] 0709 13:12:38.371938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.372312 (+   374us) service_pool.cc:224] Handling call
0709 13:12:38.384358 (+ 12046us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:38.384706 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.384740 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:38.413850 (+ 29110us) log.cc:844] Serialized 52 byte log entry
0709 13:12:38.467898 (+ 54048us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:38.467942 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.468003 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.933967 (+1465964us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:39.938321 (+  4354us) raft_consensus.cc:1685] finished
0709 13:12:39.938351 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.949080 (+ 10729us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2245,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":43572,"spinlock_wait_cycles":21074176,"thread_start_us":20695,"threads_started":1,"wal-append.queue_time_us":80135}
I20260709 13:12:39.915299 32412 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:40.027123 32764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.007s	sys 0.014s
I20260709 13:12:39.948395   375 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:12:40.035840 27225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3518) took 2356 ms (client timeout 2600 ms). Trace:
I20260709 13:12:40.036111 27229 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:12:40.040431 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 108935us
W20260709 13:12:40.036279 27225 rpcz_store.cc:269] 0709 13:12:37.679247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.692754 (+ 13507us) service_pool.cc:224] Handling call
0709 13:12:40.035580 (+2342826us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54000960d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.035754 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51968768}
W20260709 13:12:40.027697 32764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.007s	sys 0.015s
I20260709 13:12:40.062543 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:40.045933 32654 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:40.066291 27228 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:12:40.066679 27228 pending_rounds.cc:85] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 7
I20260709 13:12:40.066956 27228 pending_rounds.cc:107] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:12:40.067312 27228 raft_consensus.cc:2889] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:40.068746 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:40.068748 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:40.069478 27223 raft_consensus.cc:2376] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14. Re-sending same reply.
I20260709 13:12:40.070849 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:40.050981   378 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:40.057186 32359 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:40.117667 27228 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:40.086988 27223 raft_consensus.cc:1240] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:40.115756 27225 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:40.058429 32764 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:40.050658 32686 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:40.124820   326 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.128293 32584 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.125344   378 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.065786 32654 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.131752 32412 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.125943 32359 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.147068 32649 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:40.151976   378 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.243671 32584 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.244346 32584 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.262612   317 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:40.278384 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.310428 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.463830 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 413769us
W20260709 13:12:40.537395 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.581322 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:40.582530 27305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2566) took 1424 ms (client timeout 1503 ms). Trace:
W20260709 13:12:40.582996 27305 rpcz_store.cc:269] 0709 13:12:39.157733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.129928 (+972195us) service_pool.cc:224] Handling call
0709 13:12:40.582452 (+452524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:40.265791   317 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.585035 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2905) took 1552 ms. Trace:
I20260709 13:12:40.585652 27149 rpcz_store.cc:276] 0709 13:12:39.033061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.034035 (+   974us) service_pool.cc:224] Handling call
0709 13:12:39.034330 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.571618 (+537288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.571663 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.586768 (+ 15105us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.998322 (+411554us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:39.998388 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.998492 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.132690 (+134198us) raft_consensus.cc:1685] finished
0709 13:12:40.132713 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.584903 (+452190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158440,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":15823,"thread_start_us":865093,"threads_started":2,"wal-append.queue_time_us":466980}
I20260709 13:12:40.582767 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2375) took 1393 ms. Trace:
I20260709 13:12:40.616218 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:12:40.616757 27269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.016s
W20260709 13:12:40.617096 27269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.016s
W20260709 13:12:40.616947 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 142615us
W20260709 13:12:40.617535 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 550523us
I20260709 13:12:40.594267 27301 rpcz_store.cc:276] 0709 13:12:39.189726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.629499 (+439773us) service_pool.cc:224] Handling call
0709 13:12:39.629931 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:39.767426 (+137495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.767476 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:39.792355 (+ 24879us) log.cc:844] Serialized 52 byte log entry
0709 13:12:40.046555 (+254200us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:40.046607 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.047190 (+   583us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.582473 (+535283us) raft_consensus.cc:1685] finished
0709 13:12:40.582503 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.582692 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50608,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4536,"thread_start_us":384107,"threads_started":2,"wal-append.queue_time_us":335252}
W20260709 13:12:40.621929 27841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 1140) took 2738 ms (client timeout 2213 ms). Trace:
W20260709 13:12:40.622416 27841 rpcz_store.cc:269] 0709 13:12:37.878202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.918856 (+ 40654us) service_pool.cc:224] Handling call
0709 13:12:40.616373 (+2697517us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54004bb254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.616489 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242214144}
I20260709 13:12:40.583609 32412 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:40.583760 32359 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.649703 32359 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:40.608212 32654 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.643519   317 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.650283 32359 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.655604 32318 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.676718 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 128590us
W20260709 13:12:40.675210   375 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.012s	sys 0.022s
I20260709 13:12:40.692116 32359 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.694533 32584 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.681922 32318 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:40.714627 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.685201   375 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.012s	sys 0.022s
I20260709 13:12:40.721323   391 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:12:40.678282 32764 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.720527   323 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.748941   392 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:40.677955   317 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.758168 32584 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:40.758427   398 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:40.759012 32584 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.759266   398 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.762398   398 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.762725 32584 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:40.774295 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2370) took 1699 ms. Trace:
I20260709 13:12:40.774817 27297 rpcz_store.cc:276] 0709 13:12:39.074798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.075758 (+   960us) service_pool.cc:224] Handling call
0709 13:12:39.092194 (+ 16436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.199452 (+107258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.199497 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.199554 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:39.199606 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.773965 (+1574359us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54000ea454. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:40.774031 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.774224 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228258688}
W20260709 13:12:40.770979 27806 connection.cc:256] RPC call timeout handler was delayed by -1.5610696490000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:12:40.778753 27806 connection.cc:256] RPC call timeout handler was delayed by -1.560169649000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:12:40.779166 27806 connection.cc:256] RPC call timeout handler was delayed by -1.3568250880000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:12:40.779829 27806 connection.cc:256] RPC call timeout handler was delayed by -1.2160980619999009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:12:40.780256 27806 connection.cc:256] RPC call timeout handler was delayed by -1.0322043640001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:12:40.782688 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69369.7us
I20260709 13:12:40.771517   398 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:40.799547 32318 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.755508   323 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:40.802414   323 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:40.804106   318 consensus_queue.cc:1059] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:40.805675   318 raft_consensus.cc:3055] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:40.806180   318 raft_consensus.cc:740] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:40.807287   318 consensus_queue.cc:260] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:40.808813   318 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:40.815703 27156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2902) took 1799 ms (client timeout 1531 ms). Trace:
W20260709 13:12:40.816267 27156 rpcz_store.cc:269] 0709 13:12:39.018551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.019277 (+   726us) service_pool.cc:224] Handling call
0709 13:12:40.815471 (+1796194us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400170cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.815614 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882497792}
I20260709 13:12:40.804469   317 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.819097 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1237) took 1246 ms. Trace:
I20260709 13:12:40.819514 27152 rpcz_store.cc:276] 0709 13:12:39.572663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.810909 (+238246us) service_pool.cc:224] Handling call
0709 13:12:39.811210 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.867305 (+ 56095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.867350 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.867407 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:39.867461 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.818838 (+951377us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b5400357d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:40.818901 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.819040 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128403840}
I20260709 13:12:40.823453   398 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.829418   320 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:40.833977 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3536) took 1743 ms. Trace:
W20260709 13:12:40.857265 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.864938 27227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3541) took 1772 ms (client timeout 1935 ms). Trace:
I20260709 13:12:40.868319 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2557) took 1725 ms. Trace:
I20260709 13:12:40.783504 32584 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:40.866753   376 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:40.872689 27227 rpcz_store.cc:269] 0709 13:12:39.092059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.115944 (+ 23885us) service_pool.cc:224] Handling call
0709 13:12:40.837044 (+1721100us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54001270d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.864864 (+ 27820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139982208}
I20260709 13:12:40.850685   398 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:40.871713 27229 rpcz_store.cc:276] 0709 13:12:39.090696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.112155 (+ 21459us) service_pool.cc:224] Handling call
0709 13:12:40.035731 (+923576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.036479 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.833753 (+797274us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000960d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.833915 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081418624}
I20260709 13:12:40.873443 27302 rpcz_store.cc:276] 0709 13:12:39.141484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.142957 (+  1473us) service_pool.cc:224] Handling call
0709 13:12:40.837752 (+1694795us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003a8c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.866657 (+ 28905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503425920}
W20260709 13:12:40.870450 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 89484.3us
I20260709 13:12:40.877174   376 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:40.877957 27051 catalog_manager.cc:5697] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 6 to 8, term changed from 7 to 9, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.880052 27225 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:40.886016   398 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:40.890461 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:40.891062   402 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:40.890497 32711 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:40.891633   402 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.892376 32711 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:40.892763 32711 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:40.883072 32584 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.894829 32651 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:40.894991   317 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.924062   317 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.926110 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:40.926625   376 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:40.923072 32651 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:40.927964   376 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:40.929093 27157 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 1242) took 1355 ms (client timeout 1761 ms). Trace:
I20260709 13:12:40.929322 32651 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:40.929522 27157 rpcz_store.cc:269] 0709 13:12:39.577874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.625759 (+ 47885us) service_pool.cc:224] Handling call
0709 13:12:40.928926 (+1303167us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54003e0654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.929035 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162796416}
I20260709 13:12:40.930245   400 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:40.931201 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2569) took 1754 ms. Trace:
I20260709 13:12:40.931553 27298 rpcz_store.cc:276] 0709 13:12:39.177230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.528764 (+351534us) service_pool.cc:224] Handling call
0709 13:12:39.629141 (+100377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.629385 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.629417 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.629473 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:39.629518 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.629585 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.931056 (+1301471us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400267fd0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.931154 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174065024}
I20260709 13:12:40.895928 27302 raft_consensus.cc:1240] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:40.932904 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.933475 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:40.934247 27302 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:40.897642 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.935041 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:40.935681 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:40.936075 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:40.937062 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.875756 32764 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:12:40.866007 32644 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:12:40.898257 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.932057   317 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.939218 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.900889 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3431) took 1800 ms. Trace:
I20260709 13:12:40.880616 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:40.937968 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.940760 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.940016 27151 rpcz_store.cc:276] 0709 13:12:39.100661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.556224 (+455563us) service_pool.cc:224] Handling call
0709 13:12:39.556500 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.556683 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:39.556978 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:12:40.900575 (+1343597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.900628 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:40.900673 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.900733 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.900836 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1242575,"prepare.queue_time_us":1812,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1243144,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":100610,"threads_started":1,"wal-append.queue_time_us":337713,"wal-append.run_cpu_time_us":987,"wal-append.run_wall_time_us":1002142}
I20260709 13:12:40.941927 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.942260 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:40.942554 27302 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:40.943104 27151 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:40.943549 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:40.900939 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 1.15304e+06us
I20260709 13:12:40.906368 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:40.944990 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:40.945243 27149 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:40.946210 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:40.946982 32626 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:40.947341 32626 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:40.947710 32626 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:40.948056   335 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.824s	user 0.010s	sys 0.017s
I20260709 13:12:40.909140 32747 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:40.951288   313 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.951164 32747 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.951756   313 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.952718   319 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:40.910343 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.901337 32559 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:40.911582 27153 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:40.954253 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:40.908164 32590 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:12:40.955154 32447 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.914929 27232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1198) took 2935 ms (client timeout 1655 ms). Trace:
W20260709 13:12:40.955746 27232 rpcz_store.cc:269] 0709 13:12:37.979757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.979889 (+   132us) service_pool.cc:224] Handling call
0709 13:12:40.914727 (+2934838us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400226fd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:40.914866 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353531136}
I20260709 13:12:40.900061 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.920612 32584 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:40.956821   359 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.921757 32760 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 2.539s	user 0.008s	sys 0.018s
I20260709 13:12:40.949826 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1201) took 2412 ms. Trace:
I20260709 13:12:40.953704   313 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.950625 27122 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:40.899435 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3538) took 1808 ms. Trace:
I20260709 13:12:40.958211 27230 rpcz_store.cc:276] 0709 13:12:38.537024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.537139 (+   115us) service_pool.cc:224] Handling call
0709 13:12:38.537536 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:38.901802 (+364266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.901846 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:38.917503 (+ 15657us) log.cc:844] Serialized 52 byte log entry
0709 13:12:39.005978 (+ 88475us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:39.006032 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.006141 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.947513 (+1941372us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:40.949501 (+  1988us) raft_consensus.cc:1685] finished
0709 13:12:40.949520 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.949745 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127624,"raft.queue_time_us":252828,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4576,"spinlock_wait_cycles":13880192,"thread_start_us":357019,"threads_started":2,"wal-append.queue_time_us":155043}
I20260709 13:12:40.962474 32509 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:40.900409 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.910944 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2572) took 1711 ms. Trace:
I20260709 13:12:40.957072 32748 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:40.963056 32509 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:40.963729 32748 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:40.963084 27303 rpcz_store.cc:276] 0709 13:12:39.199649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.782583 (+582934us) service_pool.cc:224] Handling call
0709 13:12:39.782915 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.924542 (+141627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.910740 (+986198us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540031c9d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:40.910892 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303675264}
I20260709 13:12:40.955174 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.963389 27305 raft_consensus.cc:2410] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:40.964766 32509 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:40.966029 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:40.959949 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2551) took 3645 ms. Trace:
I20260709 13:12:40.959594 32527 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:40.953724 27156 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:40.967904 32527 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:40.968672 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.968520   359 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.921240 32711 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.970745   359 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.970831 32711 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:40.964977 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.899763 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.895898   402 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:40.909044   327 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.966029 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:40.967329 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.973420 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:40.956863 27301 raft_consensus.cc:2393] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:40.919843 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2372) took 1753 ms. Trace:
I20260709 13:12:40.983904 27224 rpcz_store.cc:276] 0709 13:12:39.166420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.526092 (+359672us) service_pool.cc:224] Handling call
0709 13:12:39.526479 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.585410 (+ 58931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.919613 (+1334203us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400226ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:40.919783 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88512896}
I20260709 13:12:40.954340 32559 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:40.944074 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:40.967155 27304 rpcz_store.cc:276] 0709 13:12:37.314906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.316172 (+  1266us) service_pool.cc:224] Handling call
0709 13:12:37.324978 (+  8806us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:37.325925 (+   947us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:37.620173 (+294248us) log.cc:844] Serialized 14 byte log entry
0709 13:12:38.803341 (+1183168us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:38.835208 (+ 31867us) log.cc:844] Serialized 52 byte log entry
0709 13:12:38.835401 (+   193us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:38.835449 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.835540 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.921219 (+2085679us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:40.959651 (+ 38432us) raft_consensus.cc:1685] finished
0709 13:12:40.959748 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.959890 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475368,"prepare.queue_time_us":327597,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5991,"raft.queue_time_us":556148,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":85072,"spinlock_wait_cycles":12688768,"thread_start_us":907873,"threads_started":3,"wal-append.queue_time_us":684735}
I20260709 13:12:40.910483 27152 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:40.940012 27306 raft_consensus.cc:2410] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:12:40.996095 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.894428 27806 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:40.993053 27151 raft_consensus.cc:2376] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13. Re-sending same reply.
I20260709 13:12:40.997743 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.002893 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1228) took 2719 ms. Trace:
W20260709 13:12:41.003422 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 109107us
I20260709 13:12:41.002879 27299 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:41.004931 27149 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:41.005285 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:40.967589 32394 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:40.976733 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.969743 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.017309 27302 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:41.017438 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.927593 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:41.018729 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 91215.5us
I20260709 13:12:41.018986 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.003309 27150 rpcz_store.cc:276] 0709 13:12:38.283925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.284103 (+   178us) service_pool.cc:224] Handling call
0709 13:12:38.284513 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.185133 (+900620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.002637 (+1817504us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400069ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:41.002840 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069350272}
I20260709 13:12:40.930616 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:41.020279 27157 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:41.020491 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:40.997911 27195 leader_election.cc:400] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:41.011168 27841 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:41.009145 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:41.021066 27195 leader_election.cc:403] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:41.020306 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:40.978760 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:40.962278 27226 rpcz_store.cc:276] 0709 13:12:39.091290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.112217 (+ 20927us) service_pool.cc:224] Handling call
0709 13:12:39.124856 (+ 12639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.251918 (+127062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.251962 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:39.255729 (+  3767us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.600762 (+345033us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:39.681156 (+ 80394us) log.cc:844] Serialized 14 byte log entry
0709 13:12:39.681422 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.898287 (+1216865us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b18002cf440. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419
0709 13:12:40.899112 (+   825us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001266d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:40.899165 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.899223 (+    58us) raft_consensus.cc:1685] finished
0709 13:12:40.899238 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.899375 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26962,"prepare.queue_time_us":80151,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":111293,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6372,"spinlock_wait_cycles":304898176,"thread_start_us":326905,"threads_started":1,"wal-append.queue_time_us":540703,"wal-append.run_cpu_time_us":2226,"wal-append.run_wall_time_us":1006439}
I20260709 13:12:41.011336 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.026392 27832 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:12:41.026664 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 51644.3us
I20260709 13:12:41.028527 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:41.031875 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:41.033414 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.033910 27306 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:41.034761 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.035318 27299 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:41.037250 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.039175 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.040736 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.041877 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.042529 27150 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:41.043154 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:40.904230   349 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:41.044809 27302 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 18: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:41.045217 27195 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:41.046116 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.049366 27153 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:41.050561 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.039566 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:41.046772 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:40.955747 32447 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.048688 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.054746 27225 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:41.055696 27832 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:41.053488 27157 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:41.016947 32394 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:41.054837 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:41.027990 32730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.841s	user 0.013s	sys 0.020s
I20260709 13:12:41.057119 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:41.061342 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:41.062314 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:41.063699 27298 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:41.063653 27122 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:40.999560 32747 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:41.060223 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.017313   384 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.057763 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.066327 27297 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:41.066455 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.074174 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.025978 32654 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:41.017122 32265 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.025928   398 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.073009 27150 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:41.026125 32720 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:40.997349   327 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:40.964809 32748 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.041239   342 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.061230   355 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:41.026332 32636 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.054929   358 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:12:41.061131 32730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.014s	sys 0.020s
I20260709 13:12:41.104466 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.047536 32710 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:41.079159 32708 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:41.067839 32691 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:41.073879 32359 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:41.123903 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 80703.8us
I20260709 13:12:41.117910 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:41.073621   383 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:41.127526 32530 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:41.125427   322 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:12:41.136021 27832 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:41.103638   400 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:41.136652 32530 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.137501   322 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.075742 32462 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.139143 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:41.135979 27197 leader_election.cc:400] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
I20260709 13:12:41.141338 32530 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:41.141783   383 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:41.105700 32318 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:41.122702 27228 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:12:41.068872 32749 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:41.076380 32559 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:41.127839 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.143699 27226 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:41.144629 27269 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:41.145484 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:41.085520 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 116391us
I20260709 13:12:41.147372 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.065421   349 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.154964 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.155326 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:41.058640   360 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:12:41.156852 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.157840 27832 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:41.160341 27269 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:41.158022 27836 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:41.158382 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.158505 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.161612 27833 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:41.125185   358 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.163836 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.164588 27838 raft_consensus.cc:2393] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 18: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:41.167788 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:41.173637 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.174311 27833 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:41.174417 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.132022 32708 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.177075 27837 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:41.115280 32265 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.178874 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:41.178639 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 121978us
I20260709 13:12:41.128129   315 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:41.183395 27836 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:41.120522   398 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.182456 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.186493 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:41.197082 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.191618 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:41.133903 32636 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.148291 32318 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:41.151604 32559 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.159103   318 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:41.124861   342 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.152859   386 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:41.162526 32692 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:41.192209 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.192636   347 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:41.165591   319 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:41.228001 27152 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:41.165843 32587 raft_consensus.cc:2804] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:41.228858 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.204209 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.146703   402 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:12:41.182711 32708 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.179400 32626 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.211257 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:41.211546 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.251236 27836 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:41.152314   378 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:12:41.215058 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:41.151208 32462 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.219614 32530 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:41.217378 27834 raft_consensus.cc:2393] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:41.176604   358 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.163379   391 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:12:41.192312 32651 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:41.220968 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.222754 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:41.304714 27832 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:41.305519   405 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:12:41.148986 32691 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.234277 27833 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:12:41.236840 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.240825 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.315356 27838 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:41.139389 32394 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.210677 32318 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:41.163487 32749 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:41.291206 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48970.7us
I20260709 13:12:41.330103   332 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:12:41.215624 32559 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.208940 32603 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:41.200806   353 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:41.337435   349 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:41.228103   319 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.338351   319 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.216959   318 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:41.203564   317 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:12:41.206506   395 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.099s
W20260709 13:12:41.301949   408 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:41.219707   386 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.306659   383 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.244673 32692 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:41.331899 27832 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:41.304581 32530 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:41.309494   409 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:41.306656 32730 raft_consensus.cc:2764] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:12:41.303021 32587 raft_consensus.cc:697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:41.290575 32653 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:12:41.398346   318 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.443121 32530 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:41.424144 32692 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.317750 32651 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.527841 32530 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:41.548362   416 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:12:41.507939   317 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:41.508837 32587 consensus_queue.cc:237] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:41.510773   407 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 13:12:41.569576 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 354595us
I20260709 13:12:41.570323   327 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:41.572054 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:41.599895 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:41.572841   349 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:41.600548 27835 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:41.600606   349 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.573241 32530 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:41.502310 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 309003us
I20260709 13:12:41.597186 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1230) took 3223 ms. Trace:
I20260709 13:12:41.602232 27155 rpcz_store.cc:276] 0709 13:12:38.373601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.373802 (+   201us) service_pool.cc:224] Handling call
0709 13:12:38.374185 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.374670 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.374732 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.377400 (+  2668us) log.cc:844] Serialized 26 byte log entry
0709 13:12:40.945015 (+2567615us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18003b68c0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d70d1 00007f9a51cf2a0f
0709 13:12:41.068270 (+123255us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:41.068318 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.069158 (+   840us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.595927 (+526769us) raft_consensus.cc:1685] finished
0709 13:12:41.595956 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.597116 (+  1160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32630,"raft.queue_time_us":3478,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7313,"spinlock_wait_cycles":5719296,"thread_start_us":123048,"threads_started":1,"wal-append.queue_time_us":2772907}
I20260709 13:12:41.604388 27155 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:41.604485 27123 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.660s (SENT)
I20260709 13:12:41.605670 27155 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:12:41.606374 27151 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:41.609136 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2368) took 2558 ms. Trace:
I20260709 13:12:41.616298 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.617100 27223 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:41.623611 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:41.623854 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.625178 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.625862 27232 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:41.626310 27156 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:41.609688 27300 rpcz_store.cc:276] 0709 13:12:39.050379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.050657 (+   278us) service_pool.cc:224] Handling call
0709 13:12:39.051087 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:39.051602 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:40.670500 (+1618898us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800477640. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec47455 00007f9a5572f3c7 00007f9a51d419a7 00007f9a51d510bf 00007f9a51d51038
0709 13:12:40.867834 (+197334us) log.cc:844] Serialized 14 byte log entry
0709 13:12:41.125749 (+257915us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.135552 (+  9803us) log.cc:844] Serialized 26 byte log entry
0709 13:12:41.135720 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:41.135767 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.135888 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:41.592191 (+456303us) raft_consensus.cc:1685] finished
0709 13:12:41.608874 (+ 16683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.609056 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105942,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":4701,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":31807,"spinlock_wait_cycles":18087680,"thread_start_us":436035,"threads_started":2,"wal-append.queue_time_us":332769}
I20260709 13:12:41.628536 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:41.577368   317 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:41.595108   373 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:41.636829 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.637408 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.640054 27231 raft_consensus.cc:2410] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 15 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
W20260709 13:12:41.649767 32527 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.001s
I20260709 13:12:41.650665 32691 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:41.650839   327 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:41.651984 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.641479   355 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:12:41.654408 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:41.656159 32711 consensus_meta.cc:287] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.000s
I20260709 13:12:41.656474 32265 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:41.656962 27840 raft_consensus.cc:2410] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:41.656348 27232 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 8.
I20260709 13:12:41.661150 27230 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:41.650565 32527 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:41.640924 32590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52068 (request call id 1) took 4313 ms. Trace:
I20260709 13:12:41.784279 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:41.818337 27230 raft_consensus.cc:2368] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16.
I20260709 13:12:41.633523 32761 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:41.841629 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.844494 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.656350   355 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:41.845232 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 184606us
I20260709 13:12:41.650704   342 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:41.877002 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:41.840214 32708 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 13:12:41.926599 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.825055 32636 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:41.937397   422 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.490s	user 0.001s	sys 0.000s
W20260709 13:12:41.938534 27837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.045s	sys 0.099s
W20260709 13:12:41.939913 27837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.045s	sys 0.099s
W20260709 13:12:41.948165 32318 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:12:41.951416 32527 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:41.953684 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:41.957041   376 consensus_meta.cc:287] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 1.029s	user 0.011s	sys 0.000s
I20260709 13:12:41.957847 27227 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:41.657816   373 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.960356 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.972937 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:41.868505   355 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:41.930688 32359 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.948683 32318 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.018420 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.020025 27229 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:42.020634 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.020923 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.021582 27229 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:42.021818 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.022502 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:41.891113 32710 consensus_queue.cc:1059] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:12:42.022940 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.023713 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.024873 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.026619   373 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.026644 27839 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:41.889884 32761 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:41.817939 32590 rpcz_store.cc:276] 0709 13:12:37.314313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.314443 (+   130us) service_pool.cc:224] Handling call
0709 13:12:37.421943 (+107500us) log.cc:844] Serialized 513 byte log entry
0709 13:12:38.447407 (+1025464us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b18002a75a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a51c90b0b 00007f9a51d15b63 00007f9a51d3d752 00007f9a56cfdd29
0709 13:12:40.146405 (+1698998us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b180019d700. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d73d01 00007f9a51cb0691 00007f9a51c90eaa 00007f9a51c97d53 00007f9a51c97cd9 00007f9a51c97c69 00007f9a51c97c31 00007f9a51c96dfd 000000000038f354 000000000038f199
0709 13:12:41.627487 (+1481082us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719274,"raft.queue_time_us":1639626,"raft.run_cpu_time_us":21313,"raft.run_wall_time_us":2018054,"spinlock_wait_cycles":20766848,"thread_start_us":215551,"threads_started":1,"wal-append.queue_time_us":259948,"wal-append.run_cpu_time_us":11562,"wal-append.run_wall_time_us":1398626}
I20260709 13:12:42.029700 32761 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.032137 32318 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:42.034662   426 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:12:42.036128 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.040141 32559 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.000s
I20260709 13:12:42.040776 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.050936 27225 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:42.042032 32434 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:42.043021 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3441) took 1138 ms. Trace:
I20260709 13:12:42.052127 27154 rpcz_store.cc:276] 0709 13:12:40.904350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.904631 (+   281us) service_pool.cc:224] Handling call
0709 13:12:40.949065 (+ 44434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:40.949266 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:40.949295 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:40.949349 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:40.949381 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.970356 (+ 20975us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.042863 (+1072507us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54003e0650. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:42.042968 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101532928}
W20260709 13:12:42.044145   322 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.906s	user 0.005s	sys 0.004s
I20260709 13:12:41.968779   349 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:42.033944   424 log.cc:927] Time spent T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:42.044747   317 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.045881 32359 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:42.049726   319 consensus_meta.cc:287] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.001s
I20260709 13:12:42.056804 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.078986 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.081022 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:41.936398 32708 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.088536 27232 raft_consensus.cc:2393] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:42.090638 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2924) took 1155 ms. Trace:
I20260709 13:12:42.091102 27150 rpcz_store.cc:276] 0709 13:12:40.935274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.138208 (+202934us) service_pool.cc:224] Handling call
0709 13:12:41.138494 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.296159 (+157665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.296189 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.296233 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:41.296265 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.090299 (+794034us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000df554. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:42.090381 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.090564 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362163584}
I20260709 13:12:42.093389 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3565) took 1052 ms. Trace:
I20260709 13:12:42.093930 27228 rpcz_store.cc:276] 0709 13:12:41.040970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.041315 (+   345us) service_pool.cc:224] Handling call
0709 13:12:41.041627 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.122554 (+ 80927us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:41.172112 (+ 49558us) log.cc:844] Serialized 14 byte log entry
0709 13:12:41.451835 (+279723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.451908 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:41.451969 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.093088 (+641119us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b540037b754. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:42.093151 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.093317 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76052,"raft.queue_time_us":76206,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":44545,"spinlock_wait_cycles":185485568,"thread_start_us":203105,"threads_started":1,"wal-append.queue_time_us":695059}
I20260709 13:12:42.099994 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.054445 32434 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:42.058712   322 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:42.107350 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.109514 27225 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:42.110492 27157 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:42.103117 32587 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:42.118185 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.078722 32559 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.111379   317 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.127170 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.098960   319 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.135254 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2920) took 1226 ms. Trace:
I20260709 13:12:42.135182 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.136003 27149 rpcz_store.cc:276] 0709 13:12:40.909152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.007558 (+ 98406us) service_pool.cc:224] Handling call
0709 13:12:41.007828 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.106773 (+ 98945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.106794 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:41.107170 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:12:41.592499 (+485329us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:41.592562 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.020892 (+428330us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54001ae0d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:42.020942 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.127223 (+106281us) raft_consensus.cc:1685] finished
0709 13:12:42.127244 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.135164 (+  7920us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26590,"raft.queue_time_us":30247,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15422,"spinlock_wait_cycles":165345664,"thread_start_us":449667,"threads_started":1,"wal-append.queue_time_us":500418}
I20260709 13:12:42.140393 27148 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:42.142017 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.147380 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.119611 32587 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:42.154981   427 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:42.165874 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:42.170977 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.173357 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3569) took 1069 ms. Trace:
I20260709 13:12:42.173698 27229 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:42.173879 27227 rpcz_store.cc:276] 0709 13:12:41.103986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.104118 (+   132us) service_pool.cc:224] Handling call
0709 13:12:42.173090 (+1068972us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54003d0ed4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:42.173278 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853292800}
W20260709 13:12:42.176815   428 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:12:42.178287 32732 raft_consensus.cc:3055] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:42.178442 32748 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:42.178740 32732 raft_consensus.cc:740] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:42.179154 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:42.179565   398 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.179718 32732 consensus_queue.cc:260] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.180349 32590 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:42.180802 32590 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.181069 32732 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.181222 32590 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.184943 32603 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:42.185348 32603 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:42.186164 32603 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.187368 32603 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.150900   349 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:12:42.190546   349 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:42.191027   349 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:42.191311   349 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:42.191879 32590 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:42.192128   349 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.193186   386 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:42.193406   429 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:42.193574   349 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:42.195073   423 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:42.153599 32587 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.113484   355 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.199674 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:42.208567 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:42.213465 27123 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.220048 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.221292 32359 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.139364 32434 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.226039 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.226624 32434 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.227298 27156 raft_consensus.cc:2410] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:12:42.227363   319 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.229712   355 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.203389   342 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.235435 32748 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:42.237937   302 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.238404 32761 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:42.340560 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.324149 32748 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.331851 32761 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:42.344730 32748 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.353101 32761 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.351390 32559 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:42.402016 32590 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.391013 32708 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:42.406586 27156 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:42.392915 32447 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:42.435487 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.419516 32727 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:12:42.465498 27152 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:42.469488 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2927) took 1533 ms. Trace:
W20260709 13:12:42.472994   318 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.916s	user 0.002s	sys 0.007s
I20260709 13:12:42.481334   318 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:42.478868 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.492692   318 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.474810 32590 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:42.486739 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.488940 27230 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:42.469882 27152 rpcz_store.cc:276] 0709 13:12:40.936030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.241160 (+305130us) service_pool.cc:224] Handling call
0709 13:12:42.465175 (+1224015us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5800005198. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56d10fc0 00007f9a56cfb929 00007f9a56cfb3d2 00007f9a50272bd4
0709 13:12:42.465350 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.469259 (+  3909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.469434 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16381184}
W20260709 13:12:42.480849   358 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 1.164s	user 0.010s	sys 0.000s
I20260709 13:12:42.495028 27122 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:42.499651 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.500015 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.503870 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.504837 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.507957 27224 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:42.509655 27838 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:42.512486 27832 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:42.512744 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.513803 27841 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:42.515139 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.515730 27304 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:42.508873   349 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:42.518844 27302 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:42.519268 27224 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:42.520267 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.520828 27302 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:42.521883 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.522574 27302 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:42.522634 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.523510 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.524255 27299 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.524539 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.527534 32748 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.528698 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.530591 27838 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:42.461468 32761 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.533970 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.534508 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.523478 32434 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:42.537369   398 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.538403 27806 connection.cc:256] RPC call timeout handler was delayed by -1.0537923209999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:12:42.538831 27806 connection.cc:256] RPC call timeout handler was delayed by -1.03759232099992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:12:42.538895 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:42.539175 27806 connection.cc:256] RPC call timeout handler was delayed by -1.0321923209999113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:12:42.539533 27806 connection.cc:256] RPC call timeout handler was delayed by -1.0267923209999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:12:42.539644 27832 raft_consensus.cc:2410] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:42.542842 27299 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:42.543308 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.543828 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.533603 27272 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:42.545051 27302 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 12: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:42.546200 27122 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.547065 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.537734 32434 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.549829 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:42.552511 32434 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.553220   394 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.554116   394 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:42.533205   318 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.547283 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:42.557173 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.505517 32590 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.523707 32559 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:12:42.549827 32231 consensus_queue.cc:1059] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:12:42.565092 32708 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:42.570178 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:42.509464   358 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.559514 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:42.572805 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:42.537925   398 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.582580   398 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:42.548270 32703 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.583475 32703 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.548050 32600 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:42.556504   349 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:42.538591 32644 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:12:42.509368 32587 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.569952 32447 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:42.570112 32434 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:42.572850   443 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:12:42.600229 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.590617   302 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:42.601190   302 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:42.601256 27806 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.602169   302 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.598865 27151 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:42.602488 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:42.556984 32747 consensus_queue.cc:1059] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:12:42.611052 32318 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:42.592197   394 raft_consensus.cc:3055] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:42.611819   394 raft_consensus.cc:740] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:42.608595 32434 raft_consensus.cc:697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:42.612703   394 consensus_queue.cc:260] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.613219 32434 consensus_queue.cc:237] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:42.589085   349 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:42.586088 32708 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.614035   394 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:42.589920 32600 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:42.617527 32600 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:42.608107   398 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:42.618499 32703 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.619269 32626 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:42.619771 32748 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.597992 32447 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:42.620573 32447 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.600253 32231 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.624914 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.625201 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.625782 27306 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.626533 32590 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.627641 27150 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:12:42.614344   349 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:42.630460 27272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.635923 27157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2922) took 1726 ms. Trace:
I20260709 13:12:42.636340 27157 rpcz_store.cc:276] 0709 13:12:40.934669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.128959 (+194290us) service_pool.cc:224] Handling call
0709 13:12:41.151952 (+ 22993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.110866 (+958914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.635687 (+524821us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54003c5d54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:42.635862 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203968896}
I20260709 13:12:42.638422 32462 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.610598 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.570483   318 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.610034   448 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.644125 27306 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:42.644574 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.647034 32727 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:42.647890   353 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:42.650574   353 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:42.650938   353 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:42.651819   353 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.653038   353 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:42.662676 27806 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:42.663475 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.667076 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:42.668687 27122 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.615979 32708 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.649745 32231 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:42.675770 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:42.668883 32703 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:42.637981 32447 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.682418 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.683020 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.684264 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.691336 27835 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:42.691511 27833 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:42.685416 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:42.687662 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.675436   398 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:12:42.694234 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.674453 32748 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:42.676396 32462 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:42.675019 32318 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:42.696425 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.705042 27228 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:42.697160 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.706174 27230 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:42.707926 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:42.665215   448 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.714565 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:42.700111   447 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:12:42.690488 32708 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:42.740337 27228 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:42.742583 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.742851 27224 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:42.747668 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.748880 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.750173 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:42.753795 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.754349 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.754423 27155 raft_consensus.cc:2393] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:42.754830 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.707787   398 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:42.714871 32462 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:42.757627 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.758580 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.759501 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.760432 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.765105 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:42.765547 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.765730 27230 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:42.767977 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.768801 27155 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:42.770944 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.773904 32651 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:42.777221 27807 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.655s (SENT)
I20260709 13:12:42.753473 32603 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.778192 32603 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:42.779945   439 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.326s	user 0.004s	sys 0.000s
I20260709 13:12:42.781307 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.783715 27305 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:42.777693 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.787612 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.709672 32748 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.805145 27807 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:42.753890 32761 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.806903 27302 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:12:42.809311 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:42.806346 32231 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:12:42.798085   447 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:42.826689 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:42.832576 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 133448us
I20260709 13:12:42.737809 32708 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:42.797338 32318 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:42.838523 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:42.839128 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 193194us
I20260709 13:12:42.844010 27302 raft_consensus.cc:2368] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
W20260709 13:12:42.845185 27271 consensus_peers.cc:597] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 -> Peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741): Couldn't send request to peer f4afe81810944d70bc2cc31754392f3d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8f560534ffa48878a9e4d4766199287. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.863534 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:42.864149 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59088.3us
I20260709 13:12:42.834498   358 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:42.874969 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 121712us
I20260709 13:12:42.883102 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.884065 27153 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.886797 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:42.887537 27153 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:42.808871   349 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.880780 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.878839 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:42.881910 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.882506 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.892052 27150 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:42.901536 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.866745   318 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:42.876736   448 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:42.874903 32587 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.912210 27150 raft_consensus.cc:1240] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:42.882882 32318 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:42.913724 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:42.918247 27155 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:42.862968 32434 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:12:42.866575   386 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:12:42.874625 32462 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:42.867125   398 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:43.120957 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.073487 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 2010) took 1899 ms. Trace:
I20260709 13:12:42.938040 27306 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 9. Current term is 11. Ops: []
I20260709 13:12:43.061843 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.085395 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:43.043322 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.998620 27148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2931) took 2061 ms. Trace:
I20260709 13:12:43.138944 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:42.951536 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.145443 27833 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.137706 27839 rpcz_store.cc:276] 0709 13:12:41.174347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.175082 (+   735us) service_pool.cc:224] Handling call
0709 13:12:41.175431 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.027277 (+851846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.073185 (+1045908us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540059f6d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:43.073410 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956969856}
I20260709 13:12:43.146878 27148 rpcz_store.cc:276] 0709 13:12:40.937071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.247183 (+310112us) service_pool.cc:224] Handling call
0709 13:12:41.247471 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.140931 (+893460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.998383 (+857452us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540012c5d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:42.998560 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052904320}
I20260709 13:12:43.143488 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:43.002703 27840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 1997) took 1962 ms (client timeout 2475 ms). Trace:
I20260709 13:12:42.990384 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:43.092170 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.962571 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:42.997946 27834 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:43.079528 27153 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:43.148623 27300 raft_consensus.cc:2368] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16.
I20260709 13:12:43.154371 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 2014) took 1854 ms. Trace:
I20260709 13:12:43.155783 27302 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:43.141572 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:43.038496 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48417.7us
W20260709 13:12:43.154978 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 194605us
I20260709 13:12:43.159425 27834 rpcz_store.cc:276] 0709 13:12:41.300437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.997264 (+1696827us) service_pool.cc:224] Handling call
0709 13:12:42.997580 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:43.152686 (+155106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.154158 (+  1472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:43.161962 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:43.149326 27840 rpcz_store.cc:269] 0709 13:12:41.040087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.046557 (+  6470us) service_pool.cc:224] Handling call
0709 13:12:43.002475 (+1955918us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54005820d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:43.002637 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391808256}
I20260709 13:12:43.166016 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.166779 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.163328 27837 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.168419 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.148488 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:42.994580 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.169166 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.169620 27839 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:43.166558 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:43.169991 27840 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 8.
W20260709 13:12:42.987033   464 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:12:43.191486 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:42.986330   457 log.cc:927] Time spent T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:12:43.086463 32705 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:43.174806 27837 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:43.173870 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.175295 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.026022   465 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.919867 32642 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.164638   461 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:42.903622 32703 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.996951 32394 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.172780 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:43.168745 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:42.938170   463 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.170228 27300 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
W20260709 13:12:43.219993 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44751.5us
I20260709 13:12:43.228319 27301 raft_consensus.cc:1240] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:12:43.220059 27306 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:12:43.220778 27833 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:43.215528 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.227398 27303 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:43.081053 32748 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.159412   342 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:43.086364 32708 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:42.937965 32447 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.159757 32434 consensus_queue.cc:1243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:12:43.164417 32727 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:43.240679 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 328509us
I20260709 13:12:42.971112   448 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.249s
I20260709 13:12:43.265206 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.266446 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.250769 27306 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:43.267802 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 402781us
I20260709 13:12:43.252605 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.253073 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:43.254312 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.257949 27301 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:12:43.272107 27301 pending_rounds.cc:85] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 5
I20260709 13:12:43.273245 27301 pending_rounds.cc:107] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:12:43.273567 27301 raft_consensus.cc:2889] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.273617 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.260089 27298 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:43.261399 27155 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:43.276232 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.214331   469 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.231196 32651 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:42.953259   318 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.277s
I20260709 13:12:43.271893 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.285248 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.218709 32705 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:43.229419 32749 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.287714 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.243392 27152 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:12:43.282562 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:43.291164 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:43.242689   349 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.302111 27302 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.289867 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.295807 27837 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
W20260709 13:12:43.305675   302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.028s	sys 0.018s
W20260709 13:12:43.306046   302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.028s	sys 0.018s
I20260709 13:12:43.307267 27154 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:43.307174 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.281127 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.308193 27840 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:43.311093 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.261139   461 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.311671 27298 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:43.238590   465 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.250396   472 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:12:43.294421   386 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.246903 32703 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.279637   473 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
W20260709 13:12:43.325122 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 165926us
I20260709 13:12:43.340350 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:43.342348 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.292651 32231 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:43.264573   342 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:43.324987 32600 consensus_meta.cc:287] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.003s
I20260709 13:12:43.277904 32727 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.316766 32649 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:43.323459 32530 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.348192   468 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:12:43.258075   463 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.350901 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:43.349493 27271 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.360122 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.351994 27841 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:43.361406 32434 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:43.363087 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.391355 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:43.353021   474 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.349258 32642 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:12:43.368199   470 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.369915   387 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.353772 32600 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.356918 32530 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.353437   479 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:12:43.401932   486 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:43.439369   485 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:12:43.491612 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 128478us
I20260709 13:12:43.494870 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:43.577487 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.579551 32703 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.579994 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:43.506973 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 224433us
W20260709 13:12:43.509838 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 237898us
I20260709 13:12:43.582268 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.583876 27806 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:43.584841 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:43.523428 27226 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:43.530566 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:43.586228 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.586778 32642 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.588158   473 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.589205   473 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:43.534533 32434 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.551753   472 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.535899 32696 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.587317 27305 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:43.591802 27806 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.437445   463 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.438145   465 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.404665   470 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:43.431877   480 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:12:43.436332   484 log.cc:927] Time spent T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:12:43.614216 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 268580us
I20260709 13:12:43.614851 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.619145   473 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:43.618319 27051 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 9 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 12 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:43.621551   387 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:43.541977 27153 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:43.622260   387 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:43.622478   499 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:43.564785 32530 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.624049   387 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.571856   496 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:43.572408 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.573397 32600 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:41.617287 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:43.575821   342 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.628796 32559 raft_consensus.cc:3055] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:43.629344 32559 raft_consensus.cc:740] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:43.591451 32696 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.626363   472 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.594234 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2936) took 2413 ms. Trace:
I20260709 13:12:43.632362 32696 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.357061 32705 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.594964   353 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:43.634151   353 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.636168 32653 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:43.636601 32653 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:43.636705   353 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.595402 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.585929   321 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:43.638077   321 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.640658 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:43.598023 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 98419.4us
I20260709 13:12:43.609970 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.642853   317 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:43.643385   317 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:43.643922 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.644323   386 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:43.645509   386 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:43.612823 32703 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:43.486270 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 312230us
I20260709 13:12:43.624078 32727 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.433925   497 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:43.630789 32559 consensus_queue.cc:260] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:43.595829   486 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
W20260709 13:12:43.652522 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60944.4us
I20260709 13:12:43.646044 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:43.646721 27269 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:43.632329 27151 rpcz_store.cc:276] 0709 13:12:41.180835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.613334 (+432499us) service_pool.cc:224] Handling call
0709 13:12:41.613682 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.606338 (+992656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.593615 (+987277us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54003e0154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:43.593998 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265161472}
I20260709 13:12:43.658524 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.648895   497 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:43.662225 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:43.662519 32603 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:43.662878   394 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:43.660386 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 65312.3us
I20260709 13:12:43.663677   502 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:43.664779   486 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.662235   497 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.667662 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:43.668516 27226 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:43.669390   318 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.669831   318 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:43.669937 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:43.670871 27230 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:43.664621   502 consensus_queue.cc:1059] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:43.671070   318 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.671939   502 consensus_queue.cc:1243] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:12:43.673086   318 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.637876 32653 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.673833 27153 raft_consensus.cc:1240] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.675834 32653 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.621735 27051 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 12 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.678663 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:43.679723 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.680832   479 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:43.680684   470 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.681356   479 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.682621   470 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.681900   479 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.652583 32559 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:43.690452 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44054.4us
I20260709 13:12:43.691052 32651 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:43.691514 32651 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.691859 32651 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.644722   317 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.696244   317 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:43.696292 32696 consensus_queue.cc:1175] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9bc1278c649846e998b312b374274d08" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:43.696697   394 consensus_queue.cc:1059] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:43.698364   500 raft_consensus.cc:3055] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:43.646462 32703 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:43.698870   500 raft_consensus.cc:740] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:43.699105 32703 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.700358   500 consensus_queue.cc:260] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.703188   474 raft_consensus.cc:3055] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:43.703238 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:43.703848   474 raft_consensus.cc:740] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:43.704553 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:43.705543   394 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:43.718640 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.705976 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.723654 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.707430 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61569.6us
W20260709 13:12:43.754097 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.698606 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.648511 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.714793 27156 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:43.705294   474 consensus_queue.cc:260] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.722775 27123 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:43.724172   387 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.708798   500 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:43.706013   394 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.787577   394 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.789770 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.707433 32697 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.791301 32697 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:43.791819 32697 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.712182 32705 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.795372 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:43.810218 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87685.1us
I20260709 13:12:43.811057 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:43.811790   393 consensus_queue.cc:1059] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:43.812585 27123 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:43.810890   486 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:43.818277   486 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:43.818711   448 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:43.818888   486 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:43.819526 27153 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:43.818351 32434 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:43.820056   486 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.822975 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:43.706652   496 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.829816   493 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.830287 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 181986us
I20260709 13:12:43.830521   493 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.826984 32653 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:43.831615   474 raft_consensus.cc:3060] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:43.832930   493 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.833527   459 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.834115   459 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.836484   473 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.837050   473 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.837563   459 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.839669   473 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:43.841512   497 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:43.842694 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:43.843560 27156 raft_consensus.cc:2376] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18. Re-sending same reply.
I20260709 13:12:43.850371   465 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:43.851097   465 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:43.852386   465 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.854621 32708 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:43.855273 32708 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:43.856227 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:43.856506 32708 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.831656 32653 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.858508 32761 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:43.824579   353 raft_consensus.cc:3055] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:43.859908   353 raft_consensus.cc:740] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:43.860136 32761 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:43.860602 32761 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:43.861027   353 consensus_queue.cc:260] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.816932 32600 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:43.861104 32761 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.865572 32767 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:43.858511 32653 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:43.869226 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:43.870086 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:43.827106   472 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:43.871652   472 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.871929 27051 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.872876   448 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.873304   448 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:43.822068   358 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:43.873590 27051 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 4 to 7, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 7 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:43.868952   479 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:43.825208 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.671s (SENT) [suppressed 33 similar messages]
I20260709 13:12:43.879549 27224 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:43.882548 27153 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:43.871001 32767 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.882740   386 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:43.883198   386 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:43.883561   386 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:43.884567 32767 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:43.885475 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47865.8us
I20260709 13:12:43.886710   353 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.887017   486 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:43.887168 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47080.8us
I20260709 13:12:43.889222 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.891590   321 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.892062 32603 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.892272   321 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.895175   496 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:43.858541 32394 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.009s
I20260709 13:12:43.896163 27304 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:43.896440   472 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.896747 31906 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:43.897300 32318 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.731s	user 0.019s	sys 0.004s
I20260709 13:12:43.897243 31906 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.897822 32318 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:43.898036 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2395) took 1380 ms. Trace:
I20260709 13:12:43.898460 27304 rpcz_store.cc:276] 0709 13:12:42.518015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.522394 (+  4379us) service_pool.cc:224] Handling call
0709 13:12:43.897801 (+1375407us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400197b54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:43.897966 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156995456}
I20260709 13:12:43.906193 27301 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:43.913087 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:43.914599 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 89409.1us
W20260709 13:12:43.922267 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.922770 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:43.920835 27154 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:12:43.923561 27302 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:43.919415 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.920946 32434 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:12:43.926585 31906 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:43.929780   319 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:43.930306   319 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:43.926690 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 148521us
I20260709 13:12:43.925992 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.933791 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.929948 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:43.924723 27154 pending_rounds.cc:85] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 6
I20260709 13:12:43.942930 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.944103 31906 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:43.938651   319 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.945847 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.949050 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:43.949316   503 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.950018 27151 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:43.949908   503 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.951172   321 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:43.947366 31906 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:43.913589   358 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:43.954833 31906 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.936905 27154 pending_rounds.cc:107] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:12:43.955952 27154 raft_consensus.cc:2889] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:43.956502 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:43.945922   319 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:43.924850   394 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.904563 32603 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.963539 32559 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.980118 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.971772   321 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:43.980142 27807 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.076s (SENT)
I20260709 13:12:43.984681   461 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:43.984937 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:43.985332   461 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:43.986168 32703 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:43.987556   461 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:43.983453   321 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.988523   321 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:43.990680 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.991598 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:43.993172 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 52894.7us
I20260709 13:12:43.993956 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:44.002200 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.011606 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:43.976125   499 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.015209 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 92551.1us
I20260709 13:12:43.955433   358 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.007244 32434 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:44.004492   496 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.026901   394 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:44.027777 32703 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:44.001848   470 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:44.029528   470 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:44.029881 32318 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.027347   496 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.030557 32603 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.024698   472 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:12:44.032598   496 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.019690 32651 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.037528 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:44.038164 27223 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.039022 27051 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.040580 27051 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 7, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 7 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:44.004335 32394 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:44.042361 32651 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:44.044261 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.044633 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.045457   503 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:44.046010   472 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:44.046887 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 77647.6us
W20260709 13:12:44.046773 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:44.046725 32318 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:44.009541 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.048492 32318 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:44.048650 32653 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:44.047700 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.082s (SENT)
I20260709 13:12:44.050364 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:44.052189 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.052235 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.053556   503 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.055723 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.049839 32318 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:44.055960 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.044936 27050 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 246) took 22341 ms (client timeout 15000 ms). Trace:
I20260709 13:12:44.058539 32761 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.061852 27840 pending_rounds.cc:85] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 11
I20260709 13:12:44.045295 27051 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 9 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:44.062189 27840 pending_rounds.cc:107] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:12:44.073972 27840 raft_consensus.cc:2889] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:44.009152 32530 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:44.064652 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.078344 27152 raft_consensus.cc:3060] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.063283 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:44.076085 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.064248 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.063858 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:44.079257 27223 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
W20260709 13:12:44.056663 27050 rpcz_store.cc:269] 0709 13:12:21.703119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.703338 (+   219us) service_pool.cc:224] Handling call
0709 13:12:44.044685 (+22341347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:34.510959 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:34.586771 (+ 75812us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:34.586831 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:12:34.586855 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:34.588172 (+  1317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:34.588283 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:34.588310 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:12:34.589478 (+  1168us) tablet.cc:701] Row locks acquired
0709 13:12:34.589521 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:12:34.589690 (+   169us) write_op.cc:270] Start()
0709 13:12:34.589838 (+   148us) write_op.cc:276] Timestamp: P: 1783602754589625 usec, L: 0
0709 13:12:34.589870 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:12:34.735005 (+145135us) log.cc:844] Serialized 5622 byte log entry
0709 13:12:35.480281 (+745276us) op_driver.cc:464] REPLICATION: finished
0709 13:12:35.835128 (+354847us) write_op.cc:301] APPLY: starting
0709 13:12:35.835235 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:36.707584 (+872349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:36.724364 (+ 16780us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:36.881522 (+157158us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:36.881892 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:12:36.881942 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:36.882410 (+   468us) log.cc:844] Serialized 129 byte log entry
0709 13:12:37.163339 (+280929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:37.163552 (+   213us) write_op.cc:454] Released schema lock
0709 13:12:37.163647 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:37.164199 (+   552us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:37.164234 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":992108,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":301138,"apply.run_cpu_time_us":50926,"apply.run_wall_time_us":1335405,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":103327,"prepare.run_cpu_time_us":36056,"prepare.run_wall_time_us":395133,"raft.queue_time_us":252523,"raft.run_cpu_time_us":32804,"raft.run_wall_time_us":183839,"replication_time_us":859783,"thread_start_us":684110,"threads_started":5,"wal-append.queue_time_us":450566,"wal-append.run_cpu_time_us":17447,"wal-append.run_wall_time_us":2455884}]]}
I20260709 13:12:44.063391 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.084851 27272 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:44.037788   321 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.090180 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.096216   317 raft_consensus.cc:2804] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:44.097010   317 raft_consensus.cc:697] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:44.098163   317 consensus_queue.cc:237] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.099155 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.099875 27837 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:44.100646 27305 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:44.081310   459 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:44.101589   459 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:44.101976   459 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:44.107554 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 63402.8us
I20260709 13:12:44.111936 27151 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:44.029903   470 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:44.116839 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.124531 27197 leader_election.cc:400] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13.
W20260709 13:12:44.120256 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.122732 27302 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:44.077961 32530 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:44.131438 27157 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:44.126091   499 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.140102   499 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.144384 32530 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.145601 32530 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:44.147886 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.148558 27833 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:44.149165 27806 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:44.149703   479 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:44.150199   398 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:44.150497 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.137601 32603 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:44.151326 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:44.152199 32651 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:44.152609 32651 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.153021 32651 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.155565 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.156414 27304 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:12:44.157676 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.150573   398 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.129815 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.158303 32697 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.145617 27051 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.127894 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:44.169437 27223 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.168814 27804 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.172442 27302 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:44.062014   386 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.176474 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.177898 27151 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:44.178333 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.183139 27834 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:44.158340   461 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:44.184563 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.185180 27051 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 12 to 16, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 16 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:44.160615   321 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.184744 27152 raft_consensus.cc:2468] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:44.187738 27051 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.185058 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:44.188727 27223 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:44.190653 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.186237 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.199875 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:44.200826 31906 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.201293 31906 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:44.194595 32651 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.207247 27151 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:44.173983   398 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.183856   472 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:44.205173 27148 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
W20260709 13:12:44.207970 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.212287 27156 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:44.197762   465 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.214187 27154 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:44.209774 32653 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.175189 32318 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:12:44.214534 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56975.7us
I20260709 13:12:44.217164   386 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:44.217381   318 consensus_meta.cc:287] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 13:12:44.218297 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.218830 32651 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.205613   497 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:12:44.235862   522 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
W20260709 13:12:44.236764 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 107118us
I20260709 13:12:44.237610 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.239171 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.240067   353 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.240753   512 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.241537 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.227833 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.204842   486 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:12:44.254725 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.231019 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 1170) took 1088 ms. Trace:
I20260709 13:12:44.234416 32318 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:44.235823   497 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:44.195393   499 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:44.244168   520 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:12:44.245407   448 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:44.227020   516 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:12:44.250895 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.213322 27195 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:44.255785 27834 rpcz_store.cc:276] 0709 13:12:43.172456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.172568 (+   112us) service_pool.cc:224] Handling call
0709 13:12:44.230804 (+1058236us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400899ed4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:44.230936 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511389056}
I20260709 13:12:44.257309 27051 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.264895 27152 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:12:44.270707 27224 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:44.274825 27122 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.277951 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.282968 27839 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:44.285195   524 ts_tablet_manager.cc:933] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:44.290112   524 tablet_copy_client.cc:323] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Beginning tablet copy session from remote peer at address 127.25.109.131:37965
W20260709 13:12:44.290329   515 log.cc:927] Time spent T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 13:12:44.292007 32761 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.292634 27315 tablet_copy_service.cc:140] P 897d8be8580141d1ad3bb17946d3da89: Received BeginTabletCopySession request for tablet c8f560534ffa48878a9e4d4766199287 from peer f4afe81810944d70bc2cc31754392f3d ({username='slave'} at 127.0.0.1:40558)
I20260709 13:12:44.292665 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.294528 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.295112 27157 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:44.295018 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 81768.3us
I20260709 13:12:44.279978 31906 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.294126 27837 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.262193 32318 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:44.302281 27051 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 9 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } }
I20260709 13:12:44.305034 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.305500 27152 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.309247 27835 raft_consensus.cc:2368] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17.
I20260709 13:12:44.309363   448 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:44.311177 32318 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.312556 32318 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:12:44.315310   504 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:12:44.259488 32696 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:12:44.300837   512 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:44.321066 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 79615.3us
I20260709 13:12:44.318756 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.293273 27315 tablet_copy_service.cc:161] P 897d8be8580141d1ad3bb17946d3da89: Beginning new tablet copy session on tablet c8f560534ffa48878a9e4d4766199287 from peer f4afe81810944d70bc2cc31754392f3d at {username='slave'} at 127.0.0.1:40558: session id = f4afe81810944d70bc2cc31754392f3d-c8f560534ffa48878a9e4d4766199287
I20260709 13:12:44.326148 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.325038 27051 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:44.340022 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:44.340713 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.306356 32705 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.324100   358 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:44.274690   470 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.346999 27197 leader_election.cc:400] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16.
I20260709 13:12:44.347538   470 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:44.348008 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:44.348960 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.324373   512 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.349756   512 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:44.350355 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.350965 27834 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:44.352317   499 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:44.352829   499 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:44.334929 32394 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:44.353709   499 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.354637 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.354640 32705 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.361017 27152 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:44.341951 27051 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 10 to 13, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.306993   465 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:44.345119 27304 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:44.372977 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.385756 27156 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:44.373119 27834 raft_consensus.cc:2468] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
W20260709 13:12:44.389724 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 134223us
I20260709 13:12:44.342741 32697 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.344676   497 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.416522 27051 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 8 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 11 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:44.421209 27838 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:44.414806 32696 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:12:44.400488   503 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
W20260709 13:12:44.431380 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 79597.6us
W20260709 13:12:44.443833 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.388530   358 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:44.450865 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:44.462814 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:44.435930   394 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:12:44.449106   319 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:44.465237 27230 raft_consensus.cc:1275] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:44.451988   353 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.470607 27051 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 10 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 11 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:44.474004 32530 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:44.474454 32530 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:44.475419 32530 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.476699 32530 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:44.465045 32394 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:44.489409 27271 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:44.494254 27051 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:44.501098 32651 consensus_queue.cc:1048] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:44.501483   358 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:44.506222 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.510891 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.513731 27271 leader_election.cc:400] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17.
I20260709 13:12:44.482633   448 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:44.523392 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:44.527052 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.528179 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:44.524085 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.497268   511 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.478961   353 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.567305 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:44.570331 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56690.7us
W20260709 13:12:44.570900 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.504068 32705 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.569814 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56386.4us
I20260709 13:12:44.520077 32434 raft_consensus.cc:2804] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:44.495826   319 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:44.606851 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.524923   448 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:44.612195 31906 consensus_queue.cc:1059] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:12:44.608778 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.608814 27223 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:44.495709   512 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.610952 27297 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:44.603448   459 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.003s
I20260709 13:12:44.566710 32394 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:44.597559 32705 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:44.609387 27834 raft_consensus.cc:2376] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12. Re-sending same reply.
W20260709 13:12:44.654495 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.676003 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:44.694757 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:44.695595 27302 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:44.655791 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:44.733475 27839 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:44.759326 27836 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
W20260709 13:12:44.803027 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.803040 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:44.648838 32434 raft_consensus.cc:697] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:44.824622 27051 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 16 to 17, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 17 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:44.677562   474 consensus_meta.cc:287] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.000s
I20260709 13:12:44.831984 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:44.832932 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:44.847186 27155 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:44.762544   516 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:12:44.856063 27223 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:44.691417   353 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:44.686022   470 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:44.863085 27051 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 5 to 10, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 10 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:44.886190 31906 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:44.898779 31906 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:44.691459   512 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:44.630796   321 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.198s
I20260709 13:12:44.842025   499 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:44.958266 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.893888   521 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.765s	user 0.000s	sys 0.004s
I20260709 13:12:44.654294   459 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.984323 31906 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.686966 32394 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:44.942580   474 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:45.009009 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 376356us
I20260709 13:12:44.678350   448 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.023007 27154 raft_consensus.cc:1240] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:44.945585 27051 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 11 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:45.045634 27157 consensus_meta.cc:287] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:12:45.046727 27157 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:44.916015   470 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.072098 32434 consensus_queue.cc:237] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.074802 32705 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:45.085240 27837 consensus_meta.cc:287] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.778s	user 0.006s	sys 0.004s
I20260709 13:12:45.085733 27837 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
W20260709 13:12:45.068854   534 log.cc:927] Time spent T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.552s	user 0.000s	sys 0.001s
W20260709 13:12:45.084674   500 consensus_meta.cc:287] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.278s	user 0.000s	sys 0.013s
W20260709 13:12:45.094266   533 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.581s	user 0.000s	sys 0.001s
I20260709 13:12:45.031668   474 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.111894 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.113751   470 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.120154   448 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.098563   319 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.109114 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:45.105650 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 338552us
W20260709 13:12:45.103919 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.133870 27155 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:45.127426 27841 raft_consensus.cc:2468] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:45.108415 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.138968 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:45.141672   528 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.533s	user 0.000s	sys 0.002s
I20260709 13:12:45.142879   545 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.146560 27833 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.152086   474 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.111212   500 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.166579   500 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.168874   500 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.171249   459 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:45.172849 32530 consensus_meta.cc:287] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.001s
I20260709 13:12:45.192529   500 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.193217   500 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.196115 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 99843.3us
I20260709 13:12:45.196949 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:45.202416 27833 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:45.173642   470 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.213868   394 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.214532   394 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.216292 32696 raft_consensus.cc:3055] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:45.216718 32696 raft_consensus.cc:740] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:45.217182   394 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.217999 32530 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:45.217523 32696 consensus_queue.cc:260] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.223935 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.228343   545 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.230449 27837 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:45.207026   503 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.248042 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:45.285499 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 201619us
W20260709 13:12:45.254799 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.277662 27149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.008s
I20260709 13:12:45.249724   500 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.291236 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:45.291893 27836 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:45.298444 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:45.271360   398 consensus_meta.cc:287] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.000s
W20260709 13:12:45.252044   387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.010s	sys 0.027s
I20260709 13:12:45.229561 32530 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.272641 32696 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.305485 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:45.305634 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 193741us
W20260709 13:12:45.305022   387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.015s	sys 0.043s
I20260709 13:12:45.321331 27304 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.304953   486 raft_consensus.cc:2764] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:12:45.309528 32530 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.252538   470 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.314364 32318 consensus_meta.cc:287] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.001s	user 0.008s	sys 0.004s
I20260709 13:12:45.288784   503 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.315864   358 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:45.255302   545 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.338917 31906 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.319314   500 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:45.338984 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 91082.2us
I20260709 13:12:45.341063 32603 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.341197   387 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.366111   500 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.366410 32603 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.368646   500 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.341660 32434 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.369575 32434 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.371003 27841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 2031) took 1316 ms (client timeout 1524 ms). Trace:
W20260709 13:12:45.371388 27841 rpcz_store.cc:269] 0709 13:12:44.054261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.055290 (+  1029us) service_pool.cc:224] Handling call
0709 13:12:45.370825 (+1315535us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54003377d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:45.370946 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951032064}
I20260709 13:12:45.373955 27832 raft_consensus.cc:1275] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:12:45.374212 32705 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:45.375159 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 2035) took 1311 ms. Trace:
I20260709 13:12:45.375286 32705 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:45.375509 27832 rpcz_store.cc:276] 0709 13:12:44.063896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.064357 (+   461us) service_pool.cc:224] Handling call
0709 13:12:45.373484 (+1309127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:45.374335 (+   851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.374964 (+   629us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003377d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:45.375090 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009974656}
I20260709 13:12:45.351794 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1272) took 1184 ms. Trace:
I20260709 13:12:45.376802 32705 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:45.377363 32705 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:45.376721 27150 rpcz_store.cc:276] 0709 13:12:44.166986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.195309 (+ 28323us) service_pool.cc:224] Handling call
0709 13:12:44.247036 (+ 51727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.299581 (+ 52545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.299611 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.335744 (+ 36133us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.494395 (+158651us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:44.494455 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.494527 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.350681 (+856154us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b2400164078. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ead09c4 00007f9a4eaceacb 00007f9a4ec89dc9 00007f9a4ec89a55 00007f9a4ec88fb0 00007f9a518ff488 00007f9a518ffbe8 00007f9a518d7398 00007f9a518d276a 00007f9a518d1bb6
0709 13:12:45.351404 (+   723us) raft_consensus.cc:1685] finished
0709 13:12:45.351426 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.351637 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1812,"raft.queue_time_us":20766,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":21318,"spinlock_wait_cycles":39908736,"thread_start_us":77839,"threads_started":1,"wal-append.queue_time_us":720524}
I20260709 13:12:45.379760 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:45.347851 32653 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.366497   387 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.368721 32603 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.371712 32434 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.339630 31906 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.308993   398 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.346002   538 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.243s	user 0.006s	sys 0.000s
I20260709 13:12:45.385321 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:45.391088 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:45.388561 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.392835 27152 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:12:45.401989 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.402272 27195 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:45.402462 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.403229 27152 raft_consensus.cc:2393] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:45.403664 27836 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:45.402272 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.334106   358 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:45.398639 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:45.363885   470 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:45.405040 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.399335 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.405434 27305 raft_consensus.cc:2393] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 17: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:45.332669 27315 tablet_copy_source_session.cc:215] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:45.380393   503 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.409978 27148 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:45.388983   486 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:45.412657 27839 raft_consensus.cc:2368] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 17. Current term is 18.
I20260709 13:12:45.412822 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:45.415904 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.420533 31906 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.422369 27297 raft_consensus.cc:1240] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:12:45.422487 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.402752   465 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:12:45.428895   398 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.430305 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.431068 27305 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:45.431360   387 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.408931   353 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:45.409317   358 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.433045   545 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.409292   546 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.440428 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.468001 31906 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.489899 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:45.490613 27156 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.413036 32653 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.495745 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.496585 27302 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
W20260709 13:12:45.477545 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.499467 27301 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:45.499737 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:45.501274 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 90528us
I20260709 13:12:45.419852   459 raft_consensus.cc:2764] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:12:45.419863   512 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:45.504729 31906 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.507097 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:45.467219 32703 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.467710 32394 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.513233 27224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3614) took 1066 ms. Trace:
I20260709 13:12:45.468623   500 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.509521 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.513648 27224 rpcz_store.cc:276] 0709 13:12:44.446654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.447277 (+   623us) service_pool.cc:224] Handling call
0709 13:12:44.458534 (+ 11257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:44.461893 (+  3359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.461923 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:44.464318 (+  2395us) log.cc:844] Serialized 26 byte log entry
0709 13:12:44.702561 (+238243us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:44.702612 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.702678 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:45.345298 (+642620us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:45.508805 (+163507us) raft_consensus.cc:1685] finished
0709 13:12:45.508837 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.513131 (+  4294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5714,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1273,"spinlock_wait_cycles":9641216,"thread_start_us":202893,"threads_started":1,"wal-append.queue_time_us":519803}
I20260709 13:12:45.518025 27157 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:45.523402 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.525110 27836 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:45.524688 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.530587 31906 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.528666 27301 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:45.531631 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.532315   561 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:45.532697   561 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:45.508221   387 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.533579   561 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.534387   387 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.534919   561 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:45.536684   387 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.537173 27297 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:45.510905   543 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.537647 32434 consensus_queue.cc:1048] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:45.508474   353 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:45.539193   353 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.540690 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.541276 27832 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:45.542588 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.543284 27315 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:40558 (request call id 1137) took 1251 ms. Trace:
I20260709 13:12:45.543783 27315 rpcz_store.cc:276] 0709 13:12:44.292109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.292369 (+   260us) service_pool.cc:224] Handling call
0709 13:12:45.543176 (+1250807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:45.531769   552 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.542793 27299 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:45.543215 27832 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:45.548892 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.440165   503 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:12:45.556685 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:45.537779   543 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.559085 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:45.559988 31906 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:45.560544 31906 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.560911   543 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.559960 27835 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:12:45.560921 31906 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:45.566039 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.566946 27841 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:45.516021 32703 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.569550 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:45.575204 27297 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:45.569681 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.569962 32603 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:45.562806 27835 pending_rounds.cc:85] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 9
W20260709 13:12:45.571587 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 95186.8us
I20260709 13:12:45.467482   546 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.529923   470 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.599195 27302 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:45.598557 27835 pending_rounds.cc:107] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:45.600383 27835 raft_consensus.cc:2889] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:45.582931 27156 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
W20260709 13:12:45.600795 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 190206us
I20260709 13:12:45.574165   552 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.566864   543 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:45.603775 27804 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:45.554579   562 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:45.604595   398 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:45.604346 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 2032) took 1543 ms. Trace:
I20260709 13:12:45.605176   398 raft_consensus.cc:697] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:45.603569   543 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.605121 27840 rpcz_store.cc:276] 0709 13:12:44.060904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.061055 (+   151us) service_pool.cc:224] Handling call
0709 13:12:44.061469 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:44.074749 (+ 13280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:44.074783 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:44.079203 (+  4420us) log.cc:844] Serialized 52 byte log entry
0709 13:12:44.128441 (+ 49238us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:44.286921 (+158480us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.287779 (+   858us) log.cc:844] Serialized 14 byte log entry
0709 13:12:44.288154 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:44.288217 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:44.470809 (+182592us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:45.600613 (+1129804us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b240033be58. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ead09c4 00007f9a4eaceacb 00007f9a4ec89dc9 00007f9a4ec89a55 00007f9a4ec88fb0 00007f9a518ff488 00007f9a518ffbe8 00007f9a518d7398 00007f9a518d276a 00007f9a518d1bb6
0709 13:12:45.604133 (+  3520us) raft_consensus.cc:1685] finished
0709 13:12:45.604154 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:45.604292 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49638,"prepare.queue_time_us":145674,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":1083,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":3542,"spinlock_wait_cycles":115928832,"thread_start_us":126291,"threads_started":2,"wal-append.queue_time_us":34842}
I20260709 13:12:45.524722   500 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.560042 32653 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.614773 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.615904 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:45.618950 27148 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:45.619544 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.575982 32603 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.518679 32394 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.624709 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.623298 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.633846 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.624167 27301 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 9: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:45.624107 27153 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:45.622716 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:45.624701   542 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:45.624912 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.635406 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:45.630664   548 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:12:45.631022   555 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:45.634640 27153 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:45.606556   398 consensus_queue.cc:237] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.667292 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.643597 27836 raft_consensus.cc:2410] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:12:45.650637 27156 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:45.622155 32651 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.678525 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:45.643857 27155 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:45.678601 27306 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:45.660872 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:45.643082 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.678130 27299 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
W20260709 13:12:45.683610 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 95419.1us
I20260709 13:12:45.679441 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:45.681808   543 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:45.684687 27807 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.671s (SENT)
I20260709 13:12:45.679903 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:45.676540   558 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.683287 27150 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:45.687575 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:45.636706 32603 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.609625   470 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.641785   448 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:45.686738 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.690786 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2408) took 1181 ms. Trace:
I20260709 13:12:45.637065   542 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.694094 27304 rpcz_store.cc:276] 0709 13:12:44.504906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.505051 (+   145us) service_pool.cc:224] Handling call
0709 13:12:44.521001 (+ 15950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:45.321733 (+800732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:45.684649 (+362916us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54000a5354. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:45.686631 (+  1982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840086400}
I20260709 13:12:45.643991 32318 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:45.693732 27149 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 8.
I20260709 13:12:45.637267 32530 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.660575   394 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:12:45.722572 31906 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.714990 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.692768   562 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:45.695842   448 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.693199   511 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:45.715516   472 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:45.695945 32318 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.733115 31906 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:45.735268 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50628.4us
I20260709 13:12:45.687490 32651 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.743258 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:45.743916 27300 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:45.729490 27297 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:45.696385   542 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:45.730250   543 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.733112   353 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.746371 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:45.747347   512 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:45.747254   353 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.747862   512 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.747889 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.747602 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:45.748490   512 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.748751 27833 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:45.749258   546 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.749804   546 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:45.749948 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.750588 27149 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:45.751777 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:45.755756   512 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.756599   552 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.757102   564 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:45.758361   353 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.758908   353 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.759251   353 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.759595   353 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.760027   512 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:45.762167   532 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.125s	user 0.006s	sys 0.006s
I20260709 13:12:45.762915 27153 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.763929 27153 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.734225   448 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.735690   511 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.695489   558 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.772722 27833 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:45.732210   562 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:45.766040 32651 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.772791   543 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.739859   524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f560534ffa48878a9e4d4766199287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:45.783149   562 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:45.783234   569 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.772531   512 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.742535 32318 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:45.794576 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:45.778944   511 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:45.795754 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.796226 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:45.796927 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 49115.4us
I20260709 13:12:45.799238 27150 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
W20260709 13:12:45.808925   536 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.773s	user 0.010s	sys 0.000s
I20260709 13:12:45.811170 32530 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.811472 32394 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.813674 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1551) took 1155 ms. Trace:
I20260709 13:12:45.777910   358 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.814219   543 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:45.815814   358 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.816470 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:45.817313 32530 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:45.817734 32530 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.799129   512 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.818140 32530 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.819746   512 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.824626 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.798962   569 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.828326   569 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.828825 32705 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:45.825901 32696 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:45.836117 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.814100 27839 rpcz_store.cc:276] 0709 13:12:44.703981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.108124 (+404143us) service_pool.cc:224] Handling call
0709 13:12:45.813486 (+705362us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54004bc654. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:45.813614 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627180288}
I20260709 13:12:45.954836 27153 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 13:12:45.955623 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.956231 27153 pending_rounds.cc:85] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 8
I20260709 13:12:45.855505 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:45.956908 27153 pending_rounds.cc:107] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:12:45.857403 27226 raft_consensus.cc:1275] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:45.957438 27153 raft_consensus.cc:2889] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:45.852530 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 233000us
W20260709 13:12:45.957556 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 124840us
I20260709 13:12:45.856137 27230 raft_consensus.cc:1240] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:12:45.925223 27807 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.840s (SENT)
I20260709 13:12:45.958637 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:45.856469 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:45.960767 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.971946 32318 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.972424   558 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.972975   545 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:45.973877 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.859925 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:45.859428 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:45.976495 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:45.974788 27232 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:45.857736 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:45.842892   470 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.983644 27224 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
W20260709 13:12:45.963369   479 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.351s	user 0.012s	sys 0.011s
I20260709 13:12:45.981333 27223 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:45.978230 27225 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:45.981544 31906 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.977682 32318 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.983373 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:45.984982 31906 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.989753 31906 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.830030 32705 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.842527   542 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.992184   542 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:45.857568 32530 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.994127 32651 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:45.994572 32530 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.994729 32651 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.996788 32651 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:45.983695 32642 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:45.998884   578 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:45.833631   552 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:45.983566   358 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:46.001935 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.001554 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.002978 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.003537 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.008566 27154 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:45.860386 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.004504 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:45.839469   562 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.004616 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.023748 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.024021 27225 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.024338 27833 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:46.025691 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.026525 27833 raft_consensus.cc:2410] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:12:46.026384 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.005219 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.006516 31906 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:46.005174 32642 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:45.979043   573 log.cc:927] Time spent T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:12:45.851099 32603 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.029825 27835 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:46.033914 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.009262 27232 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:46.006794 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:46.010200 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 174200us
I20260709 13:12:46.010480   574 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.010720 32318 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.011556 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:46.011703 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.035394 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:46.039430 27224 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:45.835887   319 consensus_queue.cc:1059] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.172s
I20260709 13:12:46.012176   552 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:46.019194 27305 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:12:46.001425   479 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.012s	sys 0.012s
I20260709 13:12:45.835007   512 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:12:45.978421   569 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.022421 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.023047 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.035719   398 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.053187 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.053745 27152 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:12:46.054032 27153 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:46.023456 27231 raft_consensus.cc:2410] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:12:46.026959 27841 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:45.838866 32696 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:46.034287 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.847381   511 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.035905 31906 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:46.065773 31906 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.036798 27839 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:46.066154 31906 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.037053 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:45.858359   448 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:45.849344   353 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.028931 32642 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.043902 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.045077 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:46.046175   524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35846 (request call id 2037) took 1957 ms. Trace:
I20260709 13:12:46.046322   319 raft_consensus.cc:3055] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:46.046663   570 raft_consensus.cc:2764] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:12:46.046716 32653 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:46.048867 27229 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:46.049484 27154 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:46.010381   358 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.058091 27838 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:46.058840 27271 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:46.059285 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 134097us
I20260709 13:12:46.099117 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:46.101203 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 56195.3us
I20260709 13:12:46.099884 31906 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.067121 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.067477 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.103011 27228 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:46.064939 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:46.096575 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 44811.6us
I20260709 13:12:46.051548   553 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:46.077211 27225 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 11.
I20260709 13:12:46.057893   555 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:46.079147 27150 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:46.081173 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.092290 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.100172 27227 raft_consensus.cc:2368] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17.
I20260709 13:12:46.062455 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.104878 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.115695 27232 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:46.117451 27151 raft_consensus.cc:2410] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:12:46.093946   319 raft_consensus.cc:740] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:46.106609   546 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:46.107940   569 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:46.124132 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.110309   553 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.127092 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.148869   576 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.148s
I20260709 13:12:46.152247   512 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:46.068892   398 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.120718 32318 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:46.142583 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.166602 31906 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.151306 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:46.112000   470 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.176234   358 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.125880   555 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:46.154728   553 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.164301   546 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:46.164012   569 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:46.166275 32318 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.142102   570 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:12:46.086472   524 rpcz_store.cc:276] 0709 13:12:44.112660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.112854 (+   194us) service_pool.cc:224] Handling call
0709 13:12:44.285539 (+172685us) ts_tablet_manager.cc:934] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:12:45.643774 (+1358235us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:45.841239 (+197465us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:45.841357 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:46.045359 (+204002us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:46.045654 (+   295us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:46.045983 (+   329us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:46.046045 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":292,"tablet-copy.queue_time_us":155299,"thread_start_us":130969,"threads_started":2}
I20260709 13:12:46.192740   556 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:46.193356   559 raft_consensus.cc:2764] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:12:46.195644   398 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.186993   512 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:46.197521   448 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:46.202924 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 91686us
I20260709 13:12:46.198359 32696 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.170233   470 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.177234   562 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.121146   552 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.163098 32697 consensus_queue.cc:1048] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:12:46.207917 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 83840.2us
I20260709 13:12:46.232987 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.233675 27150 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:46.236819 32703 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:46.209566 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 108144us
I20260709 13:12:46.196337 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.238584 27151 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:46.238739   569 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.244336   555 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.245132 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.246359   511 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:46.246569 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.247777 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 61155.8us
I20260709 13:12:46.250751 27231 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:46.216614 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:46.191531 32603 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.201223 32318 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.222942   524 tablet_copy_client.cc:806] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:46.226514   500 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.231283   546 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.259081 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.208930   556 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.251173   470 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.263787 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.212957   512 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:46.266708 27223 raft_consensus.cc:2368] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13.
I20260709 13:12:46.262913 27150 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:12:46.280354 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:46.280504 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:46.281030 27301 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:46.276564 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:46.283716 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.286434 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.287370 27154 raft_consensus.cc:2393] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:46.289923 27122 leader_election.cc:400] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 17. Current term is 18.
I20260709 13:12:46.290423 27122 leader_election.cc:403] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.291672 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.293151 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:46.190737   319 consensus_queue.cc:260] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.298748 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:46.300128   398 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:46.300652   398 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:46.301119   398 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.309062 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:46.295928 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 79380.1us
I20260709 13:12:46.310101 27223 raft_consensus.cc:2368] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16.
I20260709 13:12:46.296916 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:46.310665 27297 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:46.312090 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:46.314545 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:46.315392 27305 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:46.317130 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.317838 27157 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.275712   556 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.317591 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:46.281345 32434 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:12:46.337518 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:46.309026   448 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:46.311527 32603 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:46.321645 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45089.4us
I20260709 13:12:46.311794   500 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:12:46.282528   512 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:46.351815 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:46.353506 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:46.354223 27303 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
W20260709 13:12:46.354338   581 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:46.341514 27302 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:46.352818 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.342478 27304 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:46.348380 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 58698.3us
I20260709 13:12:46.347687 27836 raft_consensus.cc:1240] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:46.360755 27807 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.295s (SENT)
I20260709 13:12:46.361286 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:46.361510 27297 raft_consensus.cc:2468] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:46.363447 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.324597   524 tablet_copy_client.cc:670] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:46.364689 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:46.367240 27301 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 18: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:46.321736   321 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:46.290812   570 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:12:46.297315   459 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:12:46.371620 27837 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 8.
I20260709 13:12:46.385560 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.384552 27157 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:46.360383   574 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:46.319463   353 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.380632 27299 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:46.388286 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:46.438270 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50092.7us
I20260709 13:12:46.390120 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.419935 27231 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:46.419800 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 57598.5us
I20260709 13:12:46.338481   589 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 17. Current term is 18.
W20260709 13:12:46.436122 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 83417.7us
I20260709 13:12:46.344329 32603 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:46.448411 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.365341 32703 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.441170 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:46.436156 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 77055us
I20260709 13:12:46.453976 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.336954 32696 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:12:46.370481   321 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:46.458678 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.439443 27149 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.472780   552 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:46.473230   552 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.473567   552 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.477190   398 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.478269 32651 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.470815 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.481490 32653 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.486193 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.486804 27232 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.487154 31906 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:46.488658 31906 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:46.488993 31906 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:46.489926 31906 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.491086 31906 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:46.495361 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.496531 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:46.497387   585 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:46.498018 32653 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.498112   585 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.500015   552 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.500963 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.501685 27224 raft_consensus.cc:2368] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:12:46.502524 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.503062 27225 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:46.506335   552 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.365437 32697 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 13:12:46.510339 27223 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:46.447505 32705 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.452078   555 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:46.542025 27840 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:46.517159 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.452879 32603 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.447777 32530 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:46.508688 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:46.522883 27225 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:46.543872 27272 leader_election.cc:400] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:12:46.521152 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:46.463212   465 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.466843   321 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.552250 27272 leader_election.cc:403] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.557194 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:46.453569   574 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.571493 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.572219 27225 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.564867 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.573378 27226 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:46.578783 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:46.523533 32651 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:12:46.555030 32394 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:46.584123 27232 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:46.561559   589 raft_consensus.cc:2764] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:12:46.555159 32530 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:46.588676 27157 raft_consensus.cc:3055] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:46.591322 27157 raft_consensus.cc:740] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:46.592175 27225 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:46.585754   379 raft_consensus.cc:3060] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.598747   559 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:46.603906 32530 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.605229 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.606073 27272 leader_election.cc:400] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17.
W20260709 13:12:46.666432 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 65588.4us
I20260709 13:12:46.666656 27272 leader_election.cc:403] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:46.551466 32705 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.654996 27157 consensus_queue.cc:260] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:46.674326 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 68471.2us
W20260709 13:12:46.684755   595 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:12:46.685904 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.689739 27231 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:46.691674 32705 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:46.694494   594 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:12:46.695159   601 consensus_queue.cc:1059] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:12:46.696017   601 consensus_queue.cc:1243] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:46.605165 32394 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:46.702883 32394 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.715112 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:46.716024 27151 raft_consensus.cc:2410] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:12:46.716365 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.717298 27806 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.718003   472 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.718498   472 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.720567   472 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.721103   472 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:46.721427   472 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.721755   472 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:46.729477   558 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.737248 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.581705   569 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:12:46.734836 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:46.750468 27806 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.751157 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.771212 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.771898 27230 raft_consensus.cc:2368] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13.
I20260709 13:12:46.752303 27229 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:12:46.772595 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.773183 27230 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:46.774015 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.776086 27298 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:46.776636 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.773203 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.753073 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.749312 32703 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.683552   555 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:12:46.798379 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.795083 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:46.800321 27226 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:46.754978   553 consensus_meta.cc:287] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
W20260709 13:12:46.757131   597 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:12:46.758587 32318 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.760586 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.762741   398 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.766894 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.767077   512 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.768482   500 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:46.768546   574 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.783129 27229 raft_consensus.cc:2368] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16.
I20260709 13:12:46.783283   556 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.785962   576 raft_consensus.cc:2804] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:46.799805   569 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:46.786147   319 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:46.786525 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.788657 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:46.845745 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.797919   470 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.851332 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:46.851884 27834 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:46.853101 27833 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:46.804716   353 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:46.855454 27835 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:46.856005 27837 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:46.847512 27231 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:46.814942   559 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:46.804423 27272 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:46.807948 27153 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:12:46.805989 27838 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
W20260709 13:12:46.865145 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60801.6us
I20260709 13:12:46.775439   379 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:12:46.858217   470 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:46.823553 27223 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:46.799850 32703 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.867774   572 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:46.828972 27841 raft_consensus.cc:1240] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:46.865005 32642 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.831446 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.872674 32642 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.874804 32642 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.833843 27225 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:46.876654   601 consensus_queue.cc:1059] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:46.877238   512 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:46.877694   601 raft_consensus.cc:3055] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:46.878168   601 raft_consensus.cc:740] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:46.879108   601 consensus_queue.cc:260] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.880335   601 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.747339   558 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.835145   500 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:46.883775   558 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.884209   500 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.841045 32603 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:46.886133   598 log.cc:927] Time spent T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.327s	user 0.001s	sys 0.002s
I20260709 13:12:46.886557 32603 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.813158   553 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:46.843451 27298 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.858214 27224 raft_consensus.cc:1240] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:46.859122 27157 raft_consensus.cc:3060] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.804869 27149 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:46.865804 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:46.867157   317 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:46.884644 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.893141 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:46.890964   553 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:46.844241   569 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:46.932978 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.814622   459 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:12:46.842980   448 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:46.937549 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 148602us
W20260709 13:12:46.942472 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.920580   571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.044s	sys 0.048s
I20260709 13:12:46.943856 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:46.904398 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:46.978124 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 73787us
W20260709 13:12:46.989174 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50110.9us
W20260709 13:12:46.989296 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46175us
I20260709 13:12:46.936329   574 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:46.941072   569 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:46.865659   353 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.028692 27157 raft_consensus.cc:1275] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:46.864861   559 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:47.007460   596 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:47.040887 27149 raft_consensus.cc:1275] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:46.953920   317 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:47.044894 27837 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:12:46.961514   571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.045s	sys 0.048s
I20260709 13:12:46.952652   583 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:47.053361 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.055037 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.009423   465 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:47.059367 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:47.071949 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.049978   564 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:12:47.022284   574 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:47.050963   559 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.080466 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:46.953646   448 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.088351 27230 raft_consensus.cc:2368] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 10. Current term is 11.
I20260709 13:12:47.009238   358 consensus_queue.cc:1059] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:12:47.067049   465 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:47.099838 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.086001   574 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.112918   317 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.105702   465 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:47.127846   609 log.cc:927] Time spent T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:12:47.131470   321 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:12:47.131927   321 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.117657   353 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:47.118585   610 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:12:47.119627   472 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.127745   589 raft_consensus.cc:3055] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:47.075366   470 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:12:47.135289   465 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.162943   465 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.140362 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:47.115875   614 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:47.164091 27837 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:47.164521   398 consensus_queue.cc:1048] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:47.166144   448 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.116633   556 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.164577 27227 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:47.079936 32318 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.140947 27195 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:47.154868 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:47.169492 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.155511 27149 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:12:47.181210 27298 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:12:47.182636 27305 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:47.182261 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 87366.7us
I20260709 13:12:47.156780   589 raft_consensus.cc:740] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:47.194657 27837 raft_consensus.cc:1240] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:47.190665   576 raft_consensus.cc:697] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:47.198849 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.201570   589 consensus_queue.cc:260] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.202369 27832 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.205027 27225 raft_consensus.cc:1240] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:47.202641 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.213850 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:47.215713 27123 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.573s (SENT)
I20260709 13:12:47.216176 27123 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.222101   576 consensus_queue.cc:237] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.227149 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.228148 27227 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:47.229207   601 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:47.233304 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.235059 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:47.237455   358 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:47.208636   593 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:12:47.242919 27149 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:47.242578   570 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:47.245954 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.247064 27225 raft_consensus.cc:2410] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:12:47.245411   321 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.254642 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:47.255723 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 443146us
I20260709 13:12:47.257313 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.257573 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.259053 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.260535 32703 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.262156   546 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:47.268239 27225 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: [10.10-13.11]
I20260709 13:12:47.185542   353 raft_consensus.cc:2804] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:47.277696 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.282500 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.287081 27155 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 19.
I20260709 13:12:47.287285 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:47.280277 27807 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.526s (SENT)
I20260709 13:12:47.288241 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.284857 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.285760 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.290148 27224 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.265848   569 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.287504 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.292536 27228 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:47.293321 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.294998 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.295470 27227 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
W20260709 13:12:47.302804   555 consensus_meta.cc:287] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 13:12:47.303373   555 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17.
I20260709 13:12:47.306308 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.306795 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.307389 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.307971 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.308380 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.308566 27232 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:47.309005 27223 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:47.309530 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.310385 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.310739 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.311062 27226 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:47.311661 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.312175 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.311915 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.312899 27226 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:47.313541 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.313952 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.314311 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.314692 27226 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:47.315538 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.309901 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.316152   472 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.316293 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.316943 27223 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:47.314603 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.323246 27232 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:47.328858 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.330803 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.332497 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.333168 27226 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:47.209103   566 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:12:47.346542 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.359123 27838 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.360388 27231 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:47.328745 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.367765 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.370704 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:47.373310 27304 raft_consensus.cc:1240] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:12:47.373472 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.374037 27832 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:47.374383 27840 raft_consensus.cc:2393] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.286849   353 raft_consensus.cc:697] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:47.375841 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 138094us
I20260709 13:12:47.376791 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:47.378485 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.334702 32703 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.386590 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.416441 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.425740 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.426083 27228 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:47.378715   500 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:47.429227 27839 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:47.430939 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.431483 27227 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.369624   601 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:12:47.441823 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.442728 27839 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:47.443440 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.427673   546 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:47.428346   500 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.445802 27835 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 9: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.445856 27224 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:47.458791 27838 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:47.444461   358 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:47.461648 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.447263   500 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:47.466291 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.466984 27838 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.470541 27839 raft_consensus.cc:2393] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.497035 27838 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:47.504747 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.449038   546 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.509506 27838 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:47.511919 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.482527   574 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.516440 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.516260   358 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.519435 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:47.522985   636 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:12:47.523988   637 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:47.537606 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:47.538441   643 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:47.580762 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.582022   643 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.582279   561 consensus_queue.cc:1059] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:47.572346 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 482762us
I20260709 13:12:47.546258   572 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.549453 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.486483   644 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:12:47.586953 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:47.553900   616 log.cc:927] Time spent T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: Append to log took a long time: real 0.327s	user 0.003s	sys 0.003s
I20260709 13:12:47.556764 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.559453 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.560220 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.560451 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.560943 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.592905 27840 raft_consensus.cc:2368] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:47.466395   559 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.567898   546 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.568910   593 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:47.569584 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.446796   353 consensus_queue.cc:237] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.571231 27832 raft_consensus.cc:1240] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:12:47.571856 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.573853 27839 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:47.576659   632 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:47.601982   632 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:47.571264 32318 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.604259   633 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:47.605939   583 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:47.606506   559 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.539546   574 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.606941   583 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.585337 27227 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
W20260709 13:12:47.608078 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.582561   643 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:47.593576 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.594321 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.594516 27807 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:47.610958 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.572147   601 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:47.595767 27223 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:47.606117   593 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:47.609243 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 526655us
I20260709 13:12:47.614732 27807 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.590103   572 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:47.586118 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:47.587401 27226 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:47.591442 32703 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.612495 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:47.614271 27232 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:47.598757 27122 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:47.616405 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.619253 27833 raft_consensus.cc:2393] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.620258 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:47.616600 27123 leader_election.cc:400] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 15. Current term is 16.
I20260709 13:12:47.613005   459 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.622907 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.623751 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:47.623067 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:47.609426   564 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:47.625725 27839 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.626024 27840 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:47.627627 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.612932   643 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:47.634514 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.630391 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.618549   542 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.641283 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.624502   562 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.622736   569 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.624293 32530 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.625167   574 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.648768 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:47.651440 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 394825us
W20260709 13:12:47.660256 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.629663   564 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:47.632347   398 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.633843 32318 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:47.637305   545 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.675647 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.659925   576 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:47.681566 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.624162   601 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.631412   512 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:47.637399   641 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:12:47.690615 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:47.649926   642 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:47.701726 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 66663us
I20260709 13:12:47.683523 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:47.624786 32703 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.704970 27299 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:47.705727   651 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:12:47.710988 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:47.734499 27298 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:47.715998 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:47.736979 27297 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:47.738123   635 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:47.738947   652 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:47.747793   643 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.721113 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:47.721463   601 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.723024   545 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:47.724052 27837 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:47.725248 32703 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.688710   398 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:47.684610   574 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:47.768132   574 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.727696   500 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.662258   465 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:12:47.771752   500 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.730279   576 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:47.730216 32697 consensus_queue.cc:1059] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:47.723155   593 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.684553   379 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:47.752619 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48706.3us
I20260709 13:12:47.754866   545 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:47.763851   632 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:47.775254 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54196.2us
I20260709 13:12:47.824249   589 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:47.809485   640 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:47.831451   640 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.833588   640 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:47.834132   319 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:47.835618   545 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.836784   545 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:47.842569 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.844494 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:47.845387 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:47.782796 27298 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:47.688434 32530 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:12:47.836092   465 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.845942 27150 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.814165 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:47.849900 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:47.813840 32434 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.854451 27151 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:47.856594 32434 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.858914 32434 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.850471   317 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:12:47.866132   465 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:47.848249   632 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.868220   465 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.813818   379 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:47.870733 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58020us
I20260709 13:12:47.871824 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:47.872597   379 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:47.873296   379 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:47.877254 27231 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:12:47.884827   635 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:47.885493   635 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:47.808894   556 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:47.886581   556 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.886927   556 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:47.887300 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:47.887881 27229 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:47.895177 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.895406 27150 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 10.
I20260709 13:12:47.895763 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.896528 27840 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:47.893391 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:47.784626 27299 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
W20260709 13:12:47.902582 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 266459us
I20260709 13:12:47.939029 27151 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:47.942514 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.943349 27837 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:47.899355 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:47.944190 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44934.9us
I20260709 13:12:47.945945 27304 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:47.947851 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:47.847673   321 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.953819 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:47.749423   564 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:47.964674 27150 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:47.967844 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:47.901090   379 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:47.952602   317 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:47.854007 32697 consensus_queue.cc:1048] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:12:47.950613   465 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:47.976076   524 tablet_copy_client.cc:538] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:47.965181 27122 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:47.947193 32434 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:12:47.991065 27150 raft_consensus.cc:2468] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 20.
I20260709 13:12:47.992377 27804 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:47.992393 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52004.5us
I20260709 13:12:47.997197 27197 leader_election.cc:400] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:47.997575 27197 leader_election.cc:403] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:47.971688   561 consensus_queue.cc:1175] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "897d8be8580141d1ad3bb17946d3da89" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: [12.9-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:47.984364   465 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.968053   641 consensus_queue.cc:1059] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:47.983417   558 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:48.025895   558 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:48.022464 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.974254   572 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.004455   619 raft_consensus.cc:2804] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:12:48.067013 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 119600us
I20260709 13:12:48.071691 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.072750 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.074287 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.075350 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.031994   465 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.079299 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.074258 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.081400 27304 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:48.083410 27807 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:48.083671   675 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.084599 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:48.087173 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.034078   643 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.090976 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.091257 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.091578 27300 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:12:48.095455 27303 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:12:48.085376 32703 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:48.093626 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:48.034343   669 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:48.102542 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:48.103690 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:48.104866 27807 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:48.106455   576 raft_consensus.cc:2804] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:48.106737 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.107411 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.108999 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.109884 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.110378 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.110513 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.114398 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.115368 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.116815 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.109752 27301 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:48.121795 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.126276 32318 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:48.126852 32318 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:48.127346   398 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:48.067340 32530 consensus_queue.cc:1059] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:48.127777   398 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:48.128201   398 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:48.122617   660 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:48.093551   652 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:48.135474   655 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.435s	user 0.003s	sys 0.000s
I20260709 13:12:48.096773   675 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.137547   675 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.127794 32318 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.138881   558 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.139436   635 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.141537   635 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:48.110626 27306 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 17: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:48.138783 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.125769   556 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.097206   619 raft_consensus.cc:697] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
W20260709 13:12:48.148628   620 log.cc:927] Time spent T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:12:48.154465 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.156699 27299 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:48.079874   662 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:12:48.156900 27298 raft_consensus.cc:2468] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:48.160239 27302 raft_consensus.cc:2368] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 17. Current term is 18.
I20260709 13:12:48.158650 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.170864 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.171103 27304 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:12:48.171456 27298 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:48.174505 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.175264 27306 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:48.256008 27303 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:12:48.257038   672 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:48.283779 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.154985   576 raft_consensus.cc:697] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:48.095166   379 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:48.325738 27298 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
W20260709 13:12:48.343745 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.366511 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.382359 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.384693 27806 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:48.389868   679 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.390620   679 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.393174   679 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.393783   679 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.395650 27298 raft_consensus.cc:3060] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.341785   652 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.405105 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.364450   542 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.417557 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.420296 27306 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:48.417812 27298 raft_consensus.cc:2468] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
W20260709 13:12:48.408064   632 consensus_meta.cc:287] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:12:48.453356   556 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.454383 32703 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.455164 32703 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.458994 32703 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.425818   572 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.398572   619 consensus_queue.cc:237] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.417812   652 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.419826   542 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.465049   398 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.425608   576 consensus_queue.cc:237] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.490346 27297 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 10. Ops: []
I20260709 13:12:48.475991 27157 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
W20260709 13:12:48.472075   545 consensus_meta.cc:287] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.002s
I20260709 13:12:48.494664   398 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:48.495597   542 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.499282 27299 raft_consensus.cc:2393] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 11: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:48.528682 27838 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:48.526611   652 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.536845 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.541846 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.547847 27300 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:48.582880   524 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Bootstrap starting.
I20260709 13:12:48.586273   652 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.586972   652 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.589172   652 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.589690   652 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.589898   465 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:48.614908   585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.023s	sys 0.082s
W20260709 13:12:48.619781   585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.023s	sys 0.082s
I20260709 13:12:48.611042   652 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.643545   652 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:48.656265   654 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.965s	user 0.008s	sys 0.034s
I20260709 13:12:48.665350   564 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.672806 32530 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:48.673240 32530 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:48.674106 32530 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.675599 32530 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:48.681882   680 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.682446   680 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:48.684656   680 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.687397   387 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:48.687856   387 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:48.688757   387 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.693480 32697 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.693981 32697 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.696188 32697 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:48.698683 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 743342us
W20260709 13:12:48.699577   653 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 1.007s	user 0.000s	sys 0.014s
W20260709 13:12:48.699883 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.701694   642 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:48.690043   387 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:48.704638 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.706959 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 375303us
I20260709 13:12:48.712894   639 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.711742   574 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.714771   639 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.715086   574 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.716329   570 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.716815   570 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.717207   574 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.717829   574 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.718578   574 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.721521 27269 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:48.722988 27269 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:48.717828   639 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.726318 32434 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:48.727295   642 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:48.727766   676 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:48.728634   570 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.728346   642 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:48.729406   676 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.730260   578 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:48.730352 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.731385   678 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:48.731875   678 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:48.734493   658 log.cc:927] Time spent T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.039s	user 0.012s	sys 0.007s
I20260709 13:12:48.738451 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:48.747531   545 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.730015   676 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.748157   545 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:48.750866   545 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.750798   676 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.753000   574 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.753759   545 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:48.754303   545 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.756592   545 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.758235   318 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:48.761665   668 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:48.762036   668 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.762377   668 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:48.768337 27229 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:12:48.771106 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:48.771669 27232 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:48.747732   678 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.781771 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:48.782595 27227 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:48.787937 27223 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:48.790390 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:48.792620   555 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:48.793129   555 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:48.793510   657 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:48.794317   656 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:48.794835   656 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.796859   656 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.797937   676 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:48.794019   657 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.801510   657 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.803028   555 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:48.805509 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:48.806104 27227 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:48.807928 27272 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:48.808506   319 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:48.809725   319 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.810118   319 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:48.808422   668 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.808965   678 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:48.813941 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:48.814839 27232 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:48.815991 27835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1193) took 1259 ms. Trace:
I20260709 13:12:48.818598 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:48.826602 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 441971us
I20260709 13:12:48.832777 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:48.833578 27224 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:48.817987   676 raft_consensus.cc:2804] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:48.816443 27835 rpcz_store.cc:276] 0709 13:12:47.556103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.559481 (+  3378us) service_pool.cc:224] Handling call
0709 13:12:47.559797 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.607647 (+ 47850us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:47.625018 (+ 17371us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.500505 (+875487us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18003a8e20. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec2ce07 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b 00007f9a518d6d23 00007f9a518d723a 00007f9a51d41a2a
0709 13:12:48.811617 (+311112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.811673 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:48.811720 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.815785 (+  4065us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400661a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:48.815831 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.815941 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6871,"prepare.queue_time_us":24791,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":86,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":118377088,"thread_start_us":310833,"threads_started":1}
I20260709 13:12:48.846201 27303 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:48.825872   668 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.852097 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:48.867100 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:48.867816 27299 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:48.867803 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.869037 27304 raft_consensus.cc:2368] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15.
I20260709 13:12:48.874501 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.875514 27297 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:48.882030 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.887810   674 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:48.888062 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.888345   674 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:48.888769   674 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:48.869839   676 raft_consensus.cc:697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:48.890805 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.891480   676 consensus_queue.cc:237] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:48.894574   541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.056s	sys 0.152s
W20260709 13:12:48.895040   541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.056s	sys 0.152s
I20260709 13:12:48.895134   465 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:48.896020 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:48.901888 27224 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:48.944983 27299 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 19.
I20260709 13:12:48.949960 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:48.955929 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.960119 27833 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:48.959872   472 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.962352 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:48.962670   682 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:48.962997 27838 raft_consensus.cc:3060] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:48.966435   576 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.967209   572 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.967036   576 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.967789   572 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.961597   472 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.970011   572 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.972548   472 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.969429   576 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.948980   500 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:48.977072   500 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:48.979144   500 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:48.988551 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:48.979162 27838 raft_consensus.cc:2468] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:48.960589   318 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:48.997511 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:48.990553   566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.288s	user 0.019s	sys 0.062s
W20260709 13:12:49.011087   566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.019s	sys 0.062s
I20260709 13:12:49.015388 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:49.016059 27832 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.017498   576 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.018097   576 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.018723 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:49.020212   472 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:49.021045   576 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:49.033337 27806 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:49.007948   500 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.040136 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.044910 27224 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.041823 27227 pending_rounds.cc:85] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 7
I20260709 13:12:48.980309   585 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:12:49.045468 27227 pending_rounds.cc:107] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:12:49.077860 27227 raft_consensus.cc:2889] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.078388 27227 pending_rounds.cc:107] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:12:49.078665 27227 raft_consensus.cc:2889] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:49.056061 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.029991 27832 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:49.026932   318 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:49.091960 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 58744.1us
I20260709 13:12:49.099287 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.099486 27224 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:49.108369 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.109979 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.112534 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.125216 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.126576 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.118651 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:49.086196   576 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.131438 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:49.131841 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:12:49.121531 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 420499us
I20260709 13:12:49.137046 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.137831 27224 raft_consensus.cc:2368] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10.
I20260709 13:12:49.110841   585 consensus_queue.cc:1243] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer f4afe81810944d70bc2cc31754392f3d log is divergent from this leader: its last log entry 20.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:12:49.092444   685 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.163152 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:49.168565 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.163175 27228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3667) took 1281 ms. Trace:
I20260709 13:12:49.121305   642 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.134701   465 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.087956   500 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.135831   668 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:49.134444   564 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.203199 27151 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:12:49.199843 27224 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:49.212435 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 75899us
I20260709 13:12:49.136027   572 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.142205   639 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.220862 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.226217 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.226459 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.227324 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.159698   632 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.160101 32703 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.228849 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.240620 27833 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:49.198014 27228 rpcz_store.cc:276] 0709 13:12:47.881673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.882141 (+   468us) service_pool.cc:224] Handling call
0709 13:12:47.882422 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.882635 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:12:48.068868 (+186233us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.670260 (+601392us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800304060. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:12:49.162886 (+492626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:49.162934 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:49.162975 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.163032 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.163127 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11847,"prepare.queue_time_us":188050,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1810,"raft.queue_time_us":602727,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":27374976,"thread_start_us":649567,"threads_started":2}
I20260709 13:12:49.229179 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:49.237707 27832 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:49.212163   601 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.242667   601 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:49.244357 27148 raft_consensus.cc:1240] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:49.245374   601 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:49.223752   564 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.248339   564 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.249363 27299 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:49.218950   465 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.252698   465 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.253893 27835 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:49.222893 27151 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:49.255478 27838 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:49.256263 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.257004 27149 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:49.238612 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.219657   642 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.262535 27156 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
W20260709 13:12:49.265620 27298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.036s
W20260709 13:12:49.267176 27298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.005s	sys 0.036s
I20260709 13:12:49.267904 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.268321 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.270380 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.273116 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.274390 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.274641 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.275328 27840 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:49.217299   358 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.276136 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.154148   576 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.276750 27297 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:49.277261 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.277806 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.266520 27224 raft_consensus.cc:3055] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:49.290354 27224 raft_consensus.cc:740] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:49.294070 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.227936   668 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:49.239631   641 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.305383 27156 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:49.291371 27224 consensus_queue.cc:260] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.313337 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.316232 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.321561 27224 raft_consensus.cc:3060] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.255180   472 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:12:49.228367   572 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.461557   694 consensus_queue.cc:1059] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:49.441562 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:49.462860   572 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:49.377287 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.463570   576 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:49.464219 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.285368   564 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:12:49.462857 27297 raft_consensus.cc:606] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:49.467876 27297 raft_consensus.cc:614] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:49.379132 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.470777 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.470867 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:49.471531 27228 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:49.472064   459 raft_consensus.cc:3055] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:49.472450   459 raft_consensus.cc:740] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:49.240700   639 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.473284   459 consensus_queue.cc:260] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:49.474859   639 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.475692   695 raft_consensus.cc:3055] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:49.476087   695 raft_consensus.cc:740] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:49.472517 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:49.476895   695 consensus_queue.cc:260] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.387804 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.478312 27153 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:49.479909 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.480342 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.480818   500 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:49.317581   559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.038s
I20260709 13:12:49.481988   642 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:49.482286   559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.021s	sys 0.039s
I20260709 13:12:49.479380 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.222249   318 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.265234   632 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.378973   657 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.297848   358 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:49.387051   545 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.398334   512 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.321594 27837 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
W20260709 13:12:49.416855   690 log.cc:927] Time spent T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:12:49.374490   641 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.447832 27224 raft_consensus.cc:1275] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:49.451551   570 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.456290   652 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:49.480643 27225 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:49.483659 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.404806 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.532016 27149 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:49.486044 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.481725 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.465651 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:49.534119 27151 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:12:49.535190 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:49.271067   353 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.025s	sys 0.024s
I20260709 13:12:49.477522 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:49.453132   689 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:12:49.444952   700 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:49.515900 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:49.524590 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.550698 27224 raft_consensus.cc:2368] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15.
I20260709 13:12:49.277797 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:49.526113 27153 raft_consensus.cc:1240] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:49.512756   695 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:49.555173 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 84416.8us
I20260709 13:12:49.556435 27123 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:49.558065 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 280305us
I20260709 13:12:49.543349 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.544247 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:49.545122 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:49.552752 27836 raft_consensus.cc:1240] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:49.554123 27151 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:12:49.562269 27151 pending_rounds.cc:85] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 8
I20260709 13:12:49.562572 27151 pending_rounds.cc:107] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:12:49.562852 27151 raft_consensus.cc:2889] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:49.571167 27153 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:49.571609 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.559897 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:49.540089   353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.025s	sys 0.024s
I20260709 13:12:49.529125   593 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:49.552491   319 consensus_meta.cc:287] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.742s	user 0.004s	sys 0.007s
I20260709 13:12:49.519121   657 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.594923 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:49.593371 27225 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:49.457226   668 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.524274   512 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:49.519539   545 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:49.596886 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.572566   619 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:49.598647 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:49.620987 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64609.2us
I20260709 13:12:49.657476 27123 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.582736   696 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:49.662679 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 64134.8us
I20260709 13:12:49.546697   570 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.667456 27123 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.583325   639 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:49.591325   698 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:49.670768 27150 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.020s	sys 0.033s
I20260709 13:12:49.548031   652 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.673746 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.591456 32703 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.668310 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.605324   642 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:49.679809 27150 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.020s	sys 0.033s
I20260709 13:12:49.596218   500 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:49.572263   700 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.689002 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:49.669638   353 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
W20260709 13:12:49.677927   686 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 13:12:49.694839   703 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:49.694514   353 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:49.696652   512 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:49.669512   601 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:49.676139   574 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:49.674908   561 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:49.703310   644 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:49.706902   358 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:49.662235   593 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.712342   545 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:49.728466   707 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:12:49.593829   697 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 13:12:49.665228   619 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:49.692377 32703 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.757406   601 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.618909   319 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.759665   642 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:49.693275   696 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:49.739763   500 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.674670   639 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.773867   574 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:49.758175 27148 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:49.777439   619 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:49.786825   601 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:49.759451   512 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.790613   684 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.888s	user 0.006s	sys 0.004s
I20260709 13:12:49.788384   632 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.591815   564 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:12:49.766776 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.805621 27269 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.809463   593 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.812063   353 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:49.813324   570 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.814649   321 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:49.815227   321 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:49.815690   321 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:49.818159   678 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:49.818686   678 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.819121   678 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.822405   512 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:49.823349   715 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:49.826970   657 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:49.827862   693 log.cc:927] Time spent T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:12:49.827986 27230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3683) took 1015 ms. Trace:
I20260709 13:12:49.828552 27230 rpcz_store.cc:276] 0709 13:12:48.812950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.815756 (+  2806us) service_pool.cc:224] Handling call
0709 13:12:48.816073 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.816416 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.816446 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.816918 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.229641 (+412723us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:49.229686 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.229759 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.727691 (+497932us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:49.827681 (+ 99990us) raft_consensus.cc:1685] finished
0709 13:12:49.827703 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.827924 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1041,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":8054,"spinlock_wait_cycles":2804480,"thread_start_us":400108,"threads_started":1,"wal-append.queue_time_us":598752}
I20260709 13:12:49.830403   641 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:49.803436   706 log.cc:927] Time spent T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:12:49.832223 27232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3685) took 1013 ms. Trace:
I20260709 13:12:49.832564 27232 rpcz_store.cc:276] 0709 13:12:48.818391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.819122 (+   731us) service_pool.cc:224] Handling call
0709 13:12:48.819503 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.819894 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.819936 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.820488 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.206792 (+386304us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:49.206850 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.206931 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.832013 (+625082us) raft_consensus.cc:1685] finished
0709 13:12:49.832034 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.832162 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":824,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2915,"thread_start_us":360972,"threads_started":1,"wal-append.queue_time_us":588029}
W20260709 13:12:49.835196   710 log.cc:927] Time spent T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:49.771956 32394 consensus_queue.cc:1059] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:12:49.787050   699 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:12:49.745716 27806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.011s	sys 0.058s
W20260709 13:12:49.866911 27806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.011s	sys 0.058s
W20260709 13:12:49.867247 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 722202us
I20260709 13:12:49.868171 27806 leader_election.cc:400] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15.
W20260709 13:12:49.794029   688 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.487s	user 0.002s	sys 0.007s
W20260709 13:12:49.827129   712 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:49.791191   639 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:49.868814 27806 leader_election.cc:403] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:49.837597   702 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:12:49.803042   379 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.856600   585 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.879423 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.783704 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 364803us
I20260709 13:12:49.874069 27297 raft_consensus.cc:606] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:49.896154 27297 raft_consensus.cc:614] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:49.886499   319 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:49.888316   652 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:49.866757   699 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:49.892308 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.893330 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.883888 27806 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:49.889786 32394 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:49.924796 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:49.893913   555 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:49.917842   541 raft_consensus.cc:3055] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:49.946113   545 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:12:49.939325 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:49.956624 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.999010 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.929433   652 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15.
W20260709 13:12:49.961737   702 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:12:50.013356   688 log.cc:927] Time spent T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:49.814670   574 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.905562   585 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:49.900353   379 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:49.953897   541 raft_consensus.cc:740] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:49.939095   353 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:12:50.028085   512 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:50.113204 27272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.000s	sys 0.016s
W20260709 13:12:50.113794 27272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.000s	sys 0.016s
I20260709 13:12:50.011963   555 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.021342   713 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:50.035254   722 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:12:50.118655 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 455105us
I20260709 13:12:50.137079 27839 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:50.119632   500 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:50.122673   353 consensus_queue.cc:1243] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:50.156280 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.157087 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.158232 27838 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:50.161711 27301 raft_consensus.cc:1240] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:50.155057 27150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 3011) took 1015 ms. Trace:
I20260709 13:12:50.163447 27229 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:50.124759 32703 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:50.168479 27150 rpcz_store.cc:276] 0709 13:12:49.140128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.140295 (+   167us) service_pool.cc:224] Handling call
0709 13:12:49.140555 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.140724 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:49.688982 (+548258us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.154618 (+465636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.154686 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:50.154767 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.154860 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.154990 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":450366,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1280,"thread_start_us":991054,"threads_started":2}
I20260709 13:12:50.123636   713 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:50.112102   700 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.129315   722 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:50.177170 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.016s
W20260709 13:12:50.210067 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.003s	sys 0.016s
I20260709 13:12:50.024657   699 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.212046 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.215859 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:50.216802 27298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1170) took 1940 ms. Trace:
I20260709 13:12:50.217166 27223 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:50.155673   652 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.217474 27123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.005s
W20260709 13:12:50.222344 27123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.013s	sys 0.005s
W20260709 13:12:50.223162 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 534214us
W20260709 13:12:50.224699 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 340861us
I20260709 13:12:50.226693 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.227818 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.176009   353 raft_consensus.cc:3055] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:50.219676 27298 rpcz_store.cc:276] 0709 13:12:48.276242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.422137 (+145895us) service_pool.cc:224] Handling call
0709 13:12:48.422549 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:48.711305 (+288756us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:48.711579 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.299149 (+587570us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:49.307152 (+  8003us) log.cc:844] Serialized 52 byte log entry
0709 13:12:49.307342 (+   190us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:49.307389 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.307487 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.825663 (+518176us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:50.174617 (+348954us) raft_consensus.cc:1685] finished
0709 13:12:50.216593 (+ 41976us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.216746 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307261,"prepare.queue_time_us":637,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":6795,"raft.queue_time_us":322116,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9260,"spinlock_wait_cycles":114024832,"thread_start_us":555794,"threads_started":1,"wal-append.queue_time_us":812527}
I20260709 13:12:50.234359 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.236874 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.239373 27229 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:50.226614 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.181288   713 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:50.251330 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.244762 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.253599 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.248308 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.213658   722 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:50.260416 27301 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:12:50.275074   682 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.275556   719 log.cc:927] Time spent T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:12:50.275694   682 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:50.279924   729 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:50.281566 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.282339 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3547) took 1078 ms. Trace:
I20260709 13:12:50.300928 27152 rpcz_store.cc:276] 0709 13:12:49.203630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.220883 (+ 17253us) service_pool.cc:224] Handling call
0709 13:12:49.221167 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.221505 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.221545 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.228095 (+  6550us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.739427 (+511332us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:49.757924 (+ 18497us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.758264 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.758373 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.282122 (+523749us) raft_consensus.cc:1685] finished
0709 13:12:50.282142 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.282283 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5516,"prepare.queue_time_us":21020,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3452,"raft.queue_time_us":23485,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":8716,"thread_start_us":432746,"threads_started":1,"wal-append.queue_time_us":743411}
I20260709 13:12:50.282223   387 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:50.285131   585 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.143229   541 consensus_queue.cc:260] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.285737 27223 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
W20260709 13:12:50.286698   714 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:12:50.290670   737 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.306486   619 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.004s
I20260709 13:12:50.307159 27227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2442) took 1266 ms. Trace:
I20260709 13:12:50.306887   737 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.307571 27227 rpcz_store.cc:276] 0709 13:12:49.041039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.041191 (+   152us) service_pool.cc:224] Handling call
0709 13:12:49.041571 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.079374 (+ 37803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.079403 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.088161 (+  8758us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.573325 (+485164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:50.168760 (+595435us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.173200 (+  4440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.173301 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.306967 (+133666us) raft_consensus.cc:1685] finished
0709 13:12:50.306986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.307104 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3384,"prepare.queue_time_us":565939,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":121331,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":897443,"threads_started":2,"wal-append.queue_time_us":942972}
I20260709 13:12:50.309670   737 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.240123   652 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.293488   379 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:50.296450   685 consensus_meta.cc:287] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 1.085s	user 0.008s	sys 0.002s
W20260709 13:12:50.296545 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50154.6us
I20260709 13:12:50.341439 27123 leader_election.cc:400] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10.
I20260709 13:12:50.341766 27123 leader_election.cc:403] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:12:50.341951 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.298686   561 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.291808   555 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.310529   720 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:50.306916   619 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.312027   321 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.319602 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:50.318718 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54085.4us
I20260709 13:12:50.240857   353 raft_consensus.cc:740] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:50.324716   601 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.252501   472 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:50.255889   699 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:50.298264 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.354763 27832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1594) took 1093 ms. Trace:
W20260709 13:12:50.336648   695 consensus_meta.cc:287] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.010s
I20260709 13:12:50.362035   740 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:50.362949 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.379510 27152 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 9.
I20260709 13:12:50.363250 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.380756 27148 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 9: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:50.364005 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.364009 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.364748 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.368907 27301 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
W20260709 13:12:50.381659 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 169663us
I20260709 13:12:50.375667 27832 rpcz_store.cc:276] 0709 13:12:49.260960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.261134 (+   174us) service_pool.cc:224] Handling call
0709 13:12:49.261453 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.261679 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:49.619281 (+357602us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.354274 (+734993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.354353 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:50.354418 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.354511 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.354670 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":288225,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":31,"raft.queue_time_us":32500,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5398,"thread_start_us":1050213,"threads_started":3,"wal-append.queue_time_us":605795}
I20260709 13:12:50.351950   737 raft_consensus.cc:2764] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:12:50.360301   676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.252s	user 0.034s	sys 0.059s
I20260709 13:12:50.366216   561 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.361486   566 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10.
I20260709 13:12:50.361191   685 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:50.382629 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.321203   678 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.381598 27157 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:50.374871   674 consensus_meta.cc:287] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 1.486s	user 0.011s	sys 0.005s
I20260709 13:12:50.393652 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:50.397941 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.399019 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:50.387670   676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.035s	sys 0.059s
I20260709 13:12:50.390081   695 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.418706 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.382833   472 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:50.419628 27122 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.424129 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.425576   698 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:50.390496   740 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.402680   574 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:12:50.428421   566 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:50.431715   559 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:50.429049   682 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.417315   674 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:50.455467 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 75556.8us
I20260709 13:12:50.440519   749 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:50.442551   698 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:50.461864 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:50.428546   695 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.449596   545 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:50.439410   564 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:12:50.490608 27304 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
W20260709 13:12:50.475903 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57492.2us
I20260709 13:12:50.487087 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.456585   559 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.457134   566 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:50.473198   698 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:50.463146   750 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:50.502894 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.502645   758 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:12:50.505625 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 79187.9us
I20260709 13:12:50.504653   758 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.445914   353 consensus_queue.cc:260] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.511736 27301 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: [17.13-18.14]
I20260709 13:12:50.492602   753 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:50.516101 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:50.516680 27301 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:50.509963 27804 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.509071   601 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:50.518541 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 81857us
I20260709 13:12:50.519412 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.521751 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.522814 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:50.522944 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.524230 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.517385 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:50.503731   566 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:50.503412   559 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.464524   472 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:50.511302   744 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:12:50.539145   601 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.496337   682 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:12:50.510583   619 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:50.508847   652 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:50.548065 27197 leader_election.cc:400] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 17. Current term is 18.
I20260709 13:12:50.508893   758 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:50.519172   751 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:50.550549   601 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.554253   751 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:50.554422   733 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:12:50.554704   751 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:50.530937   545 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:50.555893   601 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.531414   685 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:50.559592 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.559857 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:50.560211 27832 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:50.560660 27227 raft_consensus.cc:2410] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:12:50.561486 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:50.551782 27197 leader_election.cc:403] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:12:50.536638   752 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:50.531134   749 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:50.567548   752 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 17. Current term is 18.
I20260709 13:12:50.567624 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:50.568207   743 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:50.568416 27224 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:50.569396 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.520548   512 consensus_queue.cc:1059] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:12:50.573419 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.552727   747 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:12:50.539578   748 raft_consensus.cc:2764] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:12:50.532150   321 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.575235 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.576184 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.576440 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.581159 27301 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
W20260709 13:12:50.565616   639 consensus_meta.cc:287] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.006s
I20260709 13:12:50.531605 32642 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:12:50.588121 27122 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:50.590355 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.591200 27156 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 10.
I20260709 13:12:50.592878 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.566227   685 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:50.603679 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70170.5us
I20260709 13:12:50.549605   574 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:12:50.581494 32394 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:50.605567 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:50.611475 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.613021 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.589108   561 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:50.587258   678 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.655969 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.658792   740 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.659549   674 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:50.667042 32394 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:50.668262 32394 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:50.679950 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 66987.2us
I20260709 13:12:50.595769   695 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.608237   685 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.680864   561 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:50.615688   735 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.689189 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:50.689813 27223 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:50.692260 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.693403 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:50.705543 27223 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:50.676612   545 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:50.719587 27272 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:50.680516   574 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:50.617400   762 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:50.687405 32697 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.681696   561 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.686697   735 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.699575   749 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:50.771917 27833 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:50.718165   740 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:50.772318   318 raft_consensus.cc:2804] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:50.596539   639 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.615289   748 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 13:12:50.737162   576 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:50.678495   713 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.789438   585 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:50.791270 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:50.765522   753 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:50.798801 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:50.802387 27841 raft_consensus.cc:1275] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:50.800993 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:50.818462   765 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:50.819051   765 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.826318   765 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.795439   379 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:50.775676   574 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.857632   574 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:50.840440   739 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:50.858471   739 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.860447   739 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.860814   751 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.843433   735 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.844928   778 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:50.776535 32697 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.861941   778 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.845459   379 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.846791   585 consensus_queue.cc:1048] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:50.810977   576 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.796486   740 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.818471   759 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:50.855475   713 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:50.841892   770 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:12:50.812776   318 raft_consensus.cc:697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:50.819208   561 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.852384   559 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.854935   639 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.890302   566 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.863924 32697 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:50.905869   766 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:12:50.906564   699 consensus_meta.cc:287] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.003s
I20260709 13:12:50.907068 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:50.926810 27838 raft_consensus.cc:3060] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:50.926579   318 consensus_queue.cc:237] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:50.927882   698 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.828977   753 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.931069 27156 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
W20260709 13:12:50.909621 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 228996us
I20260709 13:12:50.929912   698 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.909621   759 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:50.943185   759 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.975322   778 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.976040   713 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:50.976632   713 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:50.979008 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.979990 27838 raft_consensus.cc:2468] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:50.981235 27271 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:50.982107   318 raft_consensus.cc:2804] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:50.982656   318 raft_consensus.cc:697] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:50.983771   318 consensus_queue.cc:237] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:50.987404 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.987475   566 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.989602   379 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:50.990293 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:50.991828 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.999351 27148 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:51.001829 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.004391 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.004628 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.005146 27302 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:51.006098 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.006676 27302 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:51.007642 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.008147 27302 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:51.004006 27197 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:50.869035   685 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.011890 27305 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:51.013442 27301 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: [17.13-18.14]
I20260709 13:12:51.005334   545 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:50.998996   776 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.019109 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:51.025856 27302 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:51.027082 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.059448   713 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:51.071537 27838 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:51.070415   740 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.072522 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.073616 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.010087   774 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:51.074443   774 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.075615 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.076864 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.077574   774 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.084167 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.084944 27299 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
W20260709 13:12:51.042629 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.054471 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.032506   576 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.056176 27152 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:51.086759 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.056922   685 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:51.031009   753 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.057693 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3554) took 1638 ms. Trace:
W20260709 13:12:51.058250   722 consensus_meta.cc:287] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.737s	user 0.007s	sys 0.004s
I20260709 13:12:51.059556 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.004060   758 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.064079   589 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:51.065685   572 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:51.033605   751 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.031116   781 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.079442 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.080258 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.115201 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.116506 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.080376 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.078918 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.081606   678 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.082274 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.041924   559 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.088279 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.119113 27232 raft_consensus.cc:2410] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:51.088820 27227 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:51.087942 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.120302 27224 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:51.089124 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.089753 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.077628 27839 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:51.092610 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.121559 27299 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:51.092767 27306 raft_consensus.cc:1275] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:51.095410 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.098223 27151 rpcz_store.cc:276] 0709 13:12:49.419283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.563886 (+144603us) service_pool.cc:224] Handling call
0709 13:12:49.730178 (+166292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.730603 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.730643 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.731301 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:12:50.125001 (+393700us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:50.125041 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.125116 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.292160 (+167044us) raft_consensus.cc:1685] finished
0709 13:12:50.292180 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.057422 (+765242us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54000de650. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:51.057634 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5552,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":381593344,"thread_start_us":393295,"threads_started":1,"wal-append.queue_time_us":531107}
I20260709 13:12:51.096553 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.123718 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.124097 27152 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:51.096553 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.099400 27836 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:51.125043 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.122728 27149 raft_consensus.cc:2393] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:51.105608 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 86576.6us
I20260709 13:12:51.106213 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.096506   465 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:51.128064 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.127794 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.129271 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.126358 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:51.129705 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.130378 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.133098 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.133281 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.133672 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.135406 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.135983 27231 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:51.136847 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.137074 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.137378 27231 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:51.138355 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.139410 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.140537 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.141964 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.142576 27836 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
I20260709 13:12:51.143318 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.143483 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:51.144279 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.127987 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.145648 27306 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 18: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:51.146137 27837 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 18: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:51.135782 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.146936 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.147581 27839 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:51.147800 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.148831 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.147051 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.149917 27197 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.150813 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.150960 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.144954 27836 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:51.113652   564 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:51.156512 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.112548   749 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:51.152364 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.153100 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.150252 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:51.158789 27232 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.159018 27836 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:51.159914 27224 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:51.161106 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.161461 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.163782 27227 raft_consensus.cc:1240] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:51.161924 27838 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 9.
I20260709 13:12:51.151448 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.153780 27806 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.154863 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:51.168581 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.168864 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.194500 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.135874   740 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:12:51.127822   632 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:51.128153   465 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:51.198452 27269 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.197367 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:51.147149   735 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:12:51.197561 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 43851us
W20260709 13:12:51.200542 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.153002   780 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.155799   564 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:51.208058 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.112419   722 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:51.152547   774 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.122682   589 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.155596   319 raft_consensus.cc:2764] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:12:51.203863 27223 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:12:51.244725 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47427.9us
I20260709 13:12:51.157634   748 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.262032 27232 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:51.157495   751 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.240641 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.245328   735 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:51.251813 27306 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
W20260709 13:12:51.268235   771 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:12:51.122929   572 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.196142   639 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.198284   781 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:51.128466   678 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.263103 27838 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 10: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:51.199496   753 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.155738   786 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:12:51.270179 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:12:51.320017 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49908.9us
I20260709 13:12:51.320448 27151 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:51.320936 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.290401   576 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.322687   740 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:51.323338   715 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.438s	user 0.009s	sys 0.007s
I20260709 13:12:51.324532   459 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.244630   738 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:51.327026   738 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:51.327175   791 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:12:51.327473   738 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.331768 27833 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:12:51.332109 27834 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:51.283463   735 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.334831   678 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.155898   559 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:12:51.338194   572 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:51.339937 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 3010) took 2209 ms. Trace:
I20260709 13:12:51.340312 27155 rpcz_store.cc:276] 0709 13:12:49.130434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.130551 (+   117us) service_pool.cc:224] Handling call
0709 13:12:49.156673 (+ 26122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.527999 (+371326us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:12:49.917862 (+389863us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.216621 (+298759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.216672 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:50.216713 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.339709 (+1122996us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54000df054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:51.339754 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.339859 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67529,"prepare.queue_time_us":137062,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":10532,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14170,"spinlock_wait_cycles":853357952,"thread_start_us":640784,"threads_started":2,"wal-append.queue_time_us":454876}
I20260709 13:12:51.341035   465 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.256574   564 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:51.295186   781 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.342453   781 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.195794   685 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:12:51.251298   318 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.194830   699 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:51.345257   699 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:51.346179   699 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.348027 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.194320   698 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:51.362847 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.204216   682 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:12:51.287568 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 89177.3us
I20260709 13:12:51.388427 27305 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:51.288466 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 47949.1us
I20260709 13:12:51.237675   632 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:51.253584   775 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:51.311064   724 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.137s	user 0.005s	sys 0.000s
I20260709 13:12:51.311877   722 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.313393   589 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.349946 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.360334 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.384367 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:51.401234 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 51359.4us
I20260709 13:12:51.351681 27123 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:51.323357   740 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.402278 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:51.402145 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50535.2us
I20260709 13:12:51.391187 27806 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.333906   593 raft_consensus.cc:3055] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:51.357476 27807 connection.cc:256] RPC call timeout handler was delayed by -1.2525684379997983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 13:12:51.401899 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.407023 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.411715 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.413010 27122 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.414391 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:51.409579 27807 connection.cc:256] RPC call timeout handler was delayed by -1.22925923899993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:12:51.416368 27807 connection.cc:256] RPC call timeout handler was delayed by -1.0376069080000434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:12:51.417214 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.418589 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.419150 27837 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:51.420751 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:51.395524   318 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:12:51.415796   589 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:51.392684   512 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:12:51.442816 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.420135   760 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.444386 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.395205   465 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.398207   720 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:51.451983 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.393690   775 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:51.420218   754 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.956s	user 0.002s	sys 0.000s
I20260709 13:12:51.438509 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.464107 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.463964   564 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:51.466121 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.466697   737 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.469462   585 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:51.471714   353 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:51.457379   678 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.475600   652 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.487576   574 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.420197   639 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:51.396543   786 consensus_queue.cc:1059] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:12:51.542392   807 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:51.542567   786 raft_consensus.cc:3055] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:51.542807   807 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:51.542994   786 raft_consensus.cc:740] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:51.543687   807 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.545105   807 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:51.451131   472 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.417749   545 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.418532   642 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.546823   564 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.449165   740 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:51.458298   758 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.477669   720 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.451539   722 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:51.496302   738 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.486976   735 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.517428 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:51.520370 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 54334.4us
I20260709 13:12:51.563436 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.564042 27224 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:51.564246 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.565026 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.565261 27148 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:51.522652 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.565469 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:51.495883   721 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.326s	user 0.001s	sys 0.001s
I20260709 13:12:51.398833   601 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:12:51.567277 27300 raft_consensus.cc:2393] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 18: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:51.409403   593 raft_consensus.cc:740] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:51.569672 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 156724us
I20260709 13:12:51.543694   652 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.525095   678 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:51.540390   585 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:51.543780   786 consensus_queue.cc:260] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:51.497102 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:51.415645   576 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.480198   775 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.522238   589 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:51.455813   760 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.516330   524 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:51.535120   698 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.523386   512 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.567940 27231 raft_consensus.cc:2410] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:51.568761 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.529371 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.570540 27122 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.487322   632 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:51.588750   742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.012s	sys 0.016s
I20260709 13:12:51.574209 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.574627 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.559158   722 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:51.559135   545 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.580034 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:51.582800 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 85762us
I20260709 13:12:51.588219 27301 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:51.582034   678 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.614466 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.615129 27148 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:51.615931 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.616420 27148 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.618490   652 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:51.623432 27148 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 19.
W20260709 13:12:51.573616   797 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:51.581845   585 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:51.598990 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 69723.2us
I20260709 13:12:51.598446   786 raft_consensus.cc:3060] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:51.585446   682 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:51.602196 27227 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:51.603166 27155 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:51.644783 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.645514 27155 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:51.606437 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.607617   722 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:51.605047   576 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.610515   545 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.611756 27223 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:51.612385   781 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.623530   760 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.624588 27836 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:51.628033   589 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.570411   601 consensus_queue.cc:1243] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer 9bc1278c649846e998b312b374274d08 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:51.629710 27304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34456 (request call id 2453) took 2399 ms. Trace:
I20260709 13:12:51.631132   738 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.663154 27304 rpcz_store.cc:276] 0709 13:12:49.230447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.230557 (+   110us) service_pool.cc:224] Handling call
0709 13:12:49.230811 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.491040 (+1260229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.629414 (+1138374us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540031c4d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:51.629619 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896798464}
I20260709 13:12:51.632943 27224 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:51.632795 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.664494 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:51.602630   742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.013s	sys 0.016s
I20260709 13:12:51.640817 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.600533 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:51.668079 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67620us
W20260709 13:12:51.641515 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.642584 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:51.647583 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:51.610431   805 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.659444 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.598186   698 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.672154 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:51.706920 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 264166us
I20260709 13:12:51.708410 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.675458 27304 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:51.678653 27155 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:12:51.664880 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:51.654037   682 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:51.691733 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 50991.6us
I20260709 13:12:51.669847 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.679526   699 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.699687   576 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:51.722689 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52953.5us
I20260709 13:12:51.724962 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.727347 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.711027   524 tablet_bootstrap.cc:492] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Bootstrap complete.
W20260709 13:12:51.740779 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 77004.6us
I20260709 13:12:51.706647   752 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:51.742236 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.740680 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.733031   805 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:51.826265 27195 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.129:38249 timed out after 1.865s (SENT) [suppressed 21 similar messages]
W20260709 13:12:51.827188 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85043us
W20260709 13:12:51.827500 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48348us
I20260709 13:12:51.827993 27807 leader_election.cc:400] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15.
I20260709 13:12:51.828946 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.731956   700 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:51.716379   682 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.810879   775 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:51.814251   794 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.421s	user 0.003s	sys 0.000s
I20260709 13:12:51.815331   749 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:51.864492 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42282 (request call id 50) took 2267 ms. Trace:
I20260709 13:12:51.710353   652 consensus_queue.cc:1048] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:12:51.818413 27153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3556) took 2309 ms. Trace:
I20260709 13:12:51.852978 27148 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.770601   753 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:51.863602 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.793500   632 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:12:51.867705 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 98236.5us
I20260709 13:12:51.864919 27297 rpcz_store.cc:276] 0709 13:12:49.594598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.594801 (+   203us) service_pool.cc:224] Handling call
0709 13:12:51.862000 (+2267199us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000a4e54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d31853 00007f9a56cff60a 00007f9a502857d4 00007f9a50285762 00007f9a50285691 00007f9a5028560c 00007f9a502848c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:51.862136 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619322112}
I20260709 13:12:51.865177 27153 rpcz_store.cc:276] 0709 13:12:49.509565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.663644 (+154079us) service_pool.cc:224] Handling call
0709 13:12:49.875564 (+211920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.875753 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:12:49.919862 (+ 44109us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.227328 (+307466us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.227506 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.227533 (+    27us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:50.227565 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.227643 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.611732 (+1384089us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b1800351880. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:51.612131 (+   399us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b1800351880. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f
0709 13:12:51.612584 (+   453us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b4800002dd8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:12:51.818195 (+205611us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540037f5d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:51.818327 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37518,"prepare.queue_time_us":57436,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":13086,"raft.queue_time_us":15869,"raft.run_cpu_time_us":3415,"raft.run_wall_time_us":1383876,"spinlock_wait_cycles":538822144,"thread_start_us":306934,"threads_started":1,"wal-append.queue_time_us":370479,"wal-append.run_cpu_time_us":1666,"wal-append.run_wall_time_us":1001817}
I20260709 13:12:51.770860   739 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.778478   752 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:51.870333 27153 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:51.703503   585 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.874069 27154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3544) took 2671 ms. Trace:
I20260709 13:12:51.880343 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:51.782137   735 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.862761   524 ts_tablet_manager.cc:1403] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Time spent bootstrapping tablet: real 3.281s	user 0.073s	sys 0.018s
I20260709 13:12:51.850925   576 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:51.826445   805 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.885627 27807 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:51.869185   749 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:51.864516   809 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:12:51.738741   720 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:51.892879 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:51.907554 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.881888   812 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.895046   632 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:51.896675   500 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.911284   500 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.913506   500 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:51.883821   685 consensus_queue.cc:1048] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:12:51.882437 27154 rpcz_store.cc:276] 0709 13:12:49.202690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.208535 (+  5845us) service_pool.cc:224] Handling call
0709 13:12:49.208858 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.475779 (+266921us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:49.883727 (+407948us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.241149 (+357422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.241201 (+    52us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:50.241242 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:51.078942 (+837700us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4800002dd8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a56c60aa1 00007f9a56c57b37 00007f9a56c579ca 00007f9a56d4f26f 00007f9a56d4ef37 00007f9a56d6355c 00007f9a56d63508 00007f9a56d63488 00007f9a56d63443 00007f9a56d626ec 00007f9a55c8ca96
0709 13:12:51.873753 (+794811us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400358c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:51.873840 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:51.873985 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29392,"prepare.queue_time_us":118272,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":14868,"raft.queue_time_us":20311,"raft.run_cpu_time_us":4356,"raft.run_wall_time_us":835152,"spinlock_wait_cycles":621859968,"thread_start_us":737305,"threads_started":2,"wal-append.queue_time_us":497035,"wal-append.run_cpu_time_us":3744,"wal-append.run_wall_time_us":1170328}
I20260709 13:12:51.898238 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.770197   678 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:51.882838 27155 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:51.777536   676 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:12:51.869544   745 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.908815 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.908987 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:51.909456 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:51.927088 27154 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:12:51.893774   459 consensus_meta.cc:287] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:12:51.920713 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:51.899055   811 log.cc:927] Time spent T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:51.922611 27227 pending_rounds.cc:85] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 9
I20260709 13:12:51.923909 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:51.927166 27834 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.905824   472 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:51.927748 27154 pending_rounds.cc:85] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 13
I20260709 13:12:51.889328   752 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:51.930330 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:51.933121 27229 raft_consensus.cc:2410] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:12:51.904143   585 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:51.994000 27297 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:51.995631 27150 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:51.993927 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:52.011149 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:51.933310 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:51.995723 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:51.998432   545 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.001724   601 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.006892 27154 pending_rounds.cc:107] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:12:52.022102 27154 raft_consensus.cc:2889] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:52.007607 27227 pending_rounds.cc:107] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:52.023051 27227 raft_consensus.cc:2889] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:52.023407 27227 pending_rounds.cc:107] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:12:52.023648 27227 raft_consensus.cc:2889] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:52.007943 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 181691us
I20260709 13:12:51.904076   753 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:52.024420   753 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:52.015559 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 85340.6us
W20260709 13:12:52.017786 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 115304us
I20260709 13:12:51.905009   805 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.029645 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.031230 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.026688 27804 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.028069 27297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:51.996685   576 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:52.033200 27297 raft_consensus.cc:606] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.024940   753 raft_consensus.cc:3060] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.034425 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:52.006390   694 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.014194   780 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.994977   678 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:51.930109   685 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:12:52.049980 27304 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:12:52.054693 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 130875us
I20260709 13:12:52.097276 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.021534   758 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:52.056769   564 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:12:52.039394   812 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:12:52.114542 27834 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:52.094604   777 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:12:52.095799   472 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:52.130652   652 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.029809   632 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:52.038491   745 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:52.137408 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.037122   576 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:52.057706   778 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:52.157580   812 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:52.035019   601 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:52.134701   748 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.137660   735 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.157979   745 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:52.164752   576 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:52.188786 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 147262us
I20260709 13:12:52.165179   778 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:52.058774   780 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.190286 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:52.170915   758 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:52.058492   694 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.179394   632 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:52.173821   737 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:52.194321 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 163139us
I20260709 13:12:52.185990   745 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.197348 27306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1193) took 1092 ms. Trace:
W20260709 13:12:52.199620 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 143457us
I20260709 13:12:52.198237 27197 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.203261 27157 raft_consensus.cc:1240] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:52.190778   778 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.204840 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.201787 27306 rpcz_store.cc:276] 0709 13:12:51.105343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.146180 (+ 40837us) service_pool.cc:224] Handling call
0709 13:12:51.146450 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.289203 (+142753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.197146 (+907943us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001cb1d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.197298 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241947008}
I20260709 13:12:52.206418 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.196000   564 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:52.184903   748 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.195410   775 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.195137   545 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.210700 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.222325   826 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:12:52.223984 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.224601 27223 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.227387   541 raft_consensus.cc:3060] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:52.228237   524 raft_consensus.cc:359] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:52.229287   524 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Initialized, Role: LEARNER
I20260709 13:12:52.203986   685 consensus_queue.cc:1243] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:12:52.230149   545 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.238997   545 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.239174   827 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:52.240038   827 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:12:52.244635   818 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:12:52.251302 27153 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:52.252193 27840 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:52.252558 27840 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:52.253297 27840 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.254511 27148 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.257407 27195 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:52.238834 32703 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:52.258277 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:52.258646 27148 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:52.259783 27840 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.259690 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.261525 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.274613   749 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.276643 27148 raft_consensus.cc:2393] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 19: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:52.278811 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:52.201614   737 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:52.238978   807 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.004s
I20260709 13:12:52.241715   713 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:12:52.293552 27227 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:52.276371   545 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.289397 27223 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:52.299830 27227 raft_consensus.cc:1240] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:52.280539   459 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.290169   739 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.276171   512 consensus_queue.cc:1059] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:12:52.315894 27835 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:12:52.317503   749 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.264430   524 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:52.315994   827 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.323546   786 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:12:52.356349   576 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.358793   778 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.360925   778 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.361788 27157 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:52.365310   737 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.372028 27837 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:52.373418 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.287781   758 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.311843   459 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.389052 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.414626 27832 raft_consensus.cc:2393] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:52.409560 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.415267 27840 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:12:52.391351   753 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.392838   805 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:52.383409   682 consensus_meta.cc:287] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:12:52.397258   752 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.315631   739 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.416710 27840 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:52.422076 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.420485 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.423352 27123 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:52.426551 27832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35846 (request call id 2124) took 1649 ms (client timeout 1632 ms). Trace:
W20260709 13:12:52.432183 27832 rpcz_store.cc:269] 0709 13:12:50.769774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.388810 (+1619036us) service_pool.cc:224] Handling call
0709 13:12:52.418999 (+ 30189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:52.412895   833 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.423032   750 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:52.436322   833 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.436517   750 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.437215   774 raft_consensus.cc:3055] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:52.437641   774 raft_consensus.cc:740] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:52.438123   713 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:52.438584   713 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.438410   758 consensus_queue.cc:1059] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:52.439023   713 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.439515   758 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:52.439895   758 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:52.440323   524 ts_tablet_manager.cc:1434] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Time spent starting tablet: real 0.553s	user 0.001s	sys 0.009s
I20260709 13:12:52.440450 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.379905   512 consensus_queue.cc:1059] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:12:52.441138   748 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:52.418764   722 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.001s
I20260709 13:12:52.431104   682 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.443701   722 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:52.443958 27229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46412 (request call id 3702) took 1884 ms (client timeout 2174 ms). Trace:
W20260709 13:12:52.444610 27229 rpcz_store.cc:269] 0709 13:12:50.559349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.567383 (+  8034us) service_pool.cc:224] Handling call
0709 13:12:52.443723 (+1876340us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003930d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.443855 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131285888}
I20260709 13:12:52.445225   682 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.442584   459 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.442844   805 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.440919   758 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.426885   786 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:52.450137 27226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2448) took 3320 ms. Trace:
I20260709 13:12:52.444020 27154 raft_consensus.cc:1240] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:12:52.445904 27225 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:12:52.440656   524 ts_tablet_manager.cc:1467] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Tablet startup took 553ms
I20260709 13:12:52.441954   777 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:52.462625   777 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:52.454449 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.441090 27157 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.459980 27226 rpcz_store.cc:276] 0709 13:12:49.109868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.111226 (+  1358us) service_pool.cc:224] Handling call
0709 13:12:49.111642 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:49.140573 (+ 28931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.140616 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:49.214883 (+ 74267us) log.cc:844] Serialized 52 byte log entry
0709 13:12:49.585495 (+370612us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:50.173721 (+588226us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.174204 (+   483us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.385907 (+2211703us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b180012b3e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a518edd70 00007f9a518e1293 00007f9a518d6cea 00007f9a518d723a 00007f9a51d41a2a 00007f9a51d510bf 00007f9a51d51038
0709 13:12:52.422731 (+ 36824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.422814 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.430366 (+  7552us) raft_consensus.cc:1685] finished
0709 13:12:52.430399 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.430553 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2330565,"prepare.queue_time_us":560406,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":185228,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":6736,"spinlock_wait_cycles":13949696,"thread_start_us":818680,"threads_started":2,"wal-append.queue_time_us":568606}
I20260709 13:12:52.445871   722 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.471128 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.472437 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.473033 27840 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.438606   833 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.448400   752 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.486816   835 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.486657   593 consensus_queue.cc:260] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.487448   835 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.489696   835 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.491345   781 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.464936   459 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:52.495217   459 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
W20260709 13:12:52.495335 27150 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 3027) took 1918 ms (client timeout 1865 ms). Trace:
W20260709 13:12:52.495886 27150 rpcz_store.cc:269] 0709 13:12:50.576393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.576511 (+   118us) service_pool.cc:224] Handling call
0709 13:12:52.495066 (+1918555us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400357854. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.495196 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3224442112}
I20260709 13:12:52.496223   459 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.497256   833 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.497845   833 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.493583 27152 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3566) took 1442 ms. Trace:
I20260709 13:12:52.500097 27152 rpcz_store.cc:276] 0709 13:12:51.051393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.196992 (+145599us) service_pool.cc:224] Handling call
0709 13:12:51.199887 (+  2895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.287799 (+ 87912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.287845 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.287904 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:51.287951 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.493296 (+1205345us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b5400139554. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.493355 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.493515 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201622912}
I20260709 13:12:52.509336 27840 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:52.517135 27157 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:52.522230 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:52.462491   524 ts_tablet_manager.cc:1469] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Trace:
0709 13:12:44.112660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.112854 (+   194us) service_pool.cc:224] Handling call
0709 13:12:44.285539 (+172685us) ts_tablet_manager.cc:934] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Initiating tablet copy from peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
0709 13:12:45.643774 (+1358235us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:45.841239 (+197465us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:45.841357 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:46.045359 (+204002us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:46.045654 (+   295us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:46.045983 (+   329us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:46.046045 (+    62us) inbound_call.cc:177] Queueing success response
0709 13:12:48.526379 (+2480334us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:12:51.886874 (+3360495us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:12:51.887689 (+   815us) tablet_replica.cc:261] Starting instrumentation
0709 13:12:52.028764 (+141075us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":292,"mutex_wait_us":12435,"raft.queue_time_us":7597,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"tablet-copy.queue_time_us":155299,"tablet-download-pool.queue_time_us":19279,"tablet-download-pool.run_cpu_time_us":1529,"tablet-download-pool.run_wall_time_us":1546793,"thread_start_us":130969,"threads_started":2}
I20260709 13:12:52.527717 27298 raft_consensus.cc:2410] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:12:52.503371   758 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.522123   739 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.547006 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.529240   678 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.472643   774 consensus_queue.cc:260] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.536744   753 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:52.504920   745 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.556567   750 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.558096 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.562861 27834 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:52.563761   745 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:52.554468   678 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.563688 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.564699   774 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.564926 27834 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:52.565869 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.566416 27834 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:52.567512 27834 raft_consensus.cc:1217] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 LEARNER]: Deduplicated request from leader. Original: 14.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 13:12:52.569296 27836 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:52.571055 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.481433   777 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:52.582513 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 315725us
I20260709 13:12:52.584429 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.587515 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.588850 27228 raft_consensus.cc:2468] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:52.590257 27807 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.553483   713 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.586503   833 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.596700   777 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.597138   745 raft_consensus.cc:2804] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:52.608968 27840 raft_consensus.cc:2393] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:52.605044   545 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:52.615207   745 raft_consensus.cc:697] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:52.632515   745 consensus_queue.cc:237] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.633122   694 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:52.639225 27298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2473) took 1651 ms (client timeout 1925 ms). Trace:
W20260709 13:12:52.639621 27298 rpcz_store.cc:269] 0709 13:12:50.987635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:50.989981 (+  2346us) service_pool.cc:224] Handling call
0709 13:12:52.639025 (+1649044us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540005d2d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.639171 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533490432}
I20260709 13:12:52.642096 27149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3565) took 1591 ms. Trace:
I20260709 13:12:52.643935 27299 raft_consensus.cc:1275] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:12:52.644783 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 195483us
I20260709 13:12:52.643877 27149 rpcz_store.cc:276] 0709 13:12:51.051137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.169433 (+118296us) service_pool.cc:224] Handling call
0709 13:12:51.169684 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.416242 (+246558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.416270 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.416307 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:51.416339 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.641877 (+1225538us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54001716d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.641920 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.642029 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566647552}
I20260709 13:12:52.670295 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.670957 27149 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
W20260709 13:12:52.676030 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 196174us
I20260709 13:12:52.676187 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.677389 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:52.666675   774 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.694375   774 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.696506   774 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.680729 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.681371 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.685674 27149 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:52.688126   713 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.691401 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.700700 27228 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:52.699277 27157 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:52.709456 27228 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:52.698884 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:52.712103 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:52.711079 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.716215   833 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:52.716499 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:52.716773   833 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:52.717278   750 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:52.717658   750 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:52.717857   839 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.717715   833 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.718667   839 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:52.719115   781 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.718209   750 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:52.722982 32703 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:52.725337 32703 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:52.726254 32703 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.723526   839 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.732779 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.668861   541 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:12:52.714295 32697 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:52.735397 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.714181   545 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:52.739110   545 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.739562   545 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:52.741583 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.742434 27834 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:52.736449 32697 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:52.743284 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.745303 32697 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:52.745822 27834 raft_consensus.cc:2393] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:52.747527 27834 raft_consensus.cc:1240] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:12:52.753687 27833 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:52.754818 27225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46400 (request call id 2462) took 1665 ms. Trace:
I20260709 13:12:52.755203 27225 rpcz_store.cc:276] 0709 13:12:51.089453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.152823 (+ 63370us) service_pool.cc:224] Handling call
0709 13:12:52.445604 (+1292781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.461455 (+ 15851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.754623 (+293168us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003930d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.754761 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960485248}
I20260709 13:12:52.758950 27301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1204) took 1138 ms. Trace:
I20260709 13:12:52.759600   777 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.760113   777 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:52.762447 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.763039   777 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.759330 27301 rpcz_store.cc:276] 0709 13:12:51.620554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.628812 (+  8258us) service_pool.cc:224] Handling call
0709 13:12:51.629109 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:51.629687 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.629716 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:52.456234 (+826518us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:52.456742 (+   508us) log.cc:844] Serialized 52 byte log entry
0709 13:12:52.651386 (+194644us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:52.651422 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.651483 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.758672 (+107189us) raft_consensus.cc:1685] finished
0709 13:12:52.758691 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.758891 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":12515072,"thread_start_us":194276,"threads_started":1,"wal-append.queue_time_us":239751}
I20260709 13:12:52.719667   827 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:52.766021   827 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.719659   781 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.769757 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.775122 27299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1192) took 1674 ms. Trace:
I20260709 13:12:52.772944 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.773231 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.773962 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.776355 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:52.775480 27299 rpcz_store.cc:276] 0709 13:12:51.100274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.137287 (+ 37013us) service_pool.cc:224] Handling call
0709 13:12:52.642409 (+1505122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:52.644544 (+  2135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.753995 (+109451us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540005d2d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.775067 (+ 21072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3460657920}
I20260709 13:12:52.780027 27150 raft_consensus.cc:2393] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:52.783030   700 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:52.753731 32697 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.801115   780 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.802183 32697 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:52.803498   812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:12:52.808320   678 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.810796 27151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45802 (request call id 3576) took 1662 ms. Trace:
I20260709 13:12:52.811180 27151 rpcz_store.cc:276] 0709 13:12:51.148053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.321169 (+173116us) service_pool.cc:224] Handling call
0709 13:12:51.321418 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.393577 (+ 72159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.393606 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.393647 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:12:51.393676 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.810494 (+1416818us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b540012bbd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.810563 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.810731 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165484800}
W20260709 13:12:52.813350 27305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 1195) took 1707 ms (client timeout 1717 ms). Trace:
W20260709 13:12:52.813730 27305 rpcz_store.cc:269] 0709 13:12:51.105885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.116208 (+ 10323us) service_pool.cc:224] Handling call
0709 13:12:52.813188 (+1696980us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000e9a54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.813298 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524102528}
I20260709 13:12:52.817234 27836 raft_consensus.cc:1240] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.783735   777 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:52.780493   695 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:52.819342 27303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34440 (request call id 2646) took 1729 ms. Trace:
I20260709 13:12:52.777631   545 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.821905 27303 rpcz_store.cc:276] 0709 13:12:51.090398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.090544 (+   146us) service_pool.cc:224] Handling call
0709 13:12:51.091007 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:51.091289 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.091325 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.504807 (+1413482us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b2c000e0fe8. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:52.512847 (+  8040us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.667931 (+155084us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:52.667970 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.668499 (+   529us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.813929 (+145430us) raft_consensus.cc:1685] finished
0709 13:12:52.813946 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.819279 (+  5333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7444736,"thread_start_us":122888,"threads_started":1,"wal-append.queue_time_us":208186}
I20260709 13:12:52.821005   777 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.823822   780 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.824657   695 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:52.820724   839 consensus_queue.cc:1059] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:12:52.835772   777 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.828006   353 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:52.839118   815 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.003s	sys 0.032s
I20260709 13:12:52.848371   545 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.853354   781 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:52.855046   827 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:52.888902   815 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.003s	sys 0.032s
I20260709 13:12:52.891119 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:52.893105 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:52.893796 27228 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:52.894587 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.896512 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:52.897044 27226 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:52.906288   745 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.906829   745 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.908834   745 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.909268   745 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:12:52.918740   814 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 1.032s	user 0.005s	sys 0.000s
I20260709 13:12:52.919930 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.921666 27300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1200) took 1505 ms. Trace:
W20260709 13:12:52.855484 27156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47438 (request call id 1342) took 1398 ms (client timeout 1587 ms). Trace:
I20260709 13:12:52.856858   353 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:52.858706   695 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.843448   780 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.861119   750 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:52.862522 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.966421 27303 raft_consensus.cc:1240] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.863772 27151 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:12:52.966656 27804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.922079 27300 rpcz_store.cc:276] 0709 13:12:51.416199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.579125 (+162926us) service_pool.cc:224] Handling call
0709 13:12:51.579427 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:51.596359 (+ 16932us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:12:51.614589 (+ 18230us) log.cc:844] Serialized 14 byte log entry
0709 13:12:51.853843 (+239254us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:51.882409 (+ 28566us) log.cc:844] Serialized 52 byte log entry
0709 13:12:51.882553 (+   144us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:52.017362 (+134809us) log.cc:844] Serialized 14 byte log entry
0709 13:12:52.017575 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.494449 (+476874us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54003a8c54. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.494512 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.918220 (+423708us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:52.921459 (+  3239us) raft_consensus.cc:1685] finished
0709 13:12:52.921479 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:52.921607 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306671,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2189,"raft.queue_time_us":1760,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":13702,"spinlock_wait_cycles":45382784,"thread_start_us":373386,"threads_started":2,"wal-append.queue_time_us":272215}
I20260709 13:12:52.938143   674 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.970419 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.880596   601 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:52.881227 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:52.973256 27841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35852 (request call id 1617) took 1971 ms (client timeout 2227 ms). Trace:
I20260709 13:12:52.884564 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.884321   777 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:52.924599 27197 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:52.973603 27841 rpcz_store.cc:269] 0709 13:12:51.001878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.133899 (+132021us) service_pool.cc:224] Handling call
0709 13:12:52.881093 (+1747194us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b58001e0398. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4ec12b71 00007f9a4ec12a22 00007f9a57b2bc09 00007f9a56c85ee0 00007f9a56d4f0ab 00007f9a56d4f131 00007f9a56cfd0a0 00007f9a56cfc984 00007f9a502776d4 00007f9a50277662
0709 13:12:52.973204 (+ 92111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14604160}
I20260709 13:12:52.927587 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.938444 27227 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:52.938555 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:52.885792   576 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:52.922254 27156 rpcz_store.cc:269] 0709 13:12:51.456674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.522363 (+ 65689us) service_pool.cc:224] Handling call
0709 13:12:52.855290 (+1332927us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003c6254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:52.855426 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741410176}
I20260709 13:12:52.944712 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.978123 27839 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.946027 27836 raft_consensus.cc:1240] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:52.946810 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:52.971567 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.949807 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:52.909700   745 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:52.958403 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 61391.9us
I20260709 13:12:52.968102 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:52.866745 27155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1336) took 1461 ms. Trace:
I20260709 13:12:52.987308 27155 rpcz_store.cc:276] 0709 13:12:51.407600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.721758 (+314158us) service_pool.cc:224] Handling call
0709 13:12:51.722104 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.926214 (+204110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.866535 (+940321us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54003566d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:52.866688 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369259392}
I20260709 13:12:52.988533 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:52.969146 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 67453.5us
I20260709 13:12:52.879004   676 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:52.966975   319 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:52.925624 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:52.975376 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:52.976405 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:52.976871 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 52387.7us
W20260709 13:12:52.999544 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.950697 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:52.984045 27156 raft_consensus.cc:1275] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:52.990023 27833 raft_consensus.cc:2393] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:52.991222 27804 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:52.972221 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.004115 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.995630 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:53.004810 27839 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:53.005170 27301 raft_consensus.cc:606] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:52.996655 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:52.998368 27300 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:53.008620 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:52.977730   752 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:12:52.982990 32394 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:12:52.971957   632 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:12:53.006860   739 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:52.976018   674 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.013469   387 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:52.986619   576 consensus_queue.cc:1059] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:12:53.041759   318 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.068681 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.057456   752 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.006857   713 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:12:53.075779 27225 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:53.071179   387 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.006608   676 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.015460   319 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:52.996507   753 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
W20260709 13:12:53.098412 27224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39166 (request call id 1298) took 1533 ms (client timeout 1587 ms). Trace:
I20260709 13:12:53.098711 27231 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:12:53.098850 27224 rpcz_store.cc:269] 0709 13:12:51.564608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.564831 (+   223us) service_pool.cc:224] Handling call
0709 13:12:53.098163 (+1533332us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b5400391cd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:53.098346 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101667584}
I20260709 13:12:53.081399   652 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:53.058867   848 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:12:53.104864 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 116403us
W20260709 13:12:53.101672 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 77021us
I20260709 13:12:53.085194   805 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.067317   760 consensus_queue.cc:1059] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:12:53.091787   713 consensus_queue.cc:1243] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:12:53.105860 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:53.089535   752 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.063813   739 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.121057 27269 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.136780 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.145004 27226 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:12:53.076650   318 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.090005   632 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:12:53.108247   353 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.103296   745 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:53.152667 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 161518us
W20260709 13:12:53.148038 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 100255us
I20260709 13:12:53.116449   839 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.116067   836 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.119666   694 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.132535   652 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:53.142535   805 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:53.164253 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 152434us
I20260709 13:12:53.155223   750 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.176666 27226 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:53.158272   668 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:53.205010   698 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.205591   698 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.206452 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.174715   805 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:53.189064 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 154831us
W20260709 13:12:53.222710 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 102635us
I20260709 13:12:53.226578 27230 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:53.229183 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:53.232319 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.238014 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.193497   777 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.170368   836 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.206033   752 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.247300 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.215516   805 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.171561   839 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.250860 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:53.173985   694 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.254412 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:53.253829 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:53.224184   758 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.223022   541 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:53.253470 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 102761us
I20260709 13:12:53.189842   866 consensus_queue.cc:1059] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:12:53.263130 27229 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:53.206081   698 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.269157 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:53.265108   860 log.cc:927] Time spent T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:12:53.251283   870 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:53.277218 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:53.311760 27230 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 13: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:53.279721 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 125927us
I20260709 13:12:53.312642 27804 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:53.282619 27229 raft_consensus.cc:1275] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:12:53.270594   674 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.283571   318 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.285607   698 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.286230   676 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.321949 27229 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:53.331082 27229 raft_consensus.cc:1240] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:53.270798   780 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.334916 27224 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:53.315591   763 raft_consensus.cc:3055] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:53.268071   758 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.316123   387 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:53.270038   541 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.315810   879 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:12:53.341756 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 169101us
I20260709 13:12:53.339473   713 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:53.325712   319 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:53.263809   652 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.351147 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:53.351410 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63891.7us
I20260709 13:12:53.348126 27122 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.345717 27229 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:53.355409 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.339268   877 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.363021 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.350437   739 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.339556   763 raft_consensus.cc:740] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:53.347294   879 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.359133 27841 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:53.360826 27835 raft_consensus.cc:1240] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
W20260709 13:12:53.361583   871 log.cc:927] Time spent T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:12:53.319847   870 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.319700   753 consensus_queue.cc:1048] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:12:53.390413   753 consensus_queue.cc:1243] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:12:53.362727 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.392542 27150 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:53.326211   668 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:53.393710   668 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:53.394114   668 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:53.386516   541 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.394791   839 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.395016   668 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.396574   668 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:53.358160   863 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:12:53.365803 27156 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:53.369385   882 consensus_queue.cc:1059] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:53.367152   877 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.402482   877 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.403123   877 raft_consensus.cc:3055] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:53.403535   877 raft_consensus.cc:740] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:53.404531   877 consensus_queue.cc:260] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.406591   868 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:12:53.408380 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51642.3us
I20260709 13:12:53.408876 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.374265   652 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.382795 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:53.386034   836 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.386433   758 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.364946   874 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:12:53.387482 27153 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:53.388042   780 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.393896   805 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:53.397835   857 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:53.364090 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.409519 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.408051   694 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.432982 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:53.435707 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.407163   868 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.378824   739 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:53.384214   879 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.409665 27224 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:53.443701   870 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:53.430459 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 213501us
I20260709 13:12:53.444809   878 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:53.429370   780 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.446218   887 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:53.410806 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 153578us
W20260709 13:12:53.430871   862 log.cc:927] Time spent T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:12:53.447330   774 raft_consensus.cc:3055] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:53.447594   780 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.447784   774 raft_consensus.cc:740] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:53.423157   758 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.448520   758 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.448709   774 consensus_queue.cc:260] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.450866   758 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.439282   896 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.451926   896 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.449855   774 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.454602 27839 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.454960 27839 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:53.455411   805 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.455597 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.417228   652 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.456425 27157 raft_consensus.cc:2393] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:53.430997   763 consensus_queue.cc:260] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.457523   763 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.458156   652 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:53.460868 27838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35860 (request call id 1221) took 1635 ms. Trace:
I20260709 13:12:53.461864 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.463104 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.463466 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.464330 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.462450 27835 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:53.466171 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.466475 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.468024   896 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.466130 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.468966 27157 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:53.470510 27836 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:53.471521 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.461229 27838 rpcz_store.cc:276] 0709 13:12:51.824986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.825144 (+   158us) service_pool.cc:224] Handling call
0709 13:12:51.825436 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:51.883130 (+ 57694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:51.883160 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:51.883198 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:51.883228 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.460661 (+1577433us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400560254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:53.460707 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.460815 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132305664}
I20260709 13:12:53.476485   893 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.477674   674 raft_consensus.cc:993] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:53.478184   815 raft_consensus.cc:1081] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:53.479036   585 raft_consensus.cc:3055] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:53.479437   585 raft_consensus.cc:740] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:53.480258   585 consensus_queue.cc:260] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.481518   585 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.484727 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.484952 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.485908 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.486157 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.487716 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.488363 27300 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 19.
I20260709 13:12:53.488847 27227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:12:53.489420 27227 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.489760 27227 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.491257   572 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:53.492424   459 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.496441 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.498356 27227 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:53.492897   459 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.507361 27315 tablet_copy_service.cc:342] P 897d8be8580141d1ad3bb17946d3da89: Request end of tablet copy session f4afe81810944d70bc2cc31754392f3d-c8f560534ffa48878a9e4d4766199287 received from {username='slave'} at 127.0.0.1:40558
I20260709 13:12:53.507905 27315 tablet_copy_service.cc:434] P 897d8be8580141d1ad3bb17946d3da89: ending tablet copy session f4afe81810944d70bc2cc31754392f3d-c8f560534ffa48878a9e4d4766199287 on tablet c8f560534ffa48878a9e4d4766199287 with peer f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.508419   459 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.455636 27839 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.509436 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.509640 27839 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.511643 27305 raft_consensus.cc:1240] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:53.516538 32703 raft_consensus.cc:3055] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:53.517050 32703 raft_consensus.cc:740] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:53.523314 27304 raft_consensus.cc:2410] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:12:53.524487 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.524641   877 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.525019 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35860 (request call id 1227) took 1070 ms. Trace:
I20260709 13:12:53.525470 27840 rpcz_store.cc:276] 0709 13:12:52.454350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.521898 (+ 67548us) service_pool.cc:224] Handling call
0709 13:12:53.524770 (+1002872us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54004a7254. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:53.524949 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192361216}
I20260709 13:12:53.526185 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.543397 27838 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:53.526458 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.529170 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.529485   823 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.549410 27834 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:12:53.535758 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.550428 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.551995 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.552476 27838 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:53.553323 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.557928 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.561925   823 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.564221   823 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.548954   512 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:53.565505   512 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:53.567513 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 897d8be8580141d1ad3bb17946d3da89 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:53.568368   512 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.571305 27227 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.572595   758 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.573117   758 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.576031 27300 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:53.538290 27839 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:12:53.579105 27839 pending_rounds.cc:85] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 11
I20260709 13:12:53.579430 27839 pending_rounds.cc:107] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:12:53.580469 27839 raft_consensus.cc:2889] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:53.581164 27301 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:53.587297 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.590938 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.590274 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:53.594698 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.588889 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.575227   758 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:53.597543 27150 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 18: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:53.541182 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.547851 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:53.549278 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:53.531665   745 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:53.560751 27305 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:12:53.550465 32703 consensus_queue.cc:260] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.599712 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:53.597506   825 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:12:53.606467 27197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.610287 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.610584 27306 raft_consensus.cc:2368] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:53.580462   872 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.606706 27835 raft_consensus.cc:2393] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:53.606861 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.615486 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.600647 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.614167 27836 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:53.603252   893 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:53.622066   776 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:53.624804 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.625481 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:53.625883 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.624805 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.601003   780 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.631176 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.576054   879 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:53.631418 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 56389.4us
I20260709 13:12:53.632843 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.611066   745 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:53.638857 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.623802   752 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:53.640447 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.641685 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.641872 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.633819   780 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.636086 32703 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:53.634501   776 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:53.647348 27297 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:53.677299 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.601150   459 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:12:53.639842   589 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:53.647219   898 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:53.649088 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.663349 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.666239 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.642585 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.655061 27271 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:53.666982 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:53.647550 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.686098 27227 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:53.698032 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.702119   593 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.666476   780 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.705042   879 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:53.708192 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.708716 27151 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:53.706636 27305 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:53.699151 27306 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:53.710819 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:53.711254 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.669124 27301 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
W20260709 13:12:53.712149 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 57177.5us
I20260709 13:12:53.712355 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.627713   872 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.675868 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.676308 27156 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:53.684350 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.684350 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:53.712981 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:53.720338 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.721297 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.722673 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:53.722807 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.723898 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.724716 27224 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:53.725603 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.677561   776 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:53.727994 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:53.729287 27223 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:53.726164 27224 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:53.730095 27836 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:53.727654 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.730691 27302 raft_consensus.cc:2393] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:53.735275 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.735342 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.737421 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:53.737643 27305 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:53.661695   745 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.715636   879 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.743502 27306 pending_rounds.cc:85] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 15
I20260709 13:12:53.744874 27306 pending_rounds.cc:107] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:12:53.876472 27306 raft_consensus.cc:2889] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:53.668481 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:53.880475 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 211932us
I20260709 13:12:53.881094 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.884259 27298 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:53.855456 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:53.910144 27305 raft_consensus.cc:1240] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 17. Current term is 18. Ops: []
W20260709 13:12:53.912153 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57352.8us
I20260709 13:12:53.711426 27149 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 19.
I20260709 13:12:53.859611 27155 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:53.741539 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:53.738039 27302 raft_consensus.cc:606] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:53.873041 27304 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:12:53.916952 27304 pending_rounds.cc:85] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 11
I20260709 13:12:53.917272 27304 pending_rounds.cc:107] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:12:53.917554 27304 raft_consensus.cc:2889] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:53.874962 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:53.919270 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:53.757929 32697 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:53.926822 32697 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:53.936682 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.929237 32697 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:53.939446 32697 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:53.938845   318 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:53.942626 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60614.9us
I20260709 13:12:53.769143   694 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.758358   745 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.734767   776 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.027122   589 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.028173   589 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:53.768157   780 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.034914   589 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:54.037068   780 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:53.738854   817 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:54.037227 32394 consensus_queue.cc:1175] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4afe81810944d70bc2cc31754392f3d" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:53.756704   872 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:53.978974   566 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:53.760061   868 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:54.033813   601 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:54.038276   694 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.038857   817 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.064018   817 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:54.064746 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.039773   566 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:54.033123   698 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:54.062095   601 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.066366   566 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.078984 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:54.081019   776 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.081571 27232 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:54.072150   601 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.087713   589 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:54.089260 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 112451us
I20260709 13:12:54.092147   780 consensus_queue.cc:1059] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:54.102214 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.103068   589 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.104003   589 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.107649   589 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.116827   877 raft_consensus.cc:3055] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:54.117102 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.117326   877 raft_consensus.cc:740] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:54.120215 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:54.121206 27832 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.133554 27155 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
W20260709 13:12:54.135869 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 45640.8us
I20260709 13:12:54.136974 27123 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:54.142957   877 consensus_queue.cc:260] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.145414 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.146222 27835 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:54.144577   877 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.159935 27832 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:54.162775   887 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:54.172384 27834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35846 (request call id 2158) took 1740 ms. Trace:
I20260709 13:12:54.172847 27834 rpcz_store.cc:276] 0709 13:12:52.431405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.749689 (+318284us) service_pool.cc:224] Handling call
0709 13:12:53.535524 (+785835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.551405 (+ 15881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.172009 (+620604us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54004a7250. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d368ad 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:54.172194 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806224256}
I20260709 13:12:54.175107 27231 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.190972   601 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:54.204666   694 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:54.206394 32703 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.014s
W20260709 13:12:54.207470 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 70737.9us
I20260709 13:12:54.208811   898 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:54.211170   776 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:54.212833 27232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46400 (request call id 2481) took 2290 ms (client timeout 2002 ms). Trace:
I20260709 13:12:54.215276 27228 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:54.213382 27232 rpcz_store.cc:269] 0709 13:12:51.922335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.010926 (+ 88591us) service_pool.cc:224] Handling call
0709 13:12:54.212527 (+2201601us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54003d13d4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:54.212712 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4756761856}
I20260709 13:12:54.225898 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:54.226567 27150 consensus_meta.cc:287] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.007s
I20260709 13:12:54.226985 27150 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:54.227926 32697 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.229809 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:54.231753 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 554667us
I20260709 13:12:54.232079 27229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46412 (request call id 3735) took 1026 ms. Trace:
I20260709 13:12:54.232486 27229 rpcz_store.cc:276] 0709 13:12:53.205508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.437278 (+231770us) service_pool.cc:224] Handling call
0709 13:12:53.437431 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:53.437555 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:12:53.467671 (+ 30116us) log.cc:844] Serialized 14 byte log entry
0709 13:12:53.619132 (+151461us) log.cc:844] Serialized 14 byte log entry
0709 13:12:54.231148 (+612016us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b180012e980. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ebc4c0a 00007f9a58304219 00007f9a4ec4ca40 00007f9a4ec474e4 00007f9a4ec47455 00007f9a51d2f060 00007f9a51d41716 00007f9a51d52287 00007f9a51d52208
0709 13:12:54.231482 (+   334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:54.231581 (+    99us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:12:54.231685 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.231796 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.231938 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11962,"prepare.queue_time_us":30427,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":70,"raft.queue_time_us":376,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":10053,"spinlock_wait_cycles":13933952,"thread_start_us":143400,"threads_started":1,"wal-append.queue_time_us":233967}
I20260709 13:12:54.240192   566 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:54.231802 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 356762us
I20260709 13:12:54.246347   839 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:54.250592   589 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.251420   589 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.262547 27272 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.263895 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.264873   682 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.265727   682 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.266397   555 consensus_queue.cc:1048] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:54.268468   870 consensus_queue.cc:1059] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:54.269484   555 consensus_queue.cc:1059] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:54.270794   555 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:54.271255   678 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:54.271685   678 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.273142   870 raft_consensus.cc:3055] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:54.273547   870 raft_consensus.cc:740] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.272789   678 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.275075   678 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.278458 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.279503   774 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:54.280821   776 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:54.274659   870 consensus_queue.cc:260] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.280328 27195 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.225149 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:54.294811 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:54.223917   601 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:54.299540 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74457.6us
I20260709 13:12:54.300241   876 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:54.301393 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:54.306298 27225 raft_consensus.cc:2468] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
W20260709 13:12:54.306655   883 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.901s	user 0.001s	sys 0.023s
I20260709 13:12:54.306805 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:54.307721   566 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.284791   589 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.313647 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:54.314757 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.328387 27122 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:54.357550 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 79249.4us
I20260709 13:12:54.328830   876 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.366021   735 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:54.366173   632 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:54.368539 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:54.372359 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 92122.3us
I20260709 13:12:54.375382   836 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.375886   589 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.371760   876 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:54.383361   836 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:54.383857 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.384413   815 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:54.385689   918 log.cc:927] Time spent T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:12:54.387084 27837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1638) took 1408 ms. Trace:
I20260709 13:12:54.390137   735 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:54.391110   585 raft_consensus.cc:1064] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: attempting to promote NON_VOTER f4afe81810944d70bc2cc31754392f3d to VOTER
W20260709 13:12:54.393294 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.393846 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:54.394367   825 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.397480   812 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:54.430353   825 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.430547   812 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.432817   812 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:54.432600   585 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.402238   589 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.403332   694 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:12:54.407070 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 105955us
I20260709 13:12:54.407742 32703 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:54.419845   870 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:54.446687 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.414990 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:54.424660 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 178785us
I20260709 13:12:54.429766 27227 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:54.398263 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:54.434975 27806 leader_election.cc:400] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:54.435020   812 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.435544   500 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.436215   824 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:54.437498 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:54.443753 27840 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 10: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:54.439003 27152 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.448845 27806 leader_election.cc:403] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.441879   745 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.443588 32703 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.422770 27837 rpcz_store.cc:276] 0709 13:12:52.978480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.980502 (+  2022us) service_pool.cc:224] Handling call
0709 13:12:52.980759 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.981074 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.981106 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.985615 (+  4509us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.250667 (+265052us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:53.250727 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.250843 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.257613 (+1006770us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:54.386638 (+129025us) raft_consensus.cc:1685] finished
0709 13:12:54.386656 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.386902 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9968,"raft.queue_time_us":1138,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7545,"spinlock_wait_cycles":8715136,"thread_start_us":199128,"threads_started":1,"wal-append.queue_time_us":342319}
I20260709 13:12:54.459553 27195 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:54.463860 27303 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.464983 27804 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:54.465433   589 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.465472   812 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.468374   812 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.470278   778 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.444851   694 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:54.432837   825 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:54.476207 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 94606.9us
I20260709 13:12:54.477864   878 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:54.478396   878 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.478781   878 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.437976   836 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.479135   774 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:54.479785   774 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.481429   836 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.483197   827 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.483697   827 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.443092   897 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:12:54.491080 27150 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:54.472054 32703 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.470930   778 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.490860   827 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.421978   632 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.499123   752 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.486938   836 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:54.507741   812 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.510128   589 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.487191   678 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:54.490187   774 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:54.511567 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 99209.9us
I20260709 13:12:54.505618 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:54.519210 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.510286   812 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.509657   825 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) with higher term. Message: Invalid argument: T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 12. Current term is 13.
I20260709 13:12:54.515822 27195 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.510740   589 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.529114   778 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.529245   589 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.532635 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:54.533234 27230 raft_consensus.cc:3060] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.487237   500 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.498237   745 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.538465   632 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.538954 27297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34456 (request call id 2512) took 1054 ms. Trace:
I20260709 13:12:54.515313   836 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:54.539307 27297 rpcz_store.cc:276] 0709 13:12:53.484297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.485882 (+  1585us) service_pool.cc:224] Handling call
0709 13:12:54.538509 (+1052627us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001c9dd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:54.538731 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367342464}
I20260709 13:12:54.545032 27157 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:54.525146   887 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:54.555325   890 raft_consensus.cc:993] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:54.555783 27230 raft_consensus.cc:2468] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:54.555871   890 raft_consensus.cc:1081] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:54.556419 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:54.558252 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 56628.6us
W20260709 13:12:54.559149 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 63151.5us
I20260709 13:12:54.559268 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.560855 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.561637   353 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:54.510926   752 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.572355 27155 raft_consensus.cc:1240] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
I20260709 13:12:54.533871   878 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.575755 27303 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 20.
I20260709 13:12:54.575894 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:54.577569 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.521656   694 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:54.581617 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 146902us
I20260709 13:12:54.578509 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:54.582983   512 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:54.548174   774 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.577602   827 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.577389   353 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:54.592723 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.521274   735 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.600463   752 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.600526   353 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:54.606513 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.612594 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.614005 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:54.616569 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 150565us
I20260709 13:12:54.631108 27152 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 13: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:54.629719 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:54.633239   585 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:54.655328 27149 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:54.656458 32703 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.658372 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.605325   827 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.667647 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:54.677953 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61137.8us
I20260709 13:12:54.647960   825 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:54.686340 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.661051   585 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:54.688920 27122 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:54.626515   836 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.684566   825 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.691138   745 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.694810   585 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:54.713425   459 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:12:54.716995   926 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:54.726320 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.727361 27839 raft_consensus.cc:2410] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:12:54.728751 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.730332 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:54.731480 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.733318   924 log.cc:927] Time spent T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:12:54.733912   657 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.734563   657 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.737089   657 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:54.738186   887 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:54.738806   887 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.740893   887 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:54.742892 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 182102us
I20260709 13:12:54.744524 27834 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 LEARNER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:54.744637 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:54.745452 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.706482   825 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:54.721397   812 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:54.721848   459 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:54.758222 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.758912 27839 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 19.
I20260709 13:12:54.729939   878 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.759078   745 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:54.755326   500 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:54.773168 27053 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 13, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.780400   930 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:54.784456 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.787583 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:54.789808 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45269.6us
I20260709 13:12:54.793042 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.797564 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.797962   774 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.799780 27197 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.800634   839 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:54.802155 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:54.802951   839 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.805089 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.805927   839 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:54.807369 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.808034   678 raft_consensus.cc:993] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:54.808092 27297 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 19.
I20260709 13:12:54.808655   678 raft_consensus.cc:1081] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:12:54.809414 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:12:54.809628 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58431.6us
I20260709 13:12:54.811807   817 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:54.812868   817 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:54.813541   632 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:54.813639   817 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:54.814152   817 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.814288   318 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:54.811973 27272 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:54.815407   817 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.801610   876 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.827015 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.814078   632 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.812278 32703 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:54.831579 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.854210 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.852911 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.819581   318 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.864490 27225 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:12:54.866806 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61845.1us
I20260709 13:12:54.825347   745 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:54.871469 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.864498 27229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:12:54.861284   632 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:54.874938 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.871137 27228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:12:54.879738 27228 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.880103 27228 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:54.878089 27303 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:54.873703 27229 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.881613 27229 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.886682 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:54.865185   887 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.887454 27305 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:54.893705 27302 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:12:54.894452 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.878798   776 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:54.898406 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.879568   678 raft_consensus.cc:2804] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:54.902480   678 raft_consensus.cc:697] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:54.903577   678 consensus_queue.cc:237] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.904995   318 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:54.889751   817 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:54.906258   318 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.910208 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:54.910808 27836 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
W20260709 13:12:54.911501 27807 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.587s (SENT)
I20260709 13:12:54.911971 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:54.915863 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.913712 32703 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:54.927177 27197 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:54.931288 32394 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:54.914033   887 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.929314   812 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.945583 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:54.948700 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 177846us
W20260709 13:12:54.950548 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 96516.9us
I20260709 13:12:54.912875   459 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.971920 27228 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:54.934665   929 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:55.007345 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:55.007999 27155 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.010998 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.004907 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.013900 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:55.014313 27157 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:55.017086 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:54.976552   839 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.020548 27228 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.025449 32394 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.966444 32703 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:12:55.024161 27122 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.030694 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.026149 32394 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.013567   827 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.023607   745 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.042174 27154 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
W20260709 13:12:55.051399 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 84548.3us
I20260709 13:12:55.054720 27226 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:55.034487   876 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.053306 27152 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:55.062151   694 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:55.062492 27198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.047901   897 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.041049   929 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.064191 32394 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.032809   839 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.064723   932 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:12:55.098661 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74615.5us
I20260709 13:12:55.102792 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:55.102766 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.110219 27155 raft_consensus.cc:2468] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:55.111191 27299 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 18: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:55.111730 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:12:55.122097 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 144946us
I20260709 13:12:55.111227 32703 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:55.125419   739 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:55.125905 32703 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.127086   935 log.cc:927] Time spent T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:12:55.129035 32703 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.129653 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.131012 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.133250 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.134420 32394 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:55.134869 27806 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:55.135071 32394 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:55.135689 32394 consensus_queue.cc:1048] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:55.136126 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:55.137238 27806 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:55.138121   745 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.138571   745 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.138955   745 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:55.142249   812 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:55.142982   812 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.144038 27053 catalog_manager.cc:5697] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 13, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:55.134438   937 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:12:55.145696 27053 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index -1 to 12, term changed from 12 to 14, NON_VOTER f4afe81810944d70bc2cc31754392f3d (127.25.109.132) added. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } } }
I20260709 13:12:55.146687 27156 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:55.147403 27053 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 15, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:55.148603   827 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.148758   887 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.149149   827 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.149562 27232 raft_consensus.cc:1240] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:55.151278   827 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.152570 27300 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:55.137245 32394 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.090724   500 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:12:55.161413 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.161403 27229 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.163139 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.164108 27156 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
W20260709 13:12:55.170689 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 45717.4us
I20260709 13:12:55.097678   897 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.167784   942 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:12:55.154026   780 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.178815 27229 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.179570 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.183729 27804 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.168984   929 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.180847 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.175618 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.185624 27232 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:55.155897   774 consensus_queue.cc:1059] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:55.183696 27122 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.187747   812 raft_consensus.cc:2804] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:55.188324   812 raft_consensus.cc:697] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:55.188536   780 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.189247   812 consensus_queue.cc:237] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.207490 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.190210   872 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.209529   872 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:55.210079   872 raft_consensus.cc:3060] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.212790   776 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.177414   825 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.215788   825 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.171916   943 consensus_queue.cc:1059] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:12:55.216372   585 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.194149   929 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.197258 27053 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 12, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:55.235005   929 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.198609 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:55.238258 27298 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
W20260709 13:12:55.239583 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.239944 27228 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:55.240810 27227 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:55.242244   817 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:55.242638   817 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.201040   868 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.243520   868 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.245713   868 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:55.176352   739 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.205981 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:55.246592 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 71667.3us
I20260709 13:12:55.247680 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.248701   752 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:55.248862   500 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.249176   752 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.249526   500 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.189266   897 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.199740   774 raft_consensus.cc:3055] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:55.250185   500 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.250661   817 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:55.184194   735 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:55.251335   735 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.253310   735 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.253868 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.227473 32703 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:55.192970   839 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.254923 32703 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.223953 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.256366 27155 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:12:55.231528   632 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.230726   943 raft_consensus.cc:3055] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:55.257545   943 raft_consensus.cc:740] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:55.231698   825 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:55.258471   632 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.258394   943 consensus_queue.cc:260] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.258658   825 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.259725   943 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.249650   752 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:55.246644   739 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.263922   739 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.264510 32703 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:55.190701   780 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.250561   774 raft_consensus.cc:740] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:55.242607   585 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:55.266901   942 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:55.267738   895 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:55.209385 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:55.269847 27195 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:55.269855 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:55.281435 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 97808.9us
I20260709 13:12:55.266711   825 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.274828 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.282299 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.323518   942 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:55.324191   942 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:55.325661   735 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:55.274066   774 consensus_queue.cc:260] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.327344   872 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.329718 32703 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:55.331399 32703 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.331746 32703 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.333312   817 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.283726 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 74518.3us
W20260709 13:12:55.334338 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 64580us
I20260709 13:12:55.335412 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:55.336820 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.337586   827 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:55.338589 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52737.3us
I20260709 13:12:55.339300 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:55.345671 27232 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:55.330978   872 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.282651 27301 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:55.338243   839 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:55.372058 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.372010 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.385435 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.386368 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:55.386960 27840 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:55.386554 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
W20260709 13:12:55.388470 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 255262us
I20260709 13:12:55.391131 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.346930   780 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:55.392294 27149 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:55.396598 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.396188   827 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:55.371699   353 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:55.385166   825 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:12:55.403738 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 208633us
I20260709 13:12:55.403273 27155 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:55.367767   897 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:12:55.382239   839 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.402029 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.399911   353 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.408047 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:55.413136 27300 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:55.393105   946 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:55.388880   836 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:55.325518   942 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.394810   887 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.395208   780 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:55.400015   739 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:55.405694   632 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.417385 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:55.428225 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.428669 27841 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:12:55.415534 27122 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:55.419642 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:55.425843 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.429894 27152 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:55.415704   839 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.414477   353 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.437907   887 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:12:55.438769 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 70321.3us
I20260709 13:12:55.431310   946 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:55.440215   887 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.440013   946 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.442540   739 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.444556   739 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.444674   752 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.421545   868 raft_consensus.cc:3055] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:12:55.446766 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.438798   956 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:55.465831   956 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.466848   956 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:55.456204 27840 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 20.
W20260709 13:12:55.464564 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.465001 27841 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:55.465158 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.412281   694 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:12:55.425748   780 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:55.471407 27269 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.474282 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:55.474608 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:55.475170 27225 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:55.475819 27152 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:55.479269   694 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:55.455029   868 raft_consensus.cc:740] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:55.500852 27232 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:55.424472   836 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.428421   745 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.486734   942 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:55.530217 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:55.499055 27804 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:55.544961 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 129528us
W20260709 13:12:55.546233 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47249.4us
I20260709 13:12:55.454638   632 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.493430   929 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.550487 27122 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:55.531319 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 192096us
I20260709 13:12:55.573225 27122 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.574193 27122 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.574522 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.575172 27298 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:55.576404 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:55.580225 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 145272us
I20260709 13:12:55.581871 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.529887   957 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.562671   812 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:55.533891   825 consensus_queue.cc:1059] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:12:55.581441   739 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:55.579703   601 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:12:55.612638 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.627102   887 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:55.601442 27836 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:55.599718 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 155315us
I20260709 13:12:55.591367   817 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.698850 27225 raft_consensus.cc:2468] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
W20260709 13:12:55.696894 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 69323.2us
I20260709 13:12:55.602463   752 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.622893   967 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.677645   955 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.595584   678 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:12:55.674664   812 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.725157 27197 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:12:55.728696 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 105973us
I20260709 13:12:55.717363   876 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.694597   825 consensus_queue.cc:1243] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 1010256288ec4502b330749e2e3d7c85 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:12:55.732473 27269 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.732862 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:55.733556 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.706310   601 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:55.726555   812 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:55.735730   961 log.cc:927] Time spent T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:12:55.774181   955 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.777089   962 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:12:55.777247   955 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.778497 27155 raft_consensus.cc:2393] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:55.778668   963 log.cc:927] Time spent T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:12:55.790448   970 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:55.794432   601 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.770112   965 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:12:55.796192 27149 raft_consensus.cc:2468] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:12:55.727936   967 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.798915 27804 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:55.800433   632 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.764050   817 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:55.801010   956 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.801955   745 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.763801   876 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.803421   956 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.804136   745 raft_consensus.cc:2804] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:55.804840   876 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.794852   836 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:55.785744   500 consensus_meta.cc:287] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.000s
W20260709 13:12:55.811775 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 64002.6us
I20260709 13:12:55.800853   967 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:55.804790   745 raft_consensus.cc:697] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:55.842269 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:55.847476 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.848562   815 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.851491   969 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:55.852165 27836 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:12:55.854238 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 147549us
I20260709 13:12:55.856120 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.857074 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:55.857568 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.856557 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.858330 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.858745 27224 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 9.
I20260709 13:12:55.859194 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:55.859804 27223 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.860102 27835 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:55.850764 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:55.857821 27229 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:55.850992 27149 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:55.866937 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.867141 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.868186 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:55.869625   318 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:55.870508 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.871248 27231 raft_consensus.cc:2410] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:12:55.872117 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.872939 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.881482 27804 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:55.881708 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:55.861711   943 consensus_meta.cc:287] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.004s
I20260709 13:12:55.883445 27154 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:55.886888 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.851514   815 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.887362 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.887566 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:55.888686 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.889220 27231 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:12:55.887494 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.890131 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.890689 27837 raft_consensus.cc:1240] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:55.890805 27834 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:12:55.891687   353 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.893394   983 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.893989   983 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:55.894522 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:55.895458   887 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:55.889983 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:55.897511 27231 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:12:55.861197 32703 consensus_meta.cc:287] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.003s
I20260709 13:12:55.463930 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:55.861912   817 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.896019 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:55.907368 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.913534 27229 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 14.
I20260709 13:12:55.910409   969 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.915870   969 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.917323   986 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:55.918169 27834 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:55.839675   500 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.893922   353 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.921928 27301 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:55.902208 32703 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.926654 32703 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.927439   866 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:55.927901   866 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:55.928741   866 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:55.931442   958 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.309s	user 0.003s	sys 0.000s
I20260709 13:12:55.932540   815 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:55.934718   745 consensus_queue.cc:237] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.936422 27302 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:55.896615   983 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:55.938141 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:55.900319   897 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:55.950445 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:55.955924   887 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:55.956399   887 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.956815   887 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:55.962369 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 61273.6us
I20260709 13:12:55.963430   868 consensus_queue.cc:260] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.964514   780 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:55.973987 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:55.886463   739 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 17 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:55.924045   969 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:55.924808   953 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:55.983559 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:55.944829   632 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:55.947974   897 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.989128 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:55.999311 27300 consensus_meta.cc:287] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.004s
I20260709 13:12:55.999915 27300 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 20.
I20260709 13:12:55.970820   955 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:55.923444   817 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.005014 27227 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.013093 27122 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.017537 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.017812 27305 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:12:56.019205 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.001775   897 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.025157 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.025484 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.026345 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:55.979733   839 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.031575 27304 raft_consensus.cc:2393] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 18: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:56.031914 27306 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:56.031812 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.034535 27298 raft_consensus.cc:2410] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:12:56.035084 27297 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:56.035921 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.036484 27305 raft_consensus.cc:2393] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 10: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:56.036924 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.037396 27300 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.042440 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.043053 27225 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:12:56.042258   975 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:12:56.043869 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.056787 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.057430 27149 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:56.057499 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.046408   990 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:56.032542   815 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.053274   866 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.076975 27836 raft_consensus.cc:1240] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:56.027034 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.058425 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.074635 27225 raft_consensus.cc:2393] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:56.081091 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.075115 27223 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 10.
I20260709 13:12:56.081856 27225 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:56.082835 27230 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:56.001470   632 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.079505 27272 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:56.078497 27299 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:56.085750 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:56.086432 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 53248.7us
I20260709 13:12:56.093930 32394 raft_consensus.cc:2804] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:56.094113 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.095453 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.096217 27229 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:56.087116 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.096987 27226 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:56.020812   876 consensus_queue.cc:1059] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:12:56.155435 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.150794 32394 raft_consensus.cc:697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:56.154649 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.158943 27300 raft_consensus.cc:2468] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
W20260709 13:12:56.087520   977 log.cc:927] Time spent T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:12:56.158016 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:56.074361   990 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.172222 27149 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 18.
I20260709 13:12:56.173569 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.173717 27229 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:56.165093 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:56.177383 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.175961 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.182608 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:56.183647   972 log.cc:927] Time spent T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.282s	user 0.000s	sys 0.003s
I20260709 13:12:56.183940 27148 raft_consensus.cc:1240] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:56.185591 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.186406 27151 raft_consensus.cc:2368] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19.
I20260709 13:12:56.190696   989 consensus_queue.cc:1059] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:12:56.174129   990 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.193871   812 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.196532   812 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:56.093731   815 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.198137   825 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:12:56.199599 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.199803 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.200498 27806 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.201457   745 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.201831   745 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:56.202342   745 raft_consensus.cc:3060] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.203027   878 raft_consensus.cc:2804] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:56.203595   878 raft_consensus.cc:697] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:56.204516   878 consensus_queue.cc:237] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.205217   632 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.207393   989 raft_consensus.cc:3055] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:12:56.207952   989 raft_consensus.cc:740] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:56.209007   989 consensus_queue.cc:260] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.210176 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.211402 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.211934 27306 raft_consensus.cc:2376] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12. Re-sending same reply.
I20260709 13:12:56.212800   815 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:56.214234 27123 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 2.002s (SENT)
I20260709 13:12:56.201906   890 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.175755 32394 consensus_queue.cc:237] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.217551   839 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.216118   890 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.218302   890 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.220583   817 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.221575   500 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.222617   780 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.230997 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.231837 27229 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 18: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.238094   975 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:56.240387   975 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:12:56.242202   988 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:56.242558   988 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:56.243127 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.243808 27150 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:56.243470   988 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.245983 27151 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19. Ops: []
I20260709 13:12:56.246227 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.139143   739 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.248474 27269 leader_election.cc:400] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19.
I20260709 13:12:56.283120 27226 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 19.
I20260709 13:12:56.088017   870 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:12:56.285022   989 raft_consensus.cc:3060] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:56.285705 27157 raft_consensus.cc:1275] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:12:56.286031   990 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.287490 27833 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:56.290154 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.290685 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:56.340225 27835 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:56.302433 27123 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.340741 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.342115 27149 raft_consensus.cc:2393] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 18: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.311359 27231 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 17.
I20260709 13:12:56.329447 27232 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19. Ops: []
W20260709 13:12:56.324437 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 48128.2us
I20260709 13:12:56.358934 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.359032 27123 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:56.359701 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.361704 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.366194 32394 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:56.371058 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.371729 32394 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.361333   836 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.364617   979 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:56.382826 27269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.378108 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.386629 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.389197 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:56.390012 27838 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.360100   815 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:12:56.393769 27833 raft_consensus.cc:2393] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 20: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:56.395725 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.380311   827 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:56.400565 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.366916   890 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.416572 27123 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.423569 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.425066 32394 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.424400 27833 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:12:56.380751   839 consensus_queue.cc:1059] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:12:56.436117 27123 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.437845 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:56.382476   836 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.429543   870 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:56.451864 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.437072   979 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.447844   870 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:56.427785   887 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.447154   601 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:56.446954   827 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:56.470822 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75206.5us
I20260709 13:12:56.449776   839 raft_consensus.cc:3055] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:56.470008 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.471983 27123 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:56.447575   897 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:56.475769  1001 log.cc:927] Time spent T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:12:56.476004 27837 raft_consensus.cc:2368] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:56.475965   955 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:56.477471   868 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:56.478693   897 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:56.473774 27833 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:56.474949   981 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.470877   780 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:56.481809 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.487772 27231 raft_consensus.cc:2368] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17.
I20260709 13:12:56.483299 27225 raft_consensus.cc:1275] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:12:56.474344   839 raft_consensus.cc:740] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:56.489835 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.487317   780 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:56.490530   780 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.490557 27227 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:56.490239   839 consensus_queue.cc:260] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.491837 27225 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:12:56.484277 27835 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:56.491786 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.494987 27148 raft_consensus.cc:3060] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.492597 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.496873 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.497749 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:12:56.500275 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 116793us
I20260709 13:12:56.500478 27833 raft_consensus.cc:2368] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16.
I20260709 13:12:56.502995 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.504987 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.508121 27224 raft_consensus.cc:1240] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:12:56.507242   966 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.067s	user 0.005s	sys 0.000s
I20260709 13:12:56.509171 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.510146   836 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.509305   990 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.511498   890 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:56.512923 27807 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.038s	sys 0.063s
W20260709 13:12:56.513216 27807 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.038s	sys 0.063s
W20260709 13:12:56.513476 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 532767us
I20260709 13:12:56.514211   839 raft_consensus.cc:3060] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.518299   957 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.518889   957 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.519658 27298 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 12.
I20260709 13:12:56.521209 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.521539   957 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.500820   870 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.523042   870 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:56.528071  1011 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:56.528649  1011 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.531075   745 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.531531 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.533138   745 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.534081 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.534768 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.536706   976 raft_consensus.cc:3055] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:12:56.537065   976 raft_consensus.cc:740] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:56.541401 27838 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:56.542431 27832 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:56.545570 27195 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:56.544116 27302 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:56.548007 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.548717 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.549700 27302 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:56.537747   976 consensus_queue.cc:260] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.550685   981 consensus_queue.cc:1059] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:56.550985   601 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:56.551328   976 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:56.553829   887 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.557336 27302 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 18.
I20260709 13:12:56.558290 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.560704   988 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:56.564255 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.564934 27302 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:56.565600 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.565840 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.566517 27302 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:56.568863 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.550761   827 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:56.573530 27302 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:12:56.574225 27301 raft_consensus.cc:2376] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 18. Re-sending same reply.
I20260709 13:12:56.574831 27302 raft_consensus.cc:1240] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:12:56.576836 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.576900 27301 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:12:56.550005 27122 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.578487 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.579495 27122 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:56.531085  1011 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.623317 27301 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:12:56.626863 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.627346 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.580562   969 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.581606   601 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:56.628261 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.595360   887 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.608477   752 raft_consensus.cc:3055] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:56.635018   780 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:56.636983   974 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.847s	user 0.005s	sys 0.005s
I20260709 13:12:56.616127   827 raft_consensus.cc:697] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:56.646955   827 consensus_queue.cc:237] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.634863   601 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.650574   601 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.638705   752 raft_consensus.cc:740] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:56.652312   752 consensus_queue.cc:260] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.667398 27839 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:56.653463   752 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.677469 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.681934 27227 raft_consensus.cc:2410] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:56.684895 27301 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:12:56.686177 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:56.687075 27271 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:56.688431   953 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:56.688793   953 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.689132   953 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.689445   994 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:56.690191 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.691218   887 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:56.693959   942 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.694494   887 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:56.694687   942 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.695515   887 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.696732   942 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.698583 27053 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 8, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 8 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:56.639173   990 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:12:56.702036 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.702795 27303 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.703672 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.704418 27228 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
W20260709 13:12:56.705428 27807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.708781 27155 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:12:56.710856 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.711633 27153 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 14: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:56.690187   967 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:56.713510   967 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:56.713997   998 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.669s	user 0.001s	sys 0.000s
I20260709 13:12:56.715698   967 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.715961   780 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.701949 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.716722 27836 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 17.
W20260709 13:12:56.717787  1006 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.366s	user 0.002s	sys 0.000s
I20260709 13:12:56.718144 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet d87c41315a07486aa13067ad7c47c34a with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46398
I20260709 13:12:56.708580 27122 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.722501 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:56.727649 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.729470 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.730221 27228 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.729954 27053 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.728837   969 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:12:56.733310 27051 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 382) took 25212 ms (client timeout 15000 ms). Trace:
I20260709 13:12:56.733856   745 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:56.758694 27305 raft_consensus.cc:1275] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:12:56.735678   969 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:56.736196 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:56.760457 27298 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 20.
I20260709 13:12:56.738095 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1384) took 1329 ms. Trace:
I20260709 13:12:56.756788 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:56.740005 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.763836 27226 raft_consensus.cc:2393] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.739451 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.764391 27148 raft_consensus.cc:2468] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:56.742024 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.761590 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432318984ae54d3b86d6f16faa526523" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.739679 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.766175 27225 raft_consensus.cc:3060] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.737445 27152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.764771 27229 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 12.
I20260709 13:12:56.739789 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:56.746011 27271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.733382 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:56.741235 27053 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 18, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 18 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.771776 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.772764 27229 raft_consensus.cc:2393] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:56.772616 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.758183 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:56.774171 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:56.761909 27156 rpcz_store.cc:276] 0709 13:12:55.408508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.408660 (+   152us) service_pool.cc:224] Handling call
0709 13:12:55.420289 (+ 11629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.420578 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.420606 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.430821 (+ 10215us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.599496 (+168675us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:12:55.674213 (+ 74717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.674367 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.636402 (+962035us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:56.734476 (+ 98074us) raft_consensus.cc:1685] finished
0709 13:12:56.734497 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.737984 (+  3487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13537,"spinlock_wait_cycles":34762496,"thread_start_us":112698,"threads_started":1,"wal-append.queue_time_us":288387}
I20260709 13:12:56.776679 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.777277 27228 raft_consensus.cc:2368] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17.
I20260709 13:12:56.777376 27229 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.780241 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:56.750809  1021 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:56.788829 27053 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 16, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:56.799609 27225 raft_consensus.cc:2468] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
W20260709 13:12:56.801729 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60163.3us
I20260709 13:12:56.802649 27053 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 15, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:56.809352 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.725999   601 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:56.735212   500 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:12:56.810551 27053 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 11, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 11 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:56.810328 27838 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:56.812579 27804 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.825212   694 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.826081   967 raft_consensus.cc:2804] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:56.826627   967 raft_consensus.cc:697] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:56.827513   967 consensus_queue.cc:237] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.839076 27053 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 16 to 17, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 17 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:56.845283 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet d87c41315a07486aa13067ad7c47c34a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:12:56.851518   994 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:56.852057   994 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.852085   601 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.801266   969 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.854612 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:56.855394 27301 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:56.856809 27229 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:12:56.858222 27053 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 11, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 11 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:56.865119 27197 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:56.863279 27807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.109.130:33347 timed out after 1.557s (SENT) [suppressed 19 similar messages]
I20260709 13:12:56.870669 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:56.867064 27053 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 11, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 11 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:56.885527 27157 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:12:56.871794   929 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:56.895596 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:56.896473 27053 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 13, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:56.900576   752 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.901325 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:56.902140 27150 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:56.902906 27150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:56.903471 27150 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:12:56.901139   752 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.912369 27151 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:12:56.758782 27051 rpcz_store.cc:269] 0709 13:12:31.521000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.521165 (+   165us) service_pool.cc:224] Handling call
0709 13:12:56.733094 (+25211929us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:45.869206 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:45.870131 (+   925us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:45.870185 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:12:45.870203 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:45.997864 (+127661us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:45.997976 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:45.998000 (+    24us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:12:45.999727 (+  1727us) tablet.cc:701] Row locks acquired
0709 13:12:45.999785 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:12:45.999931 (+   146us) write_op.cc:270] Start()
0709 13:12:46.000079 (+   148us) write_op.cc:276] Timestamp: P: 1783602765999870 usec, L: 0
0709 13:12:46.000117 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:12:46.049636 (+ 49519us) log.cc:844] Serialized 8341 byte log entry
0709 13:12:46.752990 (+703354us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a4ec2d0ac 00007f9a57a87ab9 00007f9a4ec4969b 00007f9a4ec4793f 00007f9a4ec49c02 00007f9a518d120b
0709 13:12:47.485016 (+732026us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:48.008341 (+523325us) op_driver.cc:464] REPLICATION: finished
0709 13:12:48.148381 (+140040us) write_op.cc:301] APPLY: starting
0709 13:12:48.154234 (+  5853us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:48.637556 (+483322us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:48.637616 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:48.683433 (+ 45817us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b180016e8e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:49.271453 (+588020us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b180016e8e0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a522 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:12:50.122965 (+851512us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:50.290376 (+167411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:12:50.290432 (+    56us) write_op.cc:312] APPLY: finished
0709 13:12:50.402753 (+112321us) log.cc:844] Serialized 188 byte log entry
0709 13:12:50.514940 (+112187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:50.581455 (+ 66515us) write_op.cc:454] Released schema lock
0709 13:12:50.595470 (+ 14015us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:50.653246 (+ 57776us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:50.653290 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4938993,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":76575,"apply.run_cpu_time_us":58390,"apply.run_wall_time_us":2555196,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":139443,"prepare.run_cpu_time_us":107066,"prepare.run_wall_time_us":1284581,"raft.queue_time_us":242211,"raft.run_cpu_time_us":10749,"raft.run_wall_time_us":89621,"replication_time_us":2008038,"spinlock_wait_cycles":119739520,"thread_start_us":1312799,"threads_started":5,"wal-append.queue_time_us":1301490,"wal-append.run_cpu_time_us":45223,"wal-append.run_wall_time_us":2749562}]]}
W20260709 13:12:56.889436  1002 log.cc:927] Time spent T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.537s	user 0.001s	sys 0.002s
I20260709 13:12:56.882441   981 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:56.923415 27053 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 5 to 9, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 9 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:56.933434 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 61522.3us
I20260709 13:12:56.919907 27838 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:12:56.934450 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:56.934406 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:56.936777 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:56.945410 27053 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:56.928964   988 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:56.953868 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.912325  1015 consensus_queue.cc:1048] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:56.941951   895 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:56.941712   929 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:56.949631   353 raft_consensus.cc:2764] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:12:56.958542 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:56.958798   774 raft_consensus.cc:3060] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:56.945461   968 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.963711 27053 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 8, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 8 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.971257 27833 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:56.972699   946 raft_consensus.cc:3055] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:56.988379   946 raft_consensus.cc:740] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:56.952476   632 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:12:56.992247   978 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:56.992780   978 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:56.995512   978 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.996100   752 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:56.996678 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.975085   981 raft_consensus.cc:2804] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.003247   981 raft_consensus.cc:697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:57.004212   981 consensus_queue.cc:237] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.009431 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:56.967613 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:56.936524   870 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:12:57.010044 27227 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:56.983027   836 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:57.010998   836 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:57.012290   353 raft_consensus.cc:2764] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:12:57.012986   353 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:57.013384   836 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:56.983809   953 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.014659 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.015383 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.015915   953 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:56.985419   968 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:57.018420   968 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:57.024796   975 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.025949 27224 raft_consensus.cc:2410] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:12:57.028360 27839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1682) took 1125 ms. Trace:
I20260709 13:12:57.028693 27839 rpcz_store.cc:276] 0709 13:12:55.902875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.903012 (+   137us) service_pool.cc:224] Handling call
0709 13:12:55.915443 (+ 12431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.667810 (+752367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.028136 (+360326us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54007b7ad4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:57.028299 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728585600}
I20260709 13:12:57.030133 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.030763 27230 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:57.032438 27228 raft_consensus.cc:1275] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:12:57.032799 27228 pending_rounds.cc:85] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 10
I20260709 13:12:57.029824 27806 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:57.033051 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.033576   825 raft_consensus.cc:2804] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:56.962599   895 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.034129   825 raft_consensus.cc:697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:57.035077   825 consensus_queue.cc:237] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.033046 27228 pending_rounds.cc:107] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:12:57.036262 27228 raft_consensus.cc:2889] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:57.037495 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 58901.9us
I20260709 13:12:57.037823   694 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.009758   994 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.038307   459 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:57.039563 27226 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:12:57.039882   994 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:57.038555 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.034251   895 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.041397 27053 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 14, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:12:57.042784 27154 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
W20260709 13:12:57.043449 27195 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.043821 27123 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.025317   975 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:57.046811 27838 raft_consensus.cc:1240] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:57.039592 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.045332 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.044682 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.068041 27123 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.038352   694 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.068681   975 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:57.068948 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:57.069877 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.070693 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:57.071640 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.071818 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.072459 27225 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 11: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:57.073303 27806 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:57.074342 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:57.074931 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:57.072876 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.053509 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:57.070712 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.076887 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:57.077144 27229 raft_consensus.cc:2393] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 14: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:57.074342 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.075511 27302 raft_consensus.cc:2468] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:12:57.043416 27053 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 4 to 16. New cstate: current_term: 16 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.080554 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:57.082222 27230 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:57.082758 27300 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:57.082891 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:57.083642 27149 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.084508 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:57.085989 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 46465.6us
I20260709 13:12:57.097304 27227 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:57.088788 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.128872 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:57.129577 27839 raft_consensus.cc:3060] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.129889 27226 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:12:57.103084 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.130942 27232 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.103216 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:57.132683 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.062304   976 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.088737   876 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:57.099145   887 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:57.108549 27123 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.116715 27149 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:57.102550 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.099151 27840 raft_consensus.cc:1275] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:12:57.106300 27272 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.138660 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.139396 27224 raft_consensus.cc:2393] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 16: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:12:57.088292   967 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.142524 27197 leader_election.cc:400] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16.
I20260709 13:12:57.119092   745 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:12:57.108069   694 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:57.166270 27197 leader_election.cc:400] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:57.166709 27197 leader_election.cc:403] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:57.158572 27053 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 12, leader changed from <none> to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:12:57.164723 27157 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:12:57.168179 27840 pending_rounds.cc:85] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 11
I20260709 13:12:57.168526 27840 pending_rounds.cc:107] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:12:57.168880 27840 raft_consensus.cc:2889] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.167855 27053 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 7 to 8, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 8 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:12:57.162500 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 54021us
W20260709 13:12:57.164115 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 57913.3us
I20260709 13:12:57.101768   774 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.160785 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.174714 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.098698   994 consensus_queue.cc:1048] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:12:57.104251   739 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:12:57.176462 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.187463 27227 raft_consensus.cc:2410] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:57.177821 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.179105 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.188726 27225 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:57.166215   632 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:57.180986 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.181231 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.189725 27229 raft_consensus.cc:2376] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16. Re-sending same reply.
I20260709 13:12:57.181596   752 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for earlier term 13. Current term is 14.
I20260709 13:12:57.181828 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.104091   872 consensus_queue.cc:1048] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:12:57.179585 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.129792   868 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:12:57.159849   887 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:57.162470   942 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.195669 27807 leader_election.cc:400] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17.
I20260709 13:12:57.209478 27807 leader_election.cc:403] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:57.210588 27123 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:57.213759 27232 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:12:57.171447   995 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.145335  1013 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.168080   989 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.238011 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.200839 27839 raft_consensus.cc:2468] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 15.
I20260709 13:12:57.238842 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.191282   878 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.224838 27269 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:57.145484  1017 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:57.236750 27272 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.203799   967 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.209921   887 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:57.254011   866 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:57.254765 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:57.255414   817 raft_consensus.cc:2804] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:57.255942   817 raft_consensus.cc:697] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:57.256788   817 consensus_queue.cc:237] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.259022 27272 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.250284 27231 raft_consensus.cc:1275] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:12:57.260202 27231 pending_rounds.cc:85] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Aborting all ops after (but not including) 11
I20260709 13:12:57.260492 27231 pending_rounds.cc:107] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:12:57.260756 27231 raft_consensus.cc:2889] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:57.267585 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:57.268330 27299 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 11.
I20260709 13:12:57.262620   990 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:57.220358   942 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.267069   318 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:57.268990   994 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.266852  1017 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:57.271401   969 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:12:57.301192 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 62424.6us
I20260709 13:12:57.328425 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:12:57.330127 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 71185.7us
I20260709 13:12:57.287170   318 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.287647   990 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:57.286629  1038 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:57.280275   870 consensus_queue.cc:1059] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:12:57.300838   735 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:57.327057  1030 log.cc:927] Time spent T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:12:57.343945 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:57.344641 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:12:57.342870 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 90211us
I20260709 13:12:57.348245 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.349506 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.351066 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.335523   825 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:57.326216   986 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.350778 27807 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.339893   318 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:57.358412 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.353614   745 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.353188   989 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.352887   967 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.347396   812 consensus_queue.cc:1048] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:12:57.357211  1038 consensus_queue.cc:1048] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:12:57.400579 27123 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.367195  1045 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:57.366767  1047 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.360195   825 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:57.359081   878 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:57.390496 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.359948   986 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:57.416889  1042 log.cc:927] Time spent T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:57.419207  1044 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:57.420756   942 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:57.400198  1040 log.cc:927] Time spent T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:12:57.390846  1017 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.424177   897 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.410440 27123 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.369537   990 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:57.380435   895 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:57.451282 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 60900us
I20260709 13:12:57.426046   459 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.398859   739 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:12:57.450901  1047 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:57.479573 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 69251.6us
I20260709 13:12:57.480321 27123 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.488950   780 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:57.489074   979 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.497619 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:57.509956   895 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:57.511353   878 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:57.497694   825 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.471375  1044 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.514405 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:57.515053 27232 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.524703 27232 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:57.486928   986 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:57.475112   897 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.534883   887 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.535511  1047 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:57.536993   887 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:57.540148   897 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:57.541797 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:57.543871  1035 log.cc:927] Time spent T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:12:57.525728   780 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:57.542682 27302 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 20.
I20260709 13:12:57.548192 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:57.555227 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 311019us
W20260709 13:12:57.577652 27196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.556221 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:57.556795 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:57.588888 27148 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.572407 27197 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:57.593441 27197 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:57.601370 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:57.601585 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:57.569895  1034 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 13:12:57.603559 27157 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:57.611086 27836 raft_consensus.cc:3060] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:57.621699 27302 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:57.609642   981 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.605449 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:57.590749   989 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:12:57.654522 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 49158.8us
I20260709 13:12:57.644907 27148 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:57.657624 27269 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:57.656700 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.659965 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.660859  1010 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:57.662042  1017 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.663199 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.670869   895 raft_consensus.cc:2804] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:57.671446   895 raft_consensus.cc:697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:57.672370   895 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.676074 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:57.554023   780 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.654218   989 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.687889   989 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:57.680241   836 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:57.622746   968 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:12:57.738379 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 75227.5us
I20260709 13:12:57.704003   318 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.742774   318 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:57.703338  1038 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:57.745311   946 consensus_queue.cc:260] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.685324   992 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347) with higher term. Message: Invalid argument: T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17.
I20260709 13:12:57.782022 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:57.751147 27302 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:57.761070 27224 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:57.766331   872 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:57.767527 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:57.801520 27838 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:12:57.775259  1010 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.776779 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:57.787549 27298 raft_consensus.cc:1275] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:12:57.710999   836 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.792138 27297 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:57.806317 27227 raft_consensus.cc:1275] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:12:57.813320 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 51294.3us
W20260709 13:12:57.814268  1061 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:57.713357   774 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:57.825558   632 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:57.785290  1037 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:57.823416 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 46734.9us
I20260709 13:12:57.828260  1043 consensus_queue.cc:1048] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:57.832237 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 48573.9us
I20260709 13:12:57.858826 27300 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 20.
W20260709 13:12:57.818722  1022 log.cc:927] Time spent T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:12:57.862493 27122 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:57.867344 27227 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:57.868769 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:57.869743 27227 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:12:57.835081   836 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:57.831986   500 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:57.901053   500 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:57.899330 27838 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
I20260709 13:12:57.904471 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:12:57.928756  1056 log.cc:927] Time spent T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:57.890709   994 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.866791   774 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:12:57.866958  1017 consensus_queue.cc:1048] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:57.875386  1043 consensus_queue.cc:1048] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:12:57.875000   986 consensus_queue.cc:1059] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:12:57.931428   866 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:57.940399   976 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.007139  1058 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:57.947223   994 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:57.969234   866 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
W20260709 13:12:58.021886 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 130267us
I20260709 13:12:58.062177 27836 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:58.020924  1010 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:58.074415  1010 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:12:58.030652  1058 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:58.078269  1058 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:58.079182  1065 log.cc:927] Time spent T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:58.022729   976 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.060320  1074 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:58.082813  1074 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.085570  1074 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:58.098484  1036 log.cc:927] Time spent T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.896s	user 0.000s	sys 0.004s
W20260709 13:12:58.103003  1064 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:12:58.081017  1073 log.cc:927] Time spent T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:12:58.108084   976 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.118438   994 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.118645 27153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.119017 27230 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:58.121096 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.073437  1044 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.121568   866 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.126279 27228 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:12:58.133905 27300 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:58.138113 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.139773 27156 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:58.140790 27836 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:58.151379 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:58.162155 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.137586   957 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.186069 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.175604   872 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.188161 27300 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
I20260709 13:12:58.077889   989 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.143015   752 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:12:58.196022 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:58.195674 27804 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.190791   957 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:58.202912  1047 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:12:58.194015   872 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.208369   967 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:58.209545   500 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:58.265048 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 69092.9us
I20260709 13:12:58.266166 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:58.266942   500 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:58.267455   500 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.267869   500 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:58.284965 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 89365.6us
W20260709 13:12:58.299939 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.265328  1058 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
W20260709 13:12:58.303030  1085 log.cc:927] Time spent T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:58.284301  1052 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:58.320065  1084 log.cc:927] Time spent T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:58.322854   836 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:58.339095 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.359081 27225 raft_consensus.cc:1240] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:12:58.418502  1058 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:58.503283  1082 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:12:58.504698  1087 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:12:58.505545   989 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.509132   752 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.553143   957 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:58.555226 27154 raft_consensus.cc:1275] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:12:58.557600 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 138325us
I20260709 13:12:58.559927   752 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:58.553211   780 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:58.561244   946 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:58.561054   780 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.560173   952 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:12:58.563517   780 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.564122  1044 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:58.564623  1044 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.567058  1044 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.567796   969 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:58.560138   968 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:58.570122   968 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:58.571617 27226 raft_consensus.cc:1240] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:58.572170   968 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.572402   836 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.579129 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.414937   500 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.580881 27155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.581494   500 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:58.581848  1079 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.571s	user 0.007s	sys 0.000s
I20260709 13:12:58.582563 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.584399 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:58.584990  1046 raft_consensus.cc:3055] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:58.585392  1046 raft_consensus.cc:740] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:58.562345   752 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.580881 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:58.587965   836 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:58.588534   836 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.591820   774 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:58.592315   774 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.592658   836 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.593762 27156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47438 (request call id 1409) took 1074 ms. Trace:
I20260709 13:12:58.594378   872 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:58.559115 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 257503us
I20260709 13:12:58.594148 27156 rpcz_store.cc:276] 0709 13:12:57.519540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.519688 (+   148us) service_pool.cc:224] Handling call
0709 13:12:57.530083 (+ 10395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.140762 (+610679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.593540 (+452778us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000df054. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d37e01 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2 00007f9a5007248c 00007f9a500718c6
0709 13:12:58.593706 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401706880}
I20260709 13:12:58.602279 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.603435 27151 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:58.604153 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.604398 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:58.605270 27832 raft_consensus.cc:2368] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 20. Current term is 21.
I20260709 13:12:58.602804 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:12:58.607419 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 49942us
I20260709 13:12:58.611797 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.612577 27297 raft_consensus.cc:2410] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:12:58.613263 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:58.619642 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.620827 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:58.621421 27297 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:58.626328 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:58.627236 27225 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:58.632476 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 64848us
I20260709 13:12:58.633373 27306 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
W20260709 13:12:58.634443 27306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34440 (request call id 2691) took 1561 ms (client timeout 1669 ms). Trace:
W20260709 13:12:58.634819 27306 rpcz_store.cc:269] 0709 13:12:57.073314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.074135 (+   821us) service_pool.cc:224] Handling call
0709 13:12:58.634307 (+1560172us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54000bb154. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3b2fa 00007f9a56cfcb17 00007f9a502776d4 00007f9a50277662 00007f9a50277591 00007f9a5027750c 00007f9a502767c2 00007f9a5007248c 00007f9a500718c6 00007f9a5007126f
0709 13:12:58.634395 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3583381248}
I20260709 13:12:58.637811  1010 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.595176  1052 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.642870 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.644548 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.641880 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.646692 27224 raft_consensus.cc:1240] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:58.643376 27297 raft_consensus.cc:2468] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 21.
I20260709 13:12:58.643059 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:58.647956 27299 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.651209 27832 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:58.554774  1017 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:58.658627  1017 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:58.650025 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.594923   774 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.654528  1044 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:58.659960 27836 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:58.661399 27149 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:58.663496 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.667273 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.668280 27806 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:58.671597 27195 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.650029   986 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:58.679672 27223 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:12:58.683279   500 raft_consensus.cc:2804] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:58.672813  1044 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.683915   500 raft_consensus.cc:697] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:58.688429 27149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.675980  1037 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:12:58.680780  1058 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.678769   774 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:58.691756 27231 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:58.684868   500 consensus_queue.cc:237] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.649821  1046 consensus_queue.cc:260] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.697263  1046 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:58.699218   585 consensus_queue.cc:1048] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:58.699743   895 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:58.701443   895 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:58.688009   752 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:58.676079  1010 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:58.675802   968 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:58.655406   780 consensus_queue.cc:1059] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:12:58.728897 27225 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 16.
W20260709 13:12:58.707924 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.720234 27195 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:58.728891 27832 raft_consensus.cc:1240] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:58.732721 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:58.734150 27841 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:58.735824  1044 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:12:58.736538 27805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.737677 27299 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 20.
I20260709 13:12:58.738760 27225 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
W20260709 13:12:58.743144 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 53107.2us
I20260709 13:12:58.745199 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.748628 27806 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:58.752346   836 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:58.755398  1044 raft_consensus.cc:2804] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:58.687228   986 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.783494 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.786875 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.788820 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.789692 27299 raft_consensus.cc:2393] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 in current term 20: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:12:58.791246 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:58.791599 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.791949 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.792162 27154 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 19.
I20260709 13:12:58.793499 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:58.800011 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.806951 27156 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:58.811836 27299 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:58.813392 27299 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:12:58.813731 27299 pending_rounds.cc:85] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Aborting all ops after (but not including) 10
I20260709 13:12:58.829730 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.840014 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:58.840804 27156 raft_consensus.cc:3060] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:58.841884 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.843577 27148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:58.788667   952 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.787231  1044 raft_consensus.cc:697] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:58.813974 27299 pending_rounds.cc:107] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:12:58.854811 27299 raft_consensus.cc:2889] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:58.878146 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 117379us
W20260709 13:12:58.883889 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 233922us
I20260709 13:12:58.891031 27832 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:12:58.909729 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 154524us
I20260709 13:12:58.866796  1052 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.857365   952 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.932845 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.933521 27834 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 12.
I20260709 13:12:58.888296  1017 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.952596 27226 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:58.960577 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:12:58.954708 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 158299us
I20260709 13:12:58.929129  1015 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:58.936553 27151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
W20260709 13:12:58.964145 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 78472.8us
I20260709 13:12:58.936182  1052 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:12:58.970957  1060 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:58.977463  1060 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:12:58.984342 27182 heartbeater.cc:646] Failed to heartbeat to 127.25.109.190:33321 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.109.190:33321 timed out after 15.000s (SENT)
I20260709 13:12:58.985607  1060 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:58.988437 27156 raft_consensus.cc:2468] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 20.
W20260709 13:12:58.990561 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 140819us
I20260709 13:12:58.991202 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:58.991539   500 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.992244   500 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:58.995081   500 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:58.998328 27151 raft_consensus.cc:606] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:58.998756 27151 raft_consensus.cc:614] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:58.999696 27122 leader_election.cc:400] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for earlier term 20. Current term is 21.
I20260709 13:12:58.968313   817 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:12:58.941521  1044 consensus_queue.cc:237] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.004878 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:12:59.017390 27806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.998725   986 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:12:59.024545  1111 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:59.024396   976 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:59.028414   981 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:59.031237 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.022415 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.034446 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.037151 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.055332 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.056078 27154 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:12:59.019094  1017 consensus_queue.cc:1059] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:12:59.039812   968 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.067233   968 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.071108   459 raft_consensus.cc:3055] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:59.071658   459 raft_consensus.cc:740] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:59.073148   952 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:12:59.074913  1076 log.cc:927] Time spent T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 1.062s	user 0.007s	sys 0.010s
I20260709 13:12:59.005605  1106 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:12:59.047349  1043 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:59.069922   968 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.083887   976 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.094310 27269 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:12:59.089591   967 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:59.114768 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.072659   459 consensus_queue.cc:260] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:59.114540   817 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:59.115146  1017 raft_consensus.cc:3055] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:59.149866 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.113360   976 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: NON_VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: true } }
I20260709 13:12:59.136940  1017 raft_consensus.cc:740] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:59.136705   817 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:59.118878   967 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.182261  1134 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.182953  1134 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.185268  1134 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.187443 27302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40558 (request call id 1270) took 1036 ms. Trace:
I20260709 13:12:59.187971 27302 rpcz_store.cc:276] 0709 13:12:58.151023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.152491 (+  1468us) service_pool.cc:224] Handling call
0709 13:12:58.152805 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:58.203168 (+ 50363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:58.203198 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:59.008721 (+805523us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18003b04a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a
0709 13:12:59.009088 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 13:12:59.118832 (+109744us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:12:59.118864 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.118929 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.187040 (+ 68111us) raft_consensus.cc:1685] finished
0709 13:12:59.187073 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.187365 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39074,"raft.queue_time_us":48113,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3995,"spinlock_wait_cycles":9052800,"thread_start_us":109426,"threads_started":1,"wal-append.queue_time_us":124525}
W20260709 13:12:59.190497  1114 log.cc:927] Time spent T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:12:59.191499  1069 log.cc:927] Time spent T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 1.179s	user 0.011s	sys 0.020s
I20260709 13:12:59.192648 27840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35852 (request call id 1703) took 2013 ms. Trace:
I20260709 13:12:59.193813 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.193004 27840 rpcz_store.cc:276] 0709 13:12:57.179015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.191594 (+ 12579us) service_pool.cc:224] Handling call
0709 13:12:57.215705 (+ 24111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.221942 (+  6237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.221972 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.564209 (+342237us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c00012928. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50630a11 00007f9a50640372 00007f9a51d72a01 00007f9a51d3743a 00007f9a51d3683e 00007f9a56cfb419 00007f9a50272bd4 00007f9a50272b62 00007f9a50272a91 00007f9a50272a0c 00007f9a50271cc2
0709 13:12:57.564711 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.683622 (+118911us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:12:57.683674 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.683773 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:59.167454 (+1483681us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a4ead2db1 00007f9a4eb70c85 00007f9a4eb716a2 00007f9a518e31db 00007f9a518deaaf 00007f9a518d286e 00007f9a518d1bb6 00007f9a518d17d8 00007f9a518db221 00007f9a518db1d9 00007f9a518db169
0709 13:12:59.192449 (+ 24995us) raft_consensus.cc:1685] finished
0709 13:12:59.192475 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.192597 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5807,"raft.queue_time_us":6195,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":15421,"spinlock_wait_cycles":40362752,"thread_start_us":118461,"threads_started":1,"wal-append.queue_time_us":447005}
I20260709 13:12:59.194478 27151 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:12:59.196345 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:59.174409   780 consensus_queue.cc:1059] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:12:59.197775  1131 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:59.200412  1131 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.200470   967 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:59.200886  1131 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.201128  1017 consensus_queue.cc:260] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.198359   780 raft_consensus.cc:3055] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:59.202562   780 raft_consensus.cc:740] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:59.203397   780 consensus_queue.cc:260] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.204181   976 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:59.173262   817 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.202576  1017 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.217185 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.218262  1038 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:59.219149  1011 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:59.219583  1011 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:12:59.219957  1011 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.222122 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:59.223323 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.224416  1037 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:59.224828  1037 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.225157  1037 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.204537   780 raft_consensus.cc:3060] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:59.233623 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.234436 27300 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:59.154309   459 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.242913 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.243953 27302 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:59.264644 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:59.267118 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:59.270084 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.272529 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.274871 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.277464 27841 raft_consensus.cc:1240] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 LEADER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:59.283553 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.292448 27154 raft_consensus.cc:1275] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:12:59.294922 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 258028us
W20260709 13:12:59.297802 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 60686.2us
I20260709 13:12:59.301994 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.301560 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:12:59.306295 27836 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:59.311297 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.284618   994 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:59.319186 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.313738 27122 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.308522 27807 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.322677 27226 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:12:59.260460  1058 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:12:59.284282   986 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:59.350301  1130 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:59.350914  1130 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.353024  1130 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.353240  1131 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.286870   745 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:12:59.337863   992 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:59.322706   752 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:59.357007 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:59.371235 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 57573.2us
I20260709 13:12:59.372253 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.358412 27807 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:59.300453  1135 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:12:59.360438 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
W20260709 13:12:59.331385  1136 log.cc:927] Time spent T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:12:59.364255 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.374395 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.323686  1134 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:59.385231   817 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.387880 27122 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.396054 27154 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:59.394620 27223 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:59.407430 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.400372 27224 raft_consensus.cc:2410] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1010256288ec4502b330749e2e3d7c85 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:12:59.406216 27228 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:59.411195 27839 raft_consensus.cc:2410] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:12:59.406239  1121 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:59.414932  1121 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:12:59.415340  1121 raft_consensus.cc:3060] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.413882 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.417524 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:12:59.418787 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 58373.4us
I20260709 13:12:59.419468 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.425777 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.399490  1146 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:59.416819  1058 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:59.439117  1011 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.444551   812 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:59.445122   812 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.448920   812 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:59.451719 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:59.456970 27804 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.457809   745 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.458679   745 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:59.459136   745 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.460868   812 consensus_queue.cc:1048] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:59.461665   745 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:59.463960 27841 raft_consensus.cc:1275] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:12:59.469308  1115 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:59.472211 27304 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:59.478322  1037 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:59.479624 27302 raft_consensus.cc:1240] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Rejecting Update request from peer 1010256288ec4502b330749e2e3d7c85 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:12:59.480453  1037 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:59.486146 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:59.487175 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
W20260709 13:12:59.491511 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 63811us
W20260709 13:12:59.481798  1148 log.cc:927] Time spent T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:12:59.493747 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 68073.4us
I20260709 13:12:59.398036  1135 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.499641 27298 raft_consensus.cc:1240] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 19. Current term is 20. Ops: []
I20260709 13:12:59.481349  1011 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.504230 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:59.507635 27304 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:59.509586 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.512902 27271 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.508595 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.501556  1130 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.525249  1046 consensus_queue.cc:1059] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:59.526561   992 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:59.526902   992 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:59.527696   992 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.528227  1135 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.529436   943 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:59.530550 27148 raft_consensus.cc:1275] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:12:59.530997 27148 pending_rounds.cc:85] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Aborting all ops after (but not including) 15
I20260709 13:12:59.531219 27148 pending_rounds.cc:107] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:12:59.531438 27148 raft_consensus.cc:2889] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:59.532361   992 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.517593  1131 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.500816  1146 consensus_queue.cc:1059] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:59.514312   890 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:12:59.518965   774 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.535964  1044 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:59.515153 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.538270   774 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:59.540663  1131 consensus_queue.cc:1048] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:59.549295 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:59.561779  1146 raft_consensus.cc:3055] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:12:59.562254  1146 raft_consensus.cc:740] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:12:59.563066  1146 consensus_queue.cc:260] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:12:59.564296  1146 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:59.568154   817 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:12:59.548044 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd514c8b688c4f2e90b6ad46174723ef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:59.569406 27154 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:59.569473 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 77301.2us
I20260709 13:12:59.575242 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:12:59.579698 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:12:59.573096  1044 consensus_queue.cc:1059] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:12:59.586486   745 raft_consensus.cc:3055] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:59.586947   745 raft_consensus.cc:740] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:59.587905   745 consensus_queue.cc:260] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.589396   745 raft_consensus.cc:3060] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:59.596135 27154 raft_consensus.cc:2468] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:12:59.597337 27195 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:12:59.598996 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.600924 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:59.604894 27123 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.573444   976 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:59.604306   774 raft_consensus.cc:2804] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:59.614898  1143 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.611336   774 raft_consensus.cc:697] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:59.617709   774 consensus_queue.cc:237] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.629001 27123 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.638538 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.638828 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.641279 27197 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.653096 27156 raft_consensus.cc:1240] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:59.653461 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.655907 27156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:12:59.656945 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.658411 27156 raft_consensus.cc:606] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.659264 27156 raft_consensus.cc:614] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.574836  1121 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.636178  1143 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.668483  1046 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.690166   878 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:12:59.702734   967 consensus_queue.cc:1048] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:12:59.658474  1074 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:59.632364   459 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:12:59.717522 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 52116.9us
I20260709 13:12:59.725173 27807 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.730865 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.643535  1135 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:12:59.734740   994 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:59.755347 27156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51fed810b66a4d09868add1d38749c15"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:12:59.756023 27300 raft_consensus.cc:1275] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:59.757481 27156 raft_consensus.cc:606] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:12:59.757848 27156 raft_consensus.cc:614] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.745970   872 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:59.716048  1046 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.718604   878 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.750291   752 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:59.768724   752 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:12:59.776407   752 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.767269   745 consensus_queue.cc:1048] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:12:59.788089 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:59.788705 27302 raft_consensus.cc:606] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.789026 27302 raft_consensus.cc:614] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:59.791700 27302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:12:59.792325 27302 raft_consensus.cc:606] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.793619 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:59.795397 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:59.812736  1121 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:59.815285  1046 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:12:59.815317 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:12:59.824707 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.825434 27223 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:12:59.827344 27838 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 20.
I20260709 13:12:59.824887   878 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:12:59.832674 27807 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:12:59.834599   745 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.835022   745 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.835395   745 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.849727 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:12:59.777925   752 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:59.862556 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:12:59.863458 27156 raft_consensus.cc:2393] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 15: Already voted for candidate 1010256288ec4502b330749e2e3d7c85 in this term.
I20260709 13:12:59.867523 27232 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
W20260709 13:12:59.871500 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 67382.5us
I20260709 13:12:59.873509 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:12:59.873847 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:12:59.874183 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:59.887190   946 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:59.887728   946 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:12:59.888557   946 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.891674 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:12:59.892074 27304 raft_consensus.cc:2468] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
W20260709 13:12:59.894186 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 66778.5us
W20260709 13:12:59.896584 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47170.1us
I20260709 13:12:59.913419 27804 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:12:59.918093 27806 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:12:59.925479   992 raft_consensus.cc:2804] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:59.926071   992 raft_consensus.cc:697] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:12:59.926990   992 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:12:59.921008  1121 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:00.005671   745 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:00.154891 27151 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:00.158346 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:00.165352 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:00.166025 27232 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.127106  1113 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:00.168325  1113 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:00.169289 27300 raft_consensus.cc:3060] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.171533 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:00.172331  1113 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:00.173514   817 raft_consensus.cc:993] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:00.156399   745 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:00.173993   817 raft_consensus.cc:1081] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:00.176563 27300 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
W20260709 13:13:00.124987  1169 log.cc:927] Time spent T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:13:00.180205  1134 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:00.182515 27227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:13:00.192008 27227 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.192404 27227 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.192449 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:00.193272 27832 raft_consensus.cc:2368] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14.
I20260709 13:13:00.199357 27232 raft_consensus.cc:2468] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 14.
I20260709 13:13:00.197808 27806 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:00.201596 27271 leader_election.cc:400] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14.
I20260709 13:13:00.201889 27271 leader_election.cc:403] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.204533   817 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741) with higher term. Message: Invalid argument: T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 13. Current term is 14.
I20260709 13:13:00.204640   989 raft_consensus.cc:2804] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:00.206254   989 raft_consensus.cc:697] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:00.207100   989 consensus_queue.cc:237] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:00.212350 27227 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.220402 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:13:00.221055 27157 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:00.227162  1170 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:13:00.238938 27157 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
W20260709 13:13:00.332476 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 134726us
I20260709 13:13:00.343962 27838 raft_consensus.cc:1275] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:13:00.344408 27838 pending_rounds.cc:85] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 10
I20260709 13:13:00.344673 27838 pending_rounds.cc:107] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:13:00.344991 27838 raft_consensus.cc:2889] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:00.347316 27227 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:00.350988 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:00.351568 27304 raft_consensus.cc:3055] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:00.351874 27304 raft_consensus.cc:740] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:00.353468 27304 consensus_queue.cc:260] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.354874 27304 raft_consensus.cc:3060] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.364342 27195 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:00.365511   752 raft_consensus.cc:2804] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:00.366042   752 raft_consensus.cc:697] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:13:00.366595 27053 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 387) took 16473 ms (client timeout 15000 ms). Trace:
I20260709 13:13:00.366945   752 consensus_queue.cc:237] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.370712 27304 raft_consensus.cc:2468] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:00.413364 27051 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:13:00.367017 27053 rpcz_store.cc:269] 0709 13:12:43.892780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.893095 (+   315us) service_pool.cc:224] Handling call
0709 13:13:00.366371 (+16473276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:57.516672 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:57.517387 (+   715us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:57.517438 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:12:57.517462 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:57.539591 (+ 22129us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:57.539680 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:57.539705 (+    25us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:12:57.936375 (+396670us) tablet.cc:701] Row locks acquired
0709 13:12:57.953010 (+ 16635us) write_op.cc:260] PREPARE: finished
0709 13:12:58.021428 (+ 68418us) write_op.cc:270] Start()
0709 13:12:58.068051 (+ 46623us) write_op.cc:276] Timestamp: P: 1783602778016106 usec, L: 0
0709 13:12:58.070370 (+  2319us) op_driver.cc:348] REPLICATION: starting
0709 13:12:58.071313 (+   943us) log.cc:844] Serialized 8869 byte log entry
0709 13:12:58.958411 (+887098us) op_driver.cc:464] REPLICATION: finished
0709 13:12:59.180219 (+221808us) write_op.cc:301] APPLY: starting
0709 13:12:59.180322 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:59.457484 (+277162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:59.457596 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:59.809064 (+351468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:59.809403 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:12:59.809462 (+    59us) write_op.cc:312] APPLY: finished
0709 13:12:59.809915 (+   453us) log.cc:844] Serialized 196 byte log entry
0709 13:12:59.947100 (+137185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:59.971816 (+ 24716us) write_op.cc:454] Released schema lock
0709 13:12:59.976844 (+  5028us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:59.994576 (+ 17732us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:00.001122 (+  6546us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2157936,"reported_tablets":39,"spinlock_wait_cycles":14720,"child_traces":[["op",{"apply.queue_time_us":215466,"apply.run_cpu_time_us":59098,"apply.run_wall_time_us":805178,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95955,"num_ops":22,"prepare.queue_time_us":119371,"prepare.run_cpu_time_us":14562,"prepare.run_wall_time_us":668869,"raft.queue_time_us":628370,"raft.run_cpu_time_us":3045,"raft.run_wall_time_us":212622,"replication_time_us":862614,"thread_start_us":868473,"threads_started":5,"wal-append.queue_time_us":277881,"wal-append.run_cpu_time_us":118560,"wal-append.run_wall_time_us":1591560}]]}
I20260709 13:13:00.420185 27051 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 15 to 17, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 17 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.422721 27051 catalog_manager.cc:5697] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.428567 27051 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.431919 27156 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:00.432608 27304 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:13:00.434995 27121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.434592 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 82050.9us
I20260709 13:13:00.432600 27051 catalog_manager.cc:5697] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 14 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.447337 27157 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:00.459547 27051 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 16, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 16 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.461081 27051 catalog_manager.cc:5697] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.462412 27051 catalog_manager.cc:5697] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.464008 27051 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 12, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.449824 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet d87c41315a07486aa13067ad7c47c34a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46398
I20260709 13:13:00.465485 27051 catalog_manager.cc:5697] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 15, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 15 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.470181 27051 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 17 to 20, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 20 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.471750 27051 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 16 to 19, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 19 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.473050 27051 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 15, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 15 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.474577 27051 catalog_manager.cc:5697] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 15, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.475937 27051 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.477991 27051 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 13, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.479106   780 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.479655   780 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.481734   780 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:00.479446 27051 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 6 to 10, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 10 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.483651 27051 catalog_manager.cc:5697] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.484833 27051 catalog_manager.cc:5697] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 10, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 10 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.448949  1131 consensus_queue.cc:1048] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:13:00.488796 27051 catalog_manager.cc:5697] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 17 to 20, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 20 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.495839 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:00.502761 27227 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 12.
I20260709 13:13:00.446007   967 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:13:00.504696 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:00.504457 27051 catalog_manager.cc:5697] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 18, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 18 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.508558 27051 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 15, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 15 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.510227 27051 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.512284 27123 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:00.523757 27156 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:00.515412 27051 catalog_manager.cc:5697] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 14, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.524735 27051 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.526309 27051 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 12, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
W20260709 13:13:00.538339 27052 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 338) took 49611 ms (client timeout 15000 ms). Trace:
I20260709 13:13:00.534039 27051 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 20, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 20 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:00.542021 27052 rpcz_store.cc:269] 0709 13:12:10.879508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.882834 (+  3326us) service_pool.cc:224] Handling call
0709 13:12:12.297886 (+1415052us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:13:00.462858 (+48164972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122551,"reported_tablets":46,"spinlock_wait_cycles":2011221760}
I20260709 13:13:00.543280 27051 catalog_manager.cc:5697] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 15, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 15 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.550624 27156 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:13:00.554786 27832 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:13:00.531955  1146 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:00.523330  1046 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:13:00.567282 27051 catalog_manager.cc:5697] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 20, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 20 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.570853 27051 catalog_manager.cc:5697] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.573216 27051 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.575769 27051 catalog_manager.cc:5697] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.582645   946 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:00.583966   946 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:00.601128  1134 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:00.601768  1134 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.604851  1134 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:00.619752 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:13:00.620411 27156 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 20.
I20260709 13:13:00.559346  1146 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.625154  1146 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:00.638366 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:00.654386 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:00.655447 27300 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 20: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:13:00.577706 27051 catalog_manager.cc:5697] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 11, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } }
I20260709 13:13:00.661578 27051 catalog_manager.cc:5697] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.662855 27051 catalog_manager.cc:5697] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 11 to 17, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 17 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:00.667968 27051 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 16, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 16 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.669904 27051 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 9 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 14 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.649886  1037 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:00.663314  1017 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:00.690186  1017 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:00.690732  1017 raft_consensus.cc:3060] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:00.703490 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 147404us
I20260709 13:13:00.692696  1037 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:00.729733 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 50120.8us
W20260709 13:13:00.730454 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 50944.9us
I20260709 13:13:00.742969 27838 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:13:00.777676 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 123175us
I20260709 13:13:00.781960 27227 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:00.753989  1143 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:13:00.822103 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.827684 27151 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.836555 27227 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:00.838132   878 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:00.840866  1178 log.cc:927] Time spent T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:13:00.842206  1180 log.cc:927] Time spent T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:13:00.845315 27298 raft_consensus.cc:1275] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:00.844173 27304 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:00.914881 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet d87c41315a07486aa13067ad7c47c34a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:00.845340   780 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:13:00.916514 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 84446.7us
I20260709 13:13:00.898084  1017 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:00.901093   868 consensus_queue.cc:1048] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:13:00.952066 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 58778us
I20260709 13:13:00.976007 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:13:00.978863  1037 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:01.034643  1190 log.cc:927] Time spent T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:13:01.038796  1017 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:00.950414  1146 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:01.060110 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 121058us
W20260709 13:13:01.066138 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 189203us
I20260709 13:13:01.090518 27156 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:01.092003 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:01.093165 27157 raft_consensus.cc:2368] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:13:01.097721 27231 raft_consensus.cc:2393] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 12: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:01.100504 27154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85"
W20260709 13:13:01.117020  1193 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.257s	user 0.002s	sys 0.010s
I20260709 13:13:01.123994  1146 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:01.096853   745 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:01.131574   745 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:01.131148 27227 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:13:01.140844   745 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:01.153594 27154 raft_consensus.cc:2468] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 20.
I20260709 13:13:01.155210 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:01.155927 27232 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:13:01.161350  1173 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:01.167249  1080 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:01.193193 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:01.193836 27302 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.194720 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:01.195494 27300 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:13:01.220808 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:01.221573 27231 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.240808 27231 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:13:01.239207 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:01.232457 27195 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:01.259843 27302 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:13:01.255070 27223 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:01.281955 27122 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
W20260709 13:13:01.283255 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 47227.7us
I20260709 13:13:01.292127  1143 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:01.292865  1143 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:01.293962  1143 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:01.319872 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 89252.8us
I20260709 13:13:01.274536  1043 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:01.318499  1182 raft_consensus.cc:2804] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:01.358814 27306 raft_consensus.cc:1275] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:01.357566 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:01.362808 27300 raft_consensus.cc:2393] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 20: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:13:01.351763  1043 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:01.370493 27269 leader_election.cc:400] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:13:01.374795 27269 leader_election.cc:403] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:01.386343  1137 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:01.389533  1204 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) with higher term. Message: Invalid argument: T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for earlier term 12. Current term is 13.
I20260709 13:13:01.377648  1043 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.407433  1199 consensus_queue.cc:1048] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:01.419211 27838 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:01.364369  1182 raft_consensus.cc:697] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 20 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:01.464125  1191 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.464762  1191 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:01.468065 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:13:01.469311 27156 raft_consensus.cc:2410] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:13:01.470270 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:01.471371  1182 consensus_queue.cc:237] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:01.472644 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:01.472297  1043 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:01.480568  1191 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:01.482307  1043 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:01.484155  1112 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:01.493398 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:01.502363 27232 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:13:01.547888 27807 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:01.566843   989 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:01.628983 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 180528us
I20260709 13:13:01.573457  1194 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.640802 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:01.644801   989 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:01.645889   989 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:01.672595  1214 log.cc:927] Time spent T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:13:01.650202  1194 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:01.733613 27228 raft_consensus.cc:2955] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 6 to 11, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:01.741549 27300 raft_consensus.cc:2393] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 13: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:13:01.768447  1137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54872 (request call id 2) took 1409 ms. Trace:
I20260709 13:13:01.768954  1137 rpcz_store.cc:276] 0709 13:13:00.363357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.380220 (+ 16863us) service_pool.cc:224] Handling call
0709 13:13:00.446594 (+ 66374us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b580060c2d0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51c930aa 00007f9a51d15447 00007f9a51d3270a 00007f9a51d3376a 00007f9a51d3291b 00007f9a51d3e03c 00007f9a51d3d6b3 00007f9a51d359fa 00007f9a56cfd4c9 00007f9a50279c54
0709 13:13:00.495692 (+ 49098us) log.cc:844] Serialized 508 byte log entry
0709 13:13:01.102675 (+606983us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001d9820. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51cacdbe 00007f9a51cb7930 00007f9a51cb78d8 00007f9a51cb7858 00007f9a51cb7813 00007f9a51cb6a9c 00007f9a57ba2626 00007f9a57b9cdd8 00007f9a51cf37cb 00007f9a51cf62c0
0709 13:13:01.768316 (+665641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14404,"raft.queue_time_us":21704,"raft.run_cpu_time_us":1469,"raft.run_wall_time_us":55776,"spinlock_wait_cycles":350780160,"thread_start_us":184120,"threads_started":2,"wal-append.queue_time_us":197277}
W20260709 13:13:01.770115  1222 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:01.816448 27039 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f9dfa4361254d838c2b61576ada60f4 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:13:01.819617  1228 log.cc:927] Time spent T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:13:01.820565  1225 log.cc:927] Time spent T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:13:01.826505 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:01.827313 27227 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:13:01.834592 27272 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:01.846695   870 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:01.852239   870 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.852659   870 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.862197  1194 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:01.908169 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 174551us
I20260709 13:13:01.919090 27306 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:01.923928 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:01.928578  1185 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:13:01.935847   870 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:01.938726   870 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:01.940311 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:01.946508 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:01.947039 27223 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.956967  1206 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:01.957177 27223 raft_consensus.cc:2468] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:13:01.957557  1206 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } attrs { replace: true } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:01.958467 27272 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:01.960417  1206 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:01.961066 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:01.963085 27227 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:01.963658 27156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1010256288ec4502b330749e2e3d7c85" is_pre_election: true
I20260709 13:13:01.964408 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:01.965406 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:01.975231 27269 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:01.974678  1194 raft_consensus.cc:2804] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:01.983978  1047 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:01.990525  1194 raft_consensus.cc:697] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:01.994041  1194 consensus_queue.cc:237] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:02.001288   601 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:02.092905 27306 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:13:02.103911  1173 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:02.138921 27156 raft_consensus.cc:1275] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:13:02.140439  1189 consensus_queue.cc:1048] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:02.186780 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:02.187361 27306 raft_consensus.cc:606] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:02.192836 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:02.193377 27306 raft_consensus.cc:606] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:02.193688 27306 raft_consensus.cc:614] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:02.196038 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "f4afe81810944d70bc2cc31754392f3d"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:02.196563 27306 raft_consensus.cc:606] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Received request to transfer leadership to TS f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:02.197001 27306 raft_consensus.cc:614] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:02.199433 27306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:02.199952 27306 raft_consensus.cc:606] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:02.200249 27306 raft_consensus.cc:614] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:02.201145 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:02.203260 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:02.360280 27306 raft_consensus.cc:1240] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:02.362076  1080 consensus_queue.cc:1059] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:02.362879  1080 consensus_queue.cc:1243] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer 897d8be8580141d1ad3bb17946d3da89 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:02.363353  1080 raft_consensus.cc:3055] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:02.363723  1080 raft_consensus.cc:740] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:02.364660  1080 consensus_queue.cc:260] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:02.366495  1080 raft_consensus.cc:3060] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:02.369107 27039 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 9f9dfa4361254d838c2b61576ada60f4 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 11
I20260709 13:13:02.371466 27051 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56054 (request call id 388) took 2459 ms. Trace:
I20260709 13:13:02.378175 27051 rpcz_store.cc:276] 0709 13:12:59.912550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.912732 (+   182us) service_pool.cc:224] Handling call
0709 13:13:02.371380 (+2458648us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:01.310276 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:01.311037 (+   761us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:01.311089 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:13:01.311116 (+    27us) tablet.cc:662] Decoding operations
0709 13:13:01.314646 (+  3530us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:01.314770 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:01.314832 (+    62us) tablet.cc:685] Acquiring locks for 37 operations
0709 13:13:01.440194 (+125362us) tablet.cc:701] Row locks acquired
0709 13:13:01.440219 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:13:01.455874 (+ 15655us) write_op.cc:270] Start()
0709 13:13:01.501038 (+ 45164us) write_op.cc:276] Timestamp: P: 1783602781451416 usec, L: 0
0709 13:13:01.501067 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:13:01.718754 (+217687us) log.cc:844] Serialized 14552 byte log entry
0709 13:13:01.929311 (+210557us) op_driver.cc:464] REPLICATION: finished
0709 13:13:01.977981 (+ 48670us) write_op.cc:301] APPLY: starting
0709 13:13:01.978087 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.040231 (+ 62144us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d3432a 00007f9a51cb9f14 00007f9a51cb9ec3 00007f9a51cb9e38 00007f9a51cb9df3 00007f9a51cb90dc 00007f9a51ce2e16 00007f9a51ccacbb 00007f9a51cb539d 00007f9a51cb8d75
0709 13:13:02.087378 (+ 47147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.087412 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.260640 (+173228us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.261127 (+   487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=74,key_file_lookups=74,delta_file_lookups=74,mrs_lookups=0
0709 13:13:02.261176 (+    49us) write_op.cc:312] APPLY: finished
0709 13:13:02.278136 (+ 16960us) log.cc:844] Serialized 316 byte log entry
0709 13:13:02.278316 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.278588 (+   272us) write_op.cc:454] Released schema lock
0709 13:13:02.278659 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.279083 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.279124 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128860,"reported_tablets":46,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":45170,"apply.run_cpu_time_us":45012,"apply.run_wall_time_us":301091,"cfile_cache_hit":150,"cfile_cache_hit_bytes":158565,"num_ops":37,"prepare.queue_time_us":401040,"prepare.run_cpu_time_us":23938,"prepare.run_wall_time_us":476908,"raft.queue_time_us":120240,"raft.run_cpu_time_us":5770,"raft.run_wall_time_us":133602,"replication_time_us":406837,"spinlock_wait_cycles":7456000,"thread_start_us":483976,"threads_started":4,"wal-append.queue_time_us":34467}]]}
I20260709 13:13:02.390903 27840 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:13:02.391369 27840 pending_rounds.cc:85] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 10
I20260709 13:13:02.391606 27840 pending_rounds.cc:107] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:13:02.391853 27840 raft_consensus.cc:2889] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.395336  1047 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:13:02.412812 27227 raft_consensus.cc:1275] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:02.416200   870 consensus_queue.cc:1048] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:02.457103 27055 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 10 to 12, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 12 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:13:02.462745 27054 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 245) took 63993 ms (client timeout 15000 ms). Trace:
W20260709 13:13:02.463299 27054 rpcz_store.cc:269] 0709 13:11:58.469463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.469671 (+   208us) service_pool.cc:224] Handling call
0709 13:13:02.462550 (+63992879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2067473,"reported_tablets":43}
I20260709 13:13:02.467056 27055 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 12 to 15, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.468669 27055 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 8 to 12, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 12 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.487109   870 raft_consensus.cc:993] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:13:02.488054  1206 raft_consensus.cc:1081] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:13:02.511797 27156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:13:02.512660 27156 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:02.513103 27156 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.563634 27156 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:02.568066 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:02.568673 27306 raft_consensus.cc:3055] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:02.568998 27306 raft_consensus.cc:740] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:02.571283 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:02.571894 27832 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.569763 27306 consensus_queue.cc:260] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:02.579315 27306 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.580729 27832 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:13:02.581200 27156 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:02.585489 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:02.587975 27227 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:02.616822 27306 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:13:02.620815 27122 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:02.621711  1198 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:02.622277  1198 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:02.623307  1198 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:02.638028 27227 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 13.
I20260709 13:13:02.664944 27051 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 6 to 11, VOTER 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) evicted. New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.669257 27051 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: config changed from index 12 to 13, term changed from 14 to 15, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132), f4afe81810944d70bc2cc31754392f3d (127.25.109.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.687146 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet d87c41315a07486aa13067ad7c47c34a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46398
W20260709 13:13:02.689486 27055 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 339) took 28026 ms (client timeout 15000 ms). Trace:
W20260709 13:13:02.689949 27055 rpcz_store.cc:269] 0709 13:12:34.663090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.663249 (+   159us) service_pool.cc:224] Handling call
0709 13:12:35.691944 (+1028695us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca1090 00007f9a51d3ff3a 00007f9a57af61cc 00007f9a57bf437e 00007f9a560b52a4 00007f9a560b5232 00007f9a560b5161 00007f9a560b50dc 00007f9a560b4392 00007f9a5007248c 00007f9a500718c6
0709 13:13:02.689394 (+26997450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:02.587947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:02.588609 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:02.588647 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:13:02.588666 (+    19us) tablet.cc:662] Decoding operations
0709 13:13:02.589230 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:02.589312 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:02.589352 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:02.589668 (+   316us) tablet.cc:701] Row locks acquired
0709 13:13:02.589688 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:13:02.589840 (+   152us) write_op.cc:270] Start()
0709 13:13:02.589976 (+   136us) write_op.cc:276] Timestamp: P: 1783602782589791 usec, L: 0
0709 13:13:02.590003 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:13:02.606414 (+ 16411us) log.cc:844] Serialized 1311 byte log entry
0709 13:13:02.633662 (+ 27248us) op_driver.cc:464] REPLICATION: finished
0709 13:13:02.633992 (+   330us) write_op.cc:301] APPLY: starting
0709 13:13:02.634093 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.635983 (+  1890us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.636087 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.637917 (+  1830us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.639286 (+  1369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:13:02.639342 (+    56us) write_op.cc:312] APPLY: finished
0709 13:13:02.639554 (+   212us) log.cc:844] Serialized 41 byte log entry
0709 13:13:02.639714 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.639807 (+    93us) write_op.cc:454] Released schema lock
0709 13:13:02.639858 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.640228 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.640259 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55547,"reported_tablets":46,"spinlock_wait_cycles":486586624,"child_traces":[["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":5036,"apply.run_wall_time_us":6189,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":85867,"prepare.run_cpu_time_us":3133,"prepare.run_wall_time_us":46412,"replication_time_us":43485,"thread_start_us":91669,"threads_started":1}]]}
I20260709 13:13:02.686614 27051 catalog_manager.cc:5697] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 18 to 21, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 21 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.701454 27051 catalog_manager.cc:5697] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:02.704237 27051 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 19 to 20, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 20 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.711431 27051 catalog_manager.cc:5697] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 13 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } }
I20260709 13:13:02.724448 27051 catalog_manager.cc:5697] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 15, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.728080 27051 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 8 to 13, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.754896 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet d87c41315a07486aa13067ad7c47c34a (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:02.805522 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9dfa4361254d838c2b61576ada60f4 with delete_type TABLET_DATA_TOMBSTONED (TS 897d8be8580141d1ad3bb17946d3da89 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54492
I20260709 13:13:02.854584 27049 catalog_manager.cc:5697] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 13 to 15, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.860822 27049 catalog_manager.cc:5697] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 14 to 16, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.863565 27049 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.856854  1252 tablet_replica.cc:333] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:02.866860 27049 catalog_manager.cc:5697] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 15 to 18, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 18 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.868418  1252 raft_consensus.cc:2243] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:02.869257  1252 raft_consensus.cc:2272] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:02.868703 27049 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 12 to 14, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.879520 27049 catalog_manager.cc:5697] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 14 to 17, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 17 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.883472  1252 ts_tablet_manager.cc:1916] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:02.882899 27049 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 11 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.885169 27049 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 9 to 12, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 12 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.888830 27049 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:02.933385  1252 ts_tablet_manager.cc:1929] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:13:02.934046  1252 log.cc:1199] T 9f9dfa4361254d838c2b61576ada60f4 P 897d8be8580141d1ad3bb17946d3da89: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/wals/9f9dfa4361254d838c2b61576ada60f4
I20260709 13:13:02.948102 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 9f9dfa4361254d838c2b61576ada60f4 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:02.956199 27055 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 12 to 13, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.017972 27227 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:03.019399  1238 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:03.021118 27049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 340) took 8554 ms. Trace:
I20260709 13:13:03.021546 27049 rpcz_store.cc:276] 0709 13:12:54.466791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.467104 (+   313us) service_pool.cc:224] Handling call
0709 13:13:03.021051 (+8553947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:02.927276 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:02.927886 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:02.927923 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:02.927938 (+    15us) tablet.cc:662] Decoding operations
0709 13:13:02.928923 (+   985us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:02.928985 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:02.929016 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:13:02.929790 (+   774us) tablet.cc:701] Row locks acquired
0709 13:13:02.929810 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:13:02.929967 (+   157us) write_op.cc:270] Start()
0709 13:13:02.932568 (+  2601us) write_op.cc:276] Timestamp: P: 1783602782929910 usec, L: 0
0709 13:13:02.932591 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:02.933223 (+   632us) log.cc:844] Serialized 3628 byte log entry
0709 13:13:02.935517 (+  2294us) op_driver.cc:464] REPLICATION: finished
0709 13:13:02.936221 (+   704us) write_op.cc:301] APPLY: starting
0709 13:13:02.936301 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:02.941099 (+  4798us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:02.941190 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:02.952192 (+ 11002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:02.952413 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:13:02.952466 (+    53us) write_op.cc:312] APPLY: finished
0709 13:13:02.952762 (+   296us) log.cc:844] Serialized 89 byte log entry
0709 13:13:02.953582 (+   820us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.953727 (+   145us) write_op.cc:454] Released schema lock
0709 13:13:02.953779 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:02.954170 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:02.954208 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57480,"reported_tablets":46,"spinlock_wait_cycles":4736,"child_traces":[["op",{"apply.queue_time_us":379,"apply.run_cpu_time_us":11775,"apply.run_wall_time_us":17907,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37566,"num_ops":9,"prepare.queue_time_us":1532,"prepare.run_cpu_time_us":3789,"prepare.run_wall_time_us":6238,"replication_time_us":2742}]]}
I20260709 13:13:03.098977 27306 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:03.101019  1238 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:03.117508 27050 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 10 to 11, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 11 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.135766 27840 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:03.140947  1248 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:03.219631 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:03.273226 27050 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 247) took 15549 ms (client timeout 15000 ms). Trace:
W20260709 13:13:03.314339 27050 rpcz_store.cc:269] 0709 13:12:47.723811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.724465 (+   654us) service_pool.cc:224] Handling call
0709 13:13:03.273167 (+15548702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:03.175886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:03.189441 (+ 13555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:03.189479 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:13:03.189491 (+    12us) tablet.cc:662] Decoding operations
0709 13:13:03.189814 (+   323us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:03.189867 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:03.189891 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:03.190085 (+   194us) tablet.cc:701] Row locks acquired
0709 13:13:03.190097 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:13:03.190756 (+   659us) write_op.cc:270] Start()
0709 13:13:03.190871 (+   115us) write_op.cc:276] Timestamp: P: 1783602783190712 usec, L: 0
0709 13:13:03.190890 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:03.191459 (+   569us) log.cc:844] Serialized 539 byte log entry
0709 13:13:03.193484 (+  2025us) op_driver.cc:464] REPLICATION: finished
0709 13:13:03.193901 (+   417us) write_op.cc:301] APPLY: starting
0709 13:13:03.193972 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:03.194817 (+   845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:03.194899 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:03.195548 (+   649us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:03.195701 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:13:03.195746 (+    45us) write_op.cc:312] APPLY: finished
0709 13:13:03.195958 (+   212us) log.cc:844] Serialized 25 byte log entry
0709 13:13:03.196102 (+   144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.196174 (+    72us) write_op.cc:454] Released schema lock
0709 13:13:03.196212 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:03.196502 (+   290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.196529 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":44,"spinlock_wait_cycles":11136,"child_traces":[["op",{"apply.queue_time_us":213,"apply.run_cpu_time_us":2567,"apply.run_wall_time_us":2572,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":747,"prepare.run_cpu_time_us":4148,"prepare.run_wall_time_us":15905,"replication_time_us":2493,"spinlock_wait_cycles":2944}]]}
I20260709 13:13:03.323830 27048 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.357358 27048 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 11 to 15, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 15 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.431993 27048 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.560992 27051 catalog_manager.cc:5697] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 15 to 16, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 16 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.563149 27051 catalog_manager.cc:5697] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 12 to 14, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 14 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.598695 27051 catalog_manager.cc:5697] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.601627 27287 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9dfa4361254d838c2b61576ada60f4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:54492
I20260709 13:13:03.611626 27051 catalog_manager.cc:5697] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 14 to 16, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.612758 27051 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.613845 27051 catalog_manager.cc:5697] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:13:03.617766 27039 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 1010256288ec4502b330749e2e3d7c85 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.619278 27051 catalog_manager.cc:5697] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 14 to 15, leader changed from 9bc1278c649846e998b312b374274d08 (127.25.109.130) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.626456 27048 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 383) took 8169 ms. Trace:
I20260709 13:13:03.627986 27051 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:03.635630 27041 catalog_manager.cc:5028] TS 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): tablet 9f9dfa4361254d838c2b61576ada60f4 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:03.631497 27048 rpcz_store.cc:276] 0709 13:12:55.456919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.457198 (+   279us) service_pool.cc:224] Handling call
0709 13:13:03.626371 (+8169173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:03.454897 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:03.455535 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:03.455573 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:13:03.455604 (+    31us) tablet.cc:662] Decoding operations
0709 13:13:03.456155 (+   551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:03.456216 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:03.456246 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:03.456594 (+   348us) tablet.cc:701] Row locks acquired
0709 13:13:03.456613 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:13:03.456798 (+   185us) write_op.cc:270] Start()
0709 13:13:03.456928 (+   130us) write_op.cc:276] Timestamp: P: 1783602783456741 usec, L: 0
0709 13:13:03.456957 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:13:03.469239 (+ 12282us) log.cc:844] Serialized 1311 byte log entry
0709 13:13:03.471546 (+  2307us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540031abd4. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a51ca0571 00007f9a51d32e28 00007f9a5576d581 00007f9a5576cd58 00007f9a557719f1 00007f9a557719a9 00007f9a55771939 00007f9a55771901 00007f9a55770b2d 000000000038f354 000000000038f199
0709 13:13:03.473706 (+  2160us) op_driver.cc:464] REPLICATION: finished
0709 13:13:03.474177 (+   471us) write_op.cc:301] APPLY: starting
0709 13:13:03.474265 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:03.476122 (+  1857us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:03.476147 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:03.477949 (+  1802us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:03.478156 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:13:03.478209 (+    53us) write_op.cc:312] APPLY: finished
0709 13:13:03.478439 (+   230us) log.cc:844] Serialized 41 byte log entry
0709 13:13:03.478603 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.478699 (+    96us) write_op.cc:454] Released schema lock
0709 13:13:03.478740 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:03.480554 (+  1814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.480583 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":509196,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":4852,"apply.run_wall_time_us":4852,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12522,"num_ops":3,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":5494,"prepare.run_wall_time_us":16822,"replication_time_us":16603,"spinlock_wait_cycles":26728320}]]}
I20260709 13:13:03.974627 27051 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 248) took 1150 ms. Trace:
I20260709 13:13:03.975116 27051 rpcz_store.cc:276] 0709 13:13:02.812941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.813104 (+   163us) service_pool.cc:224] Handling call
0709 13:13:03.963112 (+1150008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:03.663307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:03.663830 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:03.663861 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:13:03.663877 (+    16us) tablet.cc:662] Decoding operations
0709 13:13:03.664701 (+   824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:03.664753 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:03.664799 (+    46us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:03.665429 (+   630us) tablet.cc:701] Row locks acquired
0709 13:13:03.665447 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:13:03.665575 (+   128us) write_op.cc:270] Start()
0709 13:13:03.665691 (+   116us) write_op.cc:276] Timestamp: P: 1783602783665536 usec, L: 0
0709 13:13:03.665712 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:03.667649 (+  1937us) log.cc:844] Serialized 3242 byte log entry
0709 13:13:03.669899 (+  2250us) op_driver.cc:464] REPLICATION: finished
0709 13:13:03.670212 (+   313us) write_op.cc:301] APPLY: starting
0709 13:13:03.670290 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:03.687782 (+ 17492us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:03.687883 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:03.693349 (+  5466us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:03.693538 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:13:03.693578 (+    40us) write_op.cc:312] APPLY: finished
0709 13:13:03.693846 (+   268us) log.cc:844] Serialized 81 byte log entry
0709 13:13:03.695807 (+  1961us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.695921 (+   114us) write_op.cc:454] Released schema lock
0709 13:13:03.695961 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:03.696265 (+   304us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:03.696291 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":209,"mutex_wait_us":58609,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":133,"apply.run_cpu_time_us":9921,"apply.run_wall_time_us":26024,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33392,"num_ops":8,"prepare.queue_time_us":3048,"prepare.run_cpu_time_us":3374,"prepare.run_wall_time_us":14333,"replication_time_us":4053}]]}
W20260709 13:13:04.058292 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 71914.8us
I20260709 13:13:04.099730 27840 consensus_queue.cc:237] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:04.187757 27301 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:13:04.190452  1260 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:13:04.235962 27227 raft_consensus.cc:1275] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:13:04.331589 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 192160us
I20260709 13:13:04.424283  1080 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Committing config change with OpId 15.15: config changed from index 13 to 15, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:04.435657 27298 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Committing config change with OpId 15.15: config changed from index 13 to 15, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:04.441653   868 consensus_queue.cc:1048] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:13:04.583307 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 95944.5us
I20260709 13:13:04.639465 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.655539 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8f560534ffa48878a9e4d4766199287 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:13:04.662209 27123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 152356us
W20260709 13:13:04.707072 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 85365.8us
I20260709 13:13:04.715509 27055 catalog_manager.cc:5697] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 13 to 15, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 15 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:04.772045 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 106755us
W20260709 13:13:04.828569 27039 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 1010256288ec4502b330749e2e3d7c85 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
W20260709 13:13:04.837621 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 95562.9us
I20260709 13:13:04.849961 27228 raft_consensus.cc:2955] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Committing config change with OpId 15.15: config changed from index 13 to 15, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:05.015403 27143 tablet_service.cc:1558] Processing DeleteTablet for tablet c8f560534ffa48878a9e4d4766199287 with delete_type TABLET_DATA_TOMBSTONED (TS 1010256288ec4502b330749e2e3d7c85 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54872
I20260709 13:13:05.035017 27157 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:13:05.036046 27157 raft_consensus.cc:606] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:13:05.046033 27301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b895e250184ee283d78483d5fcae92"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:05.046803 27301 raft_consensus.cc:606] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 LEADER]: Received request to transfer leadership to TS 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:05.050559 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:05.051131 27300 raft_consensus.cc:606] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:13:05.053678 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:05.054270 27300 raft_consensus.cc:606] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:13:05.054868  1294 tablet_replica.cc:333] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:05.056836 27300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6"
dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:42282
I20260709 13:13:05.057390 27300 raft_consensus.cc:606] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:13:05.058809 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:05.058955  1294 raft_consensus.cc:2243] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.067953  1270 raft_consensus.cc:993] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.068467  1270 raft_consensus.cc:1081] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.060144  1294 raft_consensus.cc:2272] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.070381 27228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:13:05.070997 27228 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.071341 27228 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:05.075290  1294 ts_tablet_manager.cc:1916] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:05.060541 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:05.091723 27228 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.103531 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:13:05.104224 27157 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:05.115661  1294 ts_tablet_manager.cc:1929] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.14
I20260709 13:13:05.116170  1294 log.cc:1199] T c8f560534ffa48878a9e4d4766199287 P 1010256288ec4502b330749e2e3d7c85: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/wals/c8f560534ffa48878a9e4d4766199287
I20260709 13:13:05.118237 27039 catalog_manager.cc:5028] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): tablet c8f560534ffa48878a9e4d4766199287 (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:05.118886 27157 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:05.120817 27195 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:05.121845  1285 raft_consensus.cc:2804] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:05.122395  1285 raft_consensus.cc:697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:05.123314  1285 consensus_queue.cc:237] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.129091 27228 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:05.130723 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:05.131474 27301 raft_consensus.cc:3055] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:05.131753 27301 raft_consensus.cc:740] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:05.132604 27301 consensus_queue.cc:260] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.133980 27301 raft_consensus.cc:3060] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:05.175551 27301 raft_consensus.cc:2468] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:05.193120 27049 catalog_manager.cc:5697] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 16 to 17, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 17 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.254544  1280 raft_consensus.cc:993] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.255240  1047 raft_consensus.cc:1081] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.257011 27229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:13:05.257551 27229 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.257884 27229 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:05.269855 27229 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.271688 27229 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:05.276922 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:05.277477 27301 raft_consensus.cc:3055] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:05.277763 27301 raft_consensus.cc:740] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:05.282553 27301 consensus_queue.cc:260] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.284003 27301 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:05.282586 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:05.289543 27840 raft_consensus.cc:3060] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:05.289885  1137 raft_consensus.cc:993] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.290357  1137 raft_consensus.cc:1081] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.292199 27224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:13:05.292685 27224 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.292994 27224 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.321098 27224 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.326746 27301 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:05.328148 27197 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:05.330152 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:13:05.330698 27151 raft_consensus.cc:3055] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:05.330971  1285 raft_consensus.cc:2804] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:05.331001 27151 raft_consensus.cc:740] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:05.331674  1285 raft_consensus.cc:697] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:05.332168 27151 consensus_queue.cc:260] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.333163 27151 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.332636  1285 consensus_queue.cc:237] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.334923 27224 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:05.335886 27840 raft_consensus.cc:2468] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:05.337738 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c0f63822c7471ebdec8a5f3dfa21a9" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:05.339211 27840 raft_consensus.cc:3060] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.346347 27840 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:05.347694 27197 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:05.348665  1263 raft_consensus.cc:2804] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:05.349179  1263 raft_consensus.cc:697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:05.350433 27151 raft_consensus.cc:2468] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:05.350322  1263 consensus_queue.cc:237] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.390486 27049 catalog_manager.cc:5697] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 13 to 14, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.416594 27049 catalog_manager.cc:5697] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 12 to 13, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.478360  1047 raft_consensus.cc:993] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:13:05.478906  1047 raft_consensus.cc:1081] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 LEADER]: Signalling peer 1010256288ec4502b330749e2e3d7c85 to start an election
I20260709 13:13:05.484531 27157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b895e250184ee283d78483d5fcae92"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
 from {username='slave'} at 127.0.0.1:45802
I20260709 13:13:05.485149 27157 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.485541 27157 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:05.511546 27151 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:05.514578  1266 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:05.551466 27157 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.558133 27157 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 21 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:05.558198 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:05.558898 27301 raft_consensus.cc:3055] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:05.559237 27301 raft_consensus.cc:740] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:05.560081 27301 consensus_queue.cc:260] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.562667 27301 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:05.565797 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:05.566473 27834 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:05.592006  1047 raft_consensus.cc:993] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.592569  1047 raft_consensus.cc:1081] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:05.597599 27224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46412
I20260709 13:13:05.598220 27224 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:05.598618 27224 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.605978 27300 raft_consensus.cc:1275] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:05.607882  1266 consensus_queue.cc:1048] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:05.644259 27224 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.646466 27834 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 21.
I20260709 13:13:05.670831 27122 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:05.674525  1286 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:05.691177 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 21.
I20260709 13:13:05.715685  1286 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 21 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:05.716753 27151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:13:05.717471 27151 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.717094  1286 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:05.732403 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:05.733083 27300 raft_consensus.cc:3055] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:05.733440 27300 raft_consensus.cc:740] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:05.734186 27224 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:05.734380 27300 consensus_queue.cc:260] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.735715 27300 raft_consensus.cc:3060] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.734405 27298 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:05.740523  1263 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:05.744585 27300 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:05.746444 27197 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:05.748514  1263 raft_consensus.cc:2804] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:05.749099  1263 raft_consensus.cc:697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:05.750200  1263 consensus_queue.cc:237] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:05.772722 27157 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:05.774356 27151 raft_consensus.cc:2468] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:05.774477  1266 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:05.804970 27834 raft_consensus.cc:1275] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:13:05.814090  1285 consensus_queue.cc:1048] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:05.829944 27049 catalog_manager.cc:5697] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 12 to 13, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.850025 27834 raft_consensus.cc:1275] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:13:05.875435  1285 consensus_queue.cc:1048] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:05.874956 27048 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 reported cstate change: term changed from 20 to 21, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to 1010256288ec4502b330749e2e3d7c85 (127.25.109.129). New cstate: current_term: 21 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:05.885684 27039 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 1010256288ec4502b330749e2e3d7c85 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:06.078356 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:06.204653 27306 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:13:06.207237  1286 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:06.328653 27151 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:06.330552  1263 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:06.354440 27838 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Refusing update from remote peer 1010256288ec4502b330749e2e3d7c85: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:13:06.357404  1286 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:06.367862 27306 raft_consensus.cc:1275] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:06.369829  1263 consensus_queue.cc:1048] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:07.256956 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:07.414561 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 75215.4us
I20260709 13:13:07.433910 27151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d"
dest_uuid: "1010256288ec4502b330749e2e3d7c85"
mode: GRACEFUL
new_leader_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:13:07.434522 27151 raft_consensus.cc:606] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Received request to transfer leadership to TS 9bc1278c649846e998b312b374274d08
I20260709 13:13:07.440655 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:07.442327 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:07.511478  1238 raft_consensus.cc:993] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: : Instructing follower 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:07.511988  1238 raft_consensus.cc:1081] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Signalling peer 9bc1278c649846e998b312b374274d08 to start an election
I20260709 13:13:07.515729 27224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d"
dest_uuid: "9bc1278c649846e998b312b374274d08"
 from {username='slave'} at 127.0.0.1:46400
I20260709 13:13:07.516253 27224 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.516577 27224 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.524765 27224 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:07.539597 27224 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:07.539765 27157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "1010256288ec4502b330749e2e3d7c85"
I20260709 13:13:07.540432 27157 raft_consensus.cc:3055] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:07.540738 27157 raft_consensus.cc:740] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:07.541487 27157 consensus_queue.cc:260] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:07.542524 27157 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.545994 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf276ae949142ce87f50371f8505b9d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:07.546639 27840 raft_consensus.cc:3060] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.555728 27840 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:07.558645 27197 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:07.559448  1263 raft_consensus.cc:2804] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:07.560004  1263 raft_consensus.cc:697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:07.561017  1263 consensus_queue.cc:237] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:07.566565 27157 raft_consensus.cc:2468] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:07.626019 27055 catalog_manager.cc:5697] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 12 to 13, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 13 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:07.970868 27039 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 1010256288ec4502b330749e2e3d7c85 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "1010256288ec4502b330749e2e3d7c85" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:08.062747 27151 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:13:08.073837  1285 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:08.134629 27834 raft_consensus.cc:1275] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:13:08.137584  1321 consensus_queue.cc:1048] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:08.447109 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:08.595460 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
W20260709 13:13:08.610306 27269 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:08.658569 27269 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.684571 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 49170.4us
W20260709 13:13:08.713442 27195 consensus_peers.cc:597] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.720674 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.731619 27804 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.732154 27804 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.735306 27195 consensus_peers.cc:597] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.741348 27269 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.751538 27195 consensus_peers.cc:597] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.758313 27269 consensus_peers.cc:597] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.766666 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.763698 27195 consensus_peers.cc:597] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.768368 27195 consensus_peers.cc:597] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.775446 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 59374.2us
W20260709 13:13:08.783928 27269 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.828316 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.830617 27269 consensus_peers.cc:597] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.832695 27269 consensus_peers.cc:597] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.838856 27804 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.844668 27195 consensus_peers.cc:597] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.881639 27269 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.886299 27269 consensus_peers.cc:597] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.900507 27269 consensus_peers.cc:597] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:08.954000 27195 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:08.959316 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:08.961099 26038 tablet_replica.cc:333] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.962738 26038 raft_consensus.cc:2243] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:08.964090 26038 raft_consensus.cc:2272] T fe318d32db494aafa007d9cb3d4cf02a P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:08.967468 26038 tablet_replica.cc:333] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.968523 26038 raft_consensus.cc:2243] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:08.969363 26038 raft_consensus.cc:2272] T aa050ea82d9b4a729f786c4fd23f4904 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:08.970244 27195 consensus_peers.cc:597] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:08.972481 26038 tablet_replica.cc:333] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.973546 26038 raft_consensus.cc:2243] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:08.974458 26038 raft_consensus.cc:2272] T 897bd586cdb44a899e3c85e77da927c3 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:08.977710 26038 tablet_replica.cc:333] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.978840 26038 raft_consensus.cc:2243] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:08.979480 26038 raft_consensus.cc:2272] T f5d526be8aec49c8863369b60c8e884c P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:08.983469 26038 tablet_replica.cc:333] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.984287 26038 raft_consensus.cc:2243] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:08.984908 27195 consensus_peers.cc:597] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:08.985049 26038 raft_consensus.cc:2272] T b3cb013cb450432ba238b716d88554e4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:08.988611 26038 tablet_replica.cc:333] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:08.989499 26038 raft_consensus.cc:2243] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:08.992528 26038 raft_consensus.cc:2272] T 9f9dfa4361254d838c2b61576ada60f4 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.004803 27195 consensus_peers.cc:597] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.005481 26038 tablet_replica.cc:333] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.006561 26038 raft_consensus.cc:2243] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.007670 26038 raft_consensus.cc:2272] T 695ceba1143c428490ae6aad424a66ea P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.011453 26038 tablet_replica.cc:333] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.012531 26038 raft_consensus.cc:2243] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.015380 26038 raft_consensus.cc:2272] T dd514c8b688c4f2e90b6ad46174723ef P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.027283 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.029481 26038 tablet_replica.cc:333] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.030422 26038 raft_consensus.cc:2243] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.031513 26038 raft_consensus.cc:2272] T 93b895e250184ee283d78483d5fcae92 P 1010256288ec4502b330749e2e3d7c85 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.034397 26038 tablet_replica.cc:333] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.035300 26038 raft_consensus.cc:2243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.035986 26038 raft_consensus.cc:2272] T 23b189bbd0aa4c6787e99f8cc041dd48 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.038921 26038 tablet_replica.cc:333] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.039768 26038 raft_consensus.cc:2243] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.040877 26038 raft_consensus.cc:2272] T d6c3d4b3cf374582b470348b1f7dc027 P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.048413 26038 tablet_replica.cc:333] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.049240 26038 raft_consensus.cc:2243] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.050729 26038 raft_consensus.cc:2272] T 86bf2019fd7b421393e482331c89a37d P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.053640 26038 tablet_replica.cc:333] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.054514 26038 raft_consensus.cc:2243] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:13:09.055088 27195 consensus_peers.cc:597] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.055809 26038 raft_consensus.cc:2272] T 63772c6ab6094654b0215f6a3be7d6fc P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.067492 26038 tablet_replica.cc:333] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.068835 26038 raft_consensus.cc:2243] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.070117 26038 raft_consensus.cc:2272] T 08a6377ffbb949a09216851d176dbcfc P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.074383 26038 tablet_replica.cc:333] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.075601 26038 raft_consensus.cc:2243] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.076249 26038 raft_consensus.cc:2272] T be324c341d044aa892e39ebca665c6c6 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.079993 26038 tablet_replica.cc:333] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.080950 26038 raft_consensus.cc:2243] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.081909 26038 raft_consensus.cc:2272] T 432318984ae54d3b86d6f16faa526523 P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.086445 26038 tablet_replica.cc:333] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.087803 26038 raft_consensus.cc:2243] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.089408 26038 raft_consensus.cc:2272] T c956eb948d264e3fa713d592c530d94e P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.098917 26038 tablet_replica.cc:333] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.099785 26038 raft_consensus.cc:2243] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.100350 26038 raft_consensus.cc:2272] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.103225 26038 tablet_replica.cc:333] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.103924 26038 raft_consensus.cc:2243] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.104526 26038 raft_consensus.cc:2272] T b62a963093f641fa81d5d816797099e1 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.108902 26038 tablet_replica.cc:333] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.111028 26038 raft_consensus.cc:2243] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.112479 26038 raft_consensus.cc:2272] T 9e466225c5a147b9b31f11fea1bcf893 P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.115450 26038 tablet_replica.cc:333] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.116248 26038 raft_consensus.cc:2243] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.117421 26038 raft_consensus.cc:2272] T 1366d63dcc6742608d7574eb132c123a P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.120453 26038 tablet_replica.cc:333] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.121215 26038 raft_consensus.cc:2243] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.122802 26038 raft_consensus.cc:2272] T d64b1a67a0cc42479c0519e68bc68492 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.125413 26038 tablet_replica.cc:333] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.126410 26038 raft_consensus.cc:2243] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.127404 26038 raft_consensus.cc:2272] T ae22f698260e475b89b90dcbd28bda00 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.130199 26038 tablet_replica.cc:333] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.130981 26038 raft_consensus.cc:2243] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.131467 26038 raft_consensus.cc:2272] T fcf276ae949142ce87f50371f8505b9d P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.134840 26038 tablet_replica.cc:333] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.135658 26038 raft_consensus.cc:2243] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.136891 26038 raft_consensus.cc:2272] T d87c41315a07486aa13067ad7c47c34a P 1010256288ec4502b330749e2e3d7c85 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.300259 26038 tablet_replica.cc:333] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.315390 26038 raft_consensus.cc:2243] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.574985 26038 raft_consensus.cc:2272] T 1b636aab71bc4cad87e3a5d644042885 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.591578  1335 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:09.592259  1335 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:09.591885 26038 tablet_replica.cc:333] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:09.593914 26038 raft_consensus.cc:2243] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.596670 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:09.595602  1335 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.063581  1364 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.064184  1364 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.065084  1356 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:09.602330 26038 raft_consensus.cc:2272] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.939832  1345 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.065950  1345 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.066504  1335 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.067018  1335 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.068205  1345 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.068727  1345 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:13:10.068825  1349 raft_consensus.cc:670] T bd31e5d20c484a9facfe437706e9bd6b P 1010256288ec4502b330749e2e3d7c85: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:13:09.964031  1348 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.069672  1348 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:09.986153  1353 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.070106  1335 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.071008  1353 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.072036  1364 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.073518 26038 tablet_replica.cc:333] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:10.073647 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:09.994822  1344 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.069232  1345 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.074815  1344 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.076468  1353 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.077001  1353 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.002162 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.032016  1366 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.033335  1365 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.061401  1347 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.086297 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.086540  1347 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.086315  1365 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.088925  1347 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.089428  1365 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.065624  1356 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.091200  1348 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.092792  1356 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.078256 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.070572 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.093112 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.093420 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.077435  1353 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.098150  1353 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.083595  1366 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.077243  1344 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.105830 26038 raft_consensus.cc:2243] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:10.111065 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.108513 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.109864 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.115409  1366 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.076185  1345 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.151760 27055 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52102 (request call id 262) took 1022 ms. Trace:
I20260709 13:13:10.156227  1263 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.158548 26038 raft_consensus.cc:2272] T b91cb18a432b4fefa2c9d4eff143e3d7 P 1010256288ec4502b330749e2e3d7c85 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.157944  1263 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.155663 27055 rpcz_store.cc:276] 0709 13:13:09.129832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.129984 (+   152us) service_pool.cc:224] Handling call
0709 13:13:10.151697 (+1021713us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:10.166395  1352 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.192246  1263 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.192116 27298 consensus_queue.cc:237] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.198777  1355 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.199426  1355 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.200161  1350 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.200698  1350 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.203538  1368 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.204241  1368 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:10.230870 27122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.166958  1352 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.231227 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.239007  1374 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.251246 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.242654  1374 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.259632  1323 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.260259  1323 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.259706  1352 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:10.290337 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 98870.7us
I20260709 13:13:10.283731 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.373500  1263 raft_consensus.cc:493] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:13:10.358675 27120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.353145 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.283341 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.417069 27301 raft_consensus.cc:2468] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
W20260709 13:13:10.418346 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 264301us
I20260709 13:13:10.415699  1263 raft_consensus.cc:515] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.285095 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.285679 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.284477 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.422528 27305 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 15.
I20260709 13:13:10.428637 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.263306  1352 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.255297  1345 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.425323 27122 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:10.284482  1350 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.278470  1285 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.278836  1321 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.437039  1376 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.275298  1368 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.437595  1339 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.438814  1372 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.439713  1346 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.440106  1354 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.440629  1377 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.378657  1343 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.284904  1374 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.368965  1355 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.275590  1369 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.270213  1375 raft_consensus.cc:493] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.263355  1371 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.426867  1323 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.436097 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.464988  1263 leader_election.cc:290] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.469326 26038 tablet_replica.cc:333] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:10.442759  1352 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.433333  1353 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.445443  1285 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:10.496593 27272 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 87423.1us
I20260709 13:13:10.444382  1279 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.444466  1345 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.494995  1360 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.536237 26038 raft_consensus.cc:2243] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:10.469769  1379 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:10.548782  1357 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.507814  1374 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.553437  1263 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:13:10.554760 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 129512us
I20260709 13:13:10.458281  1321 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.566553 27122 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.568007 27122 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.568288 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.540256  1350 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.571393 27122 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.565428  1263 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.477676  1346 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.478300  1339 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.576272 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.549283  1387 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.486742  1354 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.548643  1323 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.575708  1344 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:10.485499  1372 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.579206 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 
I20260709 13:13:10.539289  1353 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.592303 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.499981  1343 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.495430  1376 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.593340 26038 raft_consensus.cc:2272] T a41c5fdb574f47168ed45c1838cbd31d P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.593427  1263 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.501566  1377 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:10.599371 27862 debug-util.cc:398] Leaking SignalData structure 0x7b0800345e80 after lost signal to thread 26041
I20260709 13:13:10.507557  1369 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:13:10.539628  1375 raft_consensus.cc:515] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:10.603605 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff8e0 after lost signal to thread 27089
W20260709 13:13:10.605854 27862 debug-util.cc:398] Leaking SignalData structure 0x7b0800334240 after lost signal to thread 27181
I20260709 13:13:10.606999  1392 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.607621  1392 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.608659  1378 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.609196  1378 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.605170  1361 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.610224  1388 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.610574  1361 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.610735  1388 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.611279  1353 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.542811  1279 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.613031  1359 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:10.613508  1362 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.604648 27838 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:13:10.566542  1357 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.614105  1362 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.539439  1371 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.615664  1285 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.590327  1387 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.616876  1386 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.617672  1371 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.617452  1386 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:10.618201 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.618348 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8a00 after lost signal to thread 27256
I20260709 13:13:10.594508  1379 raft_consensus.cc:2804] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:13:10.620846 27862 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8360 after lost signal to thread 27330
I20260709 13:13:10.621976 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:10.623497 27862 debug-util.cc:398] Leaking SignalData structure 0x7b0800310560 after lost signal to thread 27865
I20260709 13:13:10.579879  1350 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.687580 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.565680  1360 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.572355  1374 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.603996  1342 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:10.614701  1279 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.621960  1379 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.593917  1323 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.615693  1357 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.606477  1344 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.703444 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.695094  1353 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.705351  1279 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.705683  1381 raft_consensus.cc:493] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.706984  1394 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.691301  1390 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.608361  1339 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.610994  1372 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.609288  1375 leader_election.cc:290] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.612867  1388 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.708894  1369 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.694849  1393 raft_consensus.cc:493] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.612738  1361 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.612674  1354 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:10.741554 27122 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 149325us
I20260709 13:13:10.705439  1392 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.742468 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.705502  1376 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.613013  1377 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.616333  1362 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.618120  1387 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.710449  1379 raft_consensus.cc:3060] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:10.728390  1344 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.732924  1321 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.748384 27122 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.749468 27229 raft_consensus.cc:2468] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 11.
I20260709 13:13:10.740906  1357 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.753742  1350 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.737763  1279 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.764853  1362 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.765096  1339 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.765406  1362 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.766072  1346 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.734692  1353 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.762955  1344 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:10.766611  1363 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.767459  1362 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.768231  1352 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.753806  1374 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.740523  1394 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.769222  1343 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.769965  1342 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:10.770141  1370 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.770570 27122 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:10.770749  1370 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.743055  1381 raft_consensus.cc:515] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.751636  1393 raft_consensus.cc:515] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.772993  1369 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:10.739212  1345 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.754423  1323 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.768314  1353 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.765700  1339 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.755276 26038 tablet_replica.cc:333] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:10.767181  1363 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.776578 26038 raft_consensus.cc:2243] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.755733  1391 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.766350  1279 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.784117 27228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.784505 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.784654 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b36513461a9483c98c7adda698d5dad" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.785107 27224 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:13:10.780912  1343 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.789288  1343 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.790297 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.790917 27232 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:13:10.792218  1343 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.782748  1321 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.793171  1321 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.792302  1391 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.795480 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.796660 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.797348 27232 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:13:10.775372  1386 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.803229 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.803553 26038 raft_consensus.cc:2272] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:10.742031  1390 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.806187 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:10.810480 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.811326 27836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.804582  1367 raft_consensus.cc:493] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.812983 26038 tablet_replica.cc:333] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:10.813844 26038 raft_consensus.cc:2243] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:10.815659  1390 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.816744 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.816917 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.817960 27840 raft_consensus.cc:2468] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 19.
I20260709 13:13:10.818953 27840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.818881 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.824923 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:10.776321  1357 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.812326  1367 raft_consensus.cc:515] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.830199 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.837718 27834 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:13:10.838948 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.839203 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.839918  1363 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.843153  1381 leader_election.cc:290] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.843745  1357 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.841727  1360 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.844544  1393 leader_election.cc:290] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.845577  1370 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.845590  1378 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.834722  1387 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.847854  1387 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.848284  1391 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.848264  1387 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:10.850646  1321 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.853273 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.853721 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.854509 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.855583 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.856457 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.820425  1402 raft_consensus.cc:2804] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:10.857698  1402 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:10.858083  1402 raft_consensus.cc:3060] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.859858 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd98a20f7c24448860d680b91e30ab5" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.826357 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:10.864732 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.865763 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.844662  1367 leader_election.cc:290] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.821604  1351 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.820077  1386 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:10.838637 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.865397 27232 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:13:10.950899 27227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6576306f90684fa797dc0cafcc53fcdb" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.900154 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.902771 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.865397  1363 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.961898 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.894405 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.881429 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae22f698260e475b89b90dcbd28bda00" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.964524  1363 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.923296 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.904592 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87c41315a07486aa13067ad7c47c34a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.904417 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.893347 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.904398 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.921854 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.911190  1357 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:10.891876  1394 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.939436 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.905563 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.888917 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.962265  1386 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.905102 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.967952  1363 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.903564 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.970198  1386 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.865931 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.961529  1351 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.971541 27300 raft_consensus.cc:2468] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 18.
I20260709 13:13:10.967871  1357 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.915346  1350 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.974997  1350 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.977165  1350 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.923815 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.972556 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 21.
I20260709 13:13:10.913316 27271 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:10.978860  1363 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:10.978996 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 65753.9us
I20260709 13:13:10.980312 27271 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:10.980625  1357 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:10.881036  1323 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:10.882720  1339 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.981487  1323 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.981096  1363 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:10.981961  1323 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.982141 27271 leader_election.cc:304] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:10.956267  1344 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:10.983109  1363 raft_consensus.cc:2749] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:10.985212 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:10.967770 27832 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:10.972911  1351 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:10.954192  1387 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.940280 27834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.917449 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.910539 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:13:10.990423 27807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:33347, user_credentials={real_user=slave}} blocked reactor thread for 79953.1us
I20260709 13:13:10.991254 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:10.985394  1344 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:10.918129 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.902724 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c956eb948d264e3fa713d592c530d94e" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.993208  1339 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:10.993628  1339 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:10.994074  1339 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:10.994391 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.995072 27225 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 10.
I20260709 13:13:10.997375 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:10.997980 27230 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:13:11.001024 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.002091  1390 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:11.002413  1387 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.002506  1390 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.003387  1390 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.003939 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:11.005321 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.006084 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.006415 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36bb684ea1124ce1a76a958bd405aa9b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.007210 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.008379 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.991205  1350 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:11.010124 27306 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:11.010298  1350 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.009500 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6d2e3ad5974f3986941a49bb1339d7" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.010243 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.011114 27306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.011602 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.012027 27306 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 13.
I20260709 13:13:11.012204 27298 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.012813 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.012840 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.013999 27297 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:11.014314 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580a99e39c90417485c3e3481d14bbdc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.017297  1356 raft_consensus.cc:2804] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:11.017578 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.017719  1356 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:11.018260  1356 raft_consensus.cc:3060] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:11.017315 27838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:10.997391 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:11.018926 27838 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:11.021772 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.022383 27832 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:11.023173 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.012279 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:10.999912 27223 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 13.
I20260709 13:13:11.024691 27298 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1010256288ec4502b330749e2e3d7c85 in term 16.
I20260709 13:13:10.991586  1402 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:13:11.025753 27299 raft_consensus.cc:1240] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Rejecting Update request from peer 9bc1278c649846e998b312b374274d08 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:11.026139  1356 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:11.025609 27122 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.027155  1350 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:11.027729  1344 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:11.028263  1344 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Becoming Leader. State: Replica: 1010256288ec4502b330749e2e3d7c85, State: Running, Role: LEADER
I20260709 13:13:11.028569 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.029084  1344 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:11.029745  1379 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.030875  1390 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:10.915858 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.032104 27833 raft_consensus.cc:2393] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.032413 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.007380 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.036528  1339 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.039044 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.042691 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.042778 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.043237  1402 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:11.046116 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 281826us
I20260709 13:13:11.047259 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.063658 27123 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.064682  1394 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:11.065048  1394 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.048336  1390 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:11.067080 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.067785 27225 raft_consensus.cc:3060] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.065654 27122 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.048731  1356 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:11.051937  1350 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.070364  1366 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:11.070818  1356 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.071820  1350 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:11.054623 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:11.073091 27837 raft_consensus.cc:2393] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 17: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.055398 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:11.057024 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:11.075783 27272 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.076086  1386 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:11.076459  1386 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.076786  1386 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:11.077075 27272 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.077560  1363 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.057644 26038 raft_consensus.cc:2272] T 1f6d2e3ad5974f3986941a49bb1339d7 P 1010256288ec4502b330749e2e3d7c85 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.078225  1363 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:11.078583  1363 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.078953  1363 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.081471 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.082868 27225 raft_consensus.cc:2468] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
I20260709 13:13:11.060678  1379 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.065423  1394 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:11.086647 27807 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.087482  1372 raft_consensus.cc:2804] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:11.087952  1372 raft_consensus.cc:697] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.088812  1372 consensus_queue.cc:237] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.083897 27835 raft_consensus.cc:2393] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 16: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.084131 26038 tablet_replica.cc:333] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.090898 26038 raft_consensus.cc:2243] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.091741 26038 raft_consensus.cc:2272] T dd61db1ee95e4b8baf0a3057db7c4d2a P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.084386 27224 raft_consensus.cc:3060] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:11.095796 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.097060 27804 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.097682  1394 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.059966  1323 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.101079 27839 raft_consensus.cc:2393] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 11: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.102212  1394 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:11.102445 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.102984 27232 raft_consensus.cc:3060] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.103006 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.104806 27225 raft_consensus.cc:3060] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:11.107879 27224 raft_consensus.cc:2468] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:13:11.114585 27807 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.108338 26038 tablet_replica.cc:333] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.116632 26038 raft_consensus.cc:2243] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.097455 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.120635  1350 raft_consensus.cc:2804] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:11.121194  1350 raft_consensus.cc:697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.122077  1350 consensus_queue.cc:237] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.103092  1339 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:11.131300 27806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 44400.8us
I20260709 13:13:11.133369 26038 raft_consensus.cc:2272] T 36bb684ea1124ce1a76a958bd405aa9b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.134660 27804 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.135124 27804 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.136117  1390 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:11.139123 27195 consensus_peers.cc:597] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.141439 27195 leader_election.cc:336] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.141990  1323 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:11.141991 27195 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.143379 27195 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.143906 27195 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.144246 27122 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.146239 27232 raft_consensus.cc:2468] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:13:11.149968 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.150748 27224 raft_consensus.cc:3060] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.152271 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.152343 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:11.146468 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:11.155114 27122 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.153505 27195 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.156206  1379 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.167397  1402 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.167083 27122 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.164529 27224 raft_consensus.cc:2468] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 11.
W20260709 13:13:11.187353 27122 raft_consensus.cc:2686] T c2d8b32b61494130ab83c26fc2d310e6 P 1010256288ec4502b330749e2e3d7c85: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:13:11.171888  1394 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.184648 27225 raft_consensus.cc:2468] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 18.
W20260709 13:13:11.158001 27804 leader_election.cc:336] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.188865 27055 catalog_manager.cc:5697] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 10 to 11, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 11 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:11.191622 27804 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.192050 27804 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.192826  1378 raft_consensus.cc:2764] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:11.193207  1372 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.194977 27806 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.195780  1372 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:11.197933 27806 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.198732  1372 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.199422  1363 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.200457 27804 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.153357  1390 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:11.186466 27195 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.201771 27269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 83172.5us
W20260709 13:13:11.201822 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 44486.9us
I20260709 13:13:11.192569 26038 tablet_replica.cc:333] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.171182 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "1010256288ec4502b330749e2e3d7c85" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:11.206585 26038 raft_consensus.cc:2243] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.207279 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.202919 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.212136 26038 pending_rounds.cc:70] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Trying to abort 1 pending ops.
W20260709 13:13:11.207690 27195 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.213661 27122 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1010256288ec4502b330749e2e3d7c85; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.215050  1402 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.224674 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.225564 27300 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 20.
I20260709 13:13:11.228204  1363 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.228775 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.229364 27225 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:11.229629 27804 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.231323 27804 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.231685 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.235209 27806 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
W20260709 13:13:11.235599 27804 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.236063 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.236794  1339 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.212464 26038 pending_rounds.cc:77] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305637032120786944 op_type: NO_OP noop_request { }
I20260709 13:13:11.238883 26038 raft_consensus.cc:2889] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:11.239480 26038 raft_consensus.cc:2272] T 38b3919a88c74cac9b41f07419fbb92d P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.239436 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.236603 27225 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
I20260709 13:13:11.213090 27195 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.244009 27270 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.245569 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.245762 27804 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.246443  1391 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:11.246582 27804 leader_election.cc:336] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.246742 27195 leader_election.cc:336] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.247030 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.248611 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.185956  1386 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:11.249980 27804 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.236929  1378 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:11.242538  1394 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.251981 27807 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.255142 27807 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.238943  1372 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.249923 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.250248  1279 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.256809 27807 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.247323  1339 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:11.256997  1279 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:11.264228 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.258163 27804 leader_election.cc:336] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.250102  1391 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.254314  1343 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:11.247355 27195 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.262907  1398 raft_consensus.cc:2804] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:11.254128  1396 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.266127 27197 leader_election.cc:304] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.258231 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.253645  1378 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.267553  1381 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.258383  1323 raft_consensus.cc:2804] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:11.258386  1353 raft_consensus.cc:2804] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:11.268105 27195 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.271958 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2fcee6798446ca0ae9140145ba175" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.272974 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.273662 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.274075  1398 raft_consensus.cc:697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.274370 27841 raft_consensus.cc:1275] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:11.272145 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.264218  1279 raft_consensus.cc:493] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.277285 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:11.278242 27804 leader_election.cc:336] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.277644 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.279023 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:11.279644 27195 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.283151 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.282160  1391 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.272866  1378 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:11.287176 27804 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.275972  1321 raft_consensus.cc:2749] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.272694  1339 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:11.287827 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.287431 27197 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
W20260709 13:13:11.289093 27804 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.285832  1279 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:11.294263 27197 leader_election.cc:304] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.286072  1371 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.293155 27804 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:13:11.296547 27804 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.297354 27804 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.297631 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:11.288214  1353 raft_consensus.cc:697] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.289055  1323 raft_consensus.cc:697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.300665 27197 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.298991  1371 raft_consensus.cc:2749] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:11.301465  1391 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:11.291023  1390 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.291323  1339 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.297762  1321 raft_consensus.cc:2764] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:11.297629  1396 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.304298  1387 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.304466  1391 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.308130  1339 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.314570 26038 tablet_replica.cc:333] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.324599 26038 raft_consensus.cc:2243] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.316679  1391 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:11.330879  1323 consensus_queue.cc:237] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.314517  1398 consensus_queue.cc:237] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.334702 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.336885 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.337425 27269 leader_election.cc:336] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.337960 27269 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.335512  1387 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.340116  1371 consensus_queue.cc:1059] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:11.341166  1371 raft_consensus.cc:3055] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:11.341468  1371 raft_consensus.cc:740] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:11.342222  1363 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.342450  1386 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:11.344033 27225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:11.346661  1391 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:11.346587  1371 consensus_queue.cc:260] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:11.330436  1353 consensus_queue.cc:237] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.347806 26038 raft_consensus.cc:2272] T 6576306f90684fa797dc0cafcc53fcdb P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.351540  1387 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.360255 27225 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 15: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:11.361156  1391 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:11.364784 26038 tablet_replica.cc:333] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.365756 26038 raft_consensus.cc:2243] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.367008  1371 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.370388 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:11.371160 27839 raft_consensus.cc:3060] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.379694 26038 raft_consensus.cc:2272] T 54a3803047aa4a85bd0d761bdb45cead P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.382256  1378 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.383548 27195 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.394809 27195 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.397770  1378 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.401525 26038 tablet_replica.cc:333] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
W20260709 13:13:11.402204 27804 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.402472 26038 raft_consensus.cc:2243] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:11.404306 27804 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.405187 27269 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.405460 27804 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.389493  1339 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.404788 27839 raft_consensus.cc:2468] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 14.
W20260709 13:13:11.406643 27269 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.410622 27269 leader_election.cc:336] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.410940 27804 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.413810 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9dfa4361254d838c2b61576ada60f4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:11.411126 27269 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.414671 27839 raft_consensus.cc:3060] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.406178  1279 raft_consensus.cc:515] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.419768 27833 raft_consensus.cc:2393] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 21: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.425251 27839 raft_consensus.cc:2468] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:11.426823 26038 raft_consensus.cc:2272] T 36d9f53e5fed4e948f0828f157789667 P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.429411 27271 leader_election.cc:304] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.434422 27269 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.435074 27269 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:13:11.436074 27269 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.436234 27271 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:11.436595 27269 leader_election.cc:336] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.439057  1406 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:11.439726 27269 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.440009 27271 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.441706  1363 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:11.448859 27832 raft_consensus.cc:2393] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 897d8be8580141d1ad3bb17946d3da89 in current term 22: Already voted for candidate f4afe81810944d70bc2cc31754392f3d in this term.
I20260709 13:13:11.449115 27197 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:11.454226  1414 raft_consensus.cc:2804] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:11.454763  1414 raft_consensus.cc:697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:11.454985  1339 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:11.455771  1414 consensus_queue.cc:237] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.439474  1367 raft_consensus.cc:2749] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:11.457645  1393 consensus_queue.cc:1048] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:11.446933  1386 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:11.446785  1357 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.465556 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.474071 27298 raft_consensus.cc:2393] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc1278c649846e998b312b374274d08 in current term 15: Already voted for candidate 897d8be8580141d1ad3bb17946d3da89 in this term.
I20260709 13:13:11.451574  1406 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:11.491145  1279 leader_election.cc:290] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:11.491108 26038 tablet_replica.cc:333] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.493583 26038 raft_consensus.cc:2243] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:11.495081 26038 raft_consensus.cc:2272] T dd2ae66505104867808d4a844f249f6b P 1010256288ec4502b330749e2e3d7c85 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.498781 26038 tablet_replica.cc:333] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.499863 26038 raft_consensus.cc:2243] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:11.500182 27804 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.505657 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.509272  1371 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.509711  1279 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.512862  1279 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.513424 27269 consensus_peers.cc:597] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.514508 27269 leader_election.cc:336] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.517705 27223 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:11.514961 27269 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.521095  1279 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:11.522810 27269 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.522970 26038 raft_consensus.cc:2272] T 4eef03c4dd654384acbb187b85475c25 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.526396 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 74436.6us
I20260709 13:13:11.523299 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:13:11.530987 27269 leader_election.cc:336] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.527375  1279 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.531391 27269 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.527577  1393 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:13:11.531608  1279 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.532680 27269 leader_election.cc:336] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.533370 27269 leader_election.cc:304] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.523641  1357 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.536933  1279 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:11.532415  1363 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.542207 27271 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.543617  1363 raft_consensus.cc:2804] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:11.544113  1363 raft_consensus.cc:697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:11.545019  1363 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.546662  1367 raft_consensus.cc:2749] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:11.548024 27269 leader_election.cc:336] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.548511 27269 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.549659  1393 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:11.550946 27269 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.554971  1386 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:11.555408  1386 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:11.556394 26038 tablet_replica.cc:333] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.557504 26038 raft_consensus.cc:2243] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.533599  1421 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:11.575938 27049 catalog_manager.cc:5697] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 13 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.581351 26038 raft_consensus.cc:2272] T 031d182ea10543e59e77e0a87f18c0be P 1010256288ec4502b330749e2e3d7c85 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:11.584169 27804 leader_election.cc:336] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.552727 27269 leader_election.cc:336] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.587613 27269 leader_election.cc:336] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.587996 27269 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:13:11.589020 27269 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:11.589550 27269 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.589886 27269 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:11.597108 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:11.605386  1422 raft_consensus.cc:2749] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:11.601473 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:13:11.606873 27271 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:42741, user_credentials={real_user=slave}} blocked reactor thread for 64751.4us
I20260709 13:13:11.601402 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b895e250184ee283d78483d5fcae92" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:11.607604 27301 raft_consensus.cc:3060] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:11.608467 27804 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.608718 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:13:11.609167 27804 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.609251 27303 raft_consensus.cc:3060] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.611123 27223 raft_consensus.cc:1275] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:13:11.595839  1421 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:11.621481 27301 raft_consensus.cc:2468] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 22.
I20260709 13:13:11.611739 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.614207  1413 consensus_queue.cc:1048] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:11.585469  1386 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.628324  1386 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:11.631312 26038 tablet_replica.cc:333] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.632153 26038 raft_consensus.cc:2243] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.632910 26038 raft_consensus.cc:2272] T 6e9a8d686c4b4ec199d64c6d3882b858 P 1010256288ec4502b330749e2e3d7c85 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.637398 26038 tablet_replica.cc:333] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.638202 26038 raft_consensus.cc:2243] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.638828 26038 raft_consensus.cc:2272] T 51fed810b66a4d09868add1d38749c15 P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.641592 26038 tablet_replica.cc:333] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.642495 27303 raft_consensus.cc:2468] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 21.
I20260709 13:13:11.624723 27271 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:11.643103  1351 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:11.646745  1424 raft_consensus.cc:2749] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:11.642933 26038 raft_consensus.cc:2243] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.661346 27806 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.662756 27225 raft_consensus.cc:1275] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:13:11.665326 26038 raft_consensus.cc:2272] T d425a845db244636a6b92ed85545087c P 1010256288ec4502b330749e2e3d7c85 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.669862  1390 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:11.672194 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.673797  1396 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:11.674463  1396 consensus_queue.cc:1048] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:13:11.676975 27806 leader_election.cc:304] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:11.679639  1390 raft_consensus.cc:2804] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:13:11.680248  1390 raft_consensus.cc:697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.681111  1390 consensus_queue.cc:237] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.685061 27804 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.691165  1387 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:11.692126  1424 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.692703  1424 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.694761  1424 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.691789  1387 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } attrs { replace: true } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.701695  1387 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.705972 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.706377 27806 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:11.706837 27839 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 20.
I20260709 13:13:11.708671 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.715790 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:13:11.721084 27195 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.722028 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.719354  1424 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:11.728132  1424 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.728530  1424 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.732100 26038 tablet_replica.cc:333] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.717990  1396 raft_consensus.cc:2804] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:11.732899  1396 raft_consensus.cc:697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:11.733829  1396 consensus_queue.cc:237] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:11.735631 27804 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.726534 27197 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:11.732913 26038 raft_consensus.cc:2243] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.741302 26038 raft_consensus.cc:2272] T 2b36513461a9483c98c7adda698d5dad P 1010256288ec4502b330749e2e3d7c85 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.742643  1414 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:11.774410 27049 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 13 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:11.780476 27804 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.789109 26038 tablet_replica.cc:333] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85: stopping tablet replica
I20260709 13:13:11.794348  1386 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 7 to 14, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:11.797452 27841 raft_consensus.cc:2955] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 7 to 14, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:11.801060 26038 raft_consensus.cc:2243] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:11.801666 26038 raft_consensus.cc:2272] T 1a6d314618684d688b91fe535777e47b P 1010256288ec4502b330749e2e3d7c85 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:11.809073 27223 raft_consensus.cc:1275] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:11.817013  1390 consensus_queue.cc:1048] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:13:11.842192 27269 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.814455  1422 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.850351  1422 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.869825  1422 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.871582 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:11.872280 27841 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:13:11.873543 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:11.875428  1351 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:13:11.875694 27804 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.875831  1351 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:11.885169  1351 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:13:11.879168 27269 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.891590 27225 raft_consensus.cc:1275] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:13:11.897313  1394 consensus_queue.cc:1048] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:11.834067 27049 catalog_manager.cc:5697] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 16 to 17, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 17 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.824256  1424 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.905860 27049 catalog_manager.cc:5697] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 17 to 18, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 18 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.909392 27049 catalog_manager.cc:5697] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 15 to 16, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.910995 27049 catalog_manager.cc:5697] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 10 to 11, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 11 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.912771 27049 catalog_manager.cc:5697] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 21 to 22, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 22 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.918304 27224 raft_consensus.cc:1275] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:13:11.921590  1413 consensus_queue.cc:1048] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:11.927870  1424 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:11.929734 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:11.930430 27833 raft_consensus.cc:3060] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:11.940080  1351 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.944551 27833 raft_consensus.cc:2468] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 21.
I20260709 13:13:11.951612 27271 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
W20260709 13:13:11.952855 27269 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:11.958120  1424 raft_consensus.cc:2804] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:11.966570  1386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54492 (request call id 20) took 1795 ms. Trace:
I20260709 13:13:11.970534  1386 rpcz_store.cc:276] 0709 13:13:10.165065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.165207 (+   142us) service_pool.cc:224] Handling call
0709 13:13:10.359054 (+193847us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4c0044aac0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a50003a20 00007f9a50014a29 00007f9a4ffda644 00007f9a50001f2d 00007f9a50001b93 00007f9a51c901af 00007f9a51c8ff3e 00007f9a51d15888 00007f9a51d3275c 00007f9a51d3376a 00007f9a51d3291b
0709 13:13:10.360682 (+  1628us) log.cc:844] Serialized 508 byte log entry
0709 13:13:10.614372 (+253690us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18004089a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec182a6 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1
0709 13:13:10.615801 (+  1429us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18004089a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:13:10.849801 (+234000us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b18004089a0. stack: 00007f9a4ec18343 00007f9a4ec18240 00007f9a4e5a71d4 00007f9a582e5304 00007f9a582e5299 00007f9a57b12de1 00007f9a57b1f5b1 00007f9a4ec4a3f3 00007f9a4ec4c7c1 00007f9a4ec4c779 00007f9a4ec4c709 00007f9a4ec4c6d1 00007f9a4ec4b9cd 000000000038f354 000000000038f199 00007f9a4ec2d83a
0709 13:13:11.959466 (+1109665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115665,"raft.queue_time_us":118948,"raft.run_cpu_time_us":3814,"raft.run_wall_time_us":140358,"spinlock_wait_cycles":105236736,"thread_start_us":100972,"threads_started":2,"wal-append.queue_time_us":145781,"wal-append.run_cpu_time_us":2192,"wal-append.run_wall_time_us":1158264}
I20260709 13:13:11.973076 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a6d314618684d688b91fe535777e47b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:13:11.983958 27048 catalog_manager.cc:5697] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: config changed from index 7 to 14, VOTER 9bc1278c649846e998b312b374274d08 (127.25.109.130) evicted. New cstate: current_term: 19 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:11.986193 27195 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:11.987536 27804 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:11.990576  1424 raft_consensus.cc:697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 21 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:11.995465  1424 consensus_queue.cc:237] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:11.999327 27833 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:13:11.995499 27269 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:12.006139  1422 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:12.008641 27833 raft_consensus.cc:1275] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:12.024320 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c5fdb574f47168ed45c1838cbd31d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:12.024832 27833 raft_consensus.cc:3060] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:12.015301  1378 consensus_queue.cc:1048] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:13:12.024102  1351 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:12.037250 27221 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a6d314618684d688b91fe535777e47b with delete_type TABLET_DATA_TOMBSTONED (TS 9bc1278c649846e998b312b374274d08 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:46398
I20260709 13:13:12.041646 27833 raft_consensus.cc:2468] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
W20260709 13:13:12.033505 27269 consensus_peers.cc:597] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.043157 27271 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:12.045809  1351 raft_consensus.cc:2804] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:12.052644 27048 catalog_manager.cc:5697] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 20 to 21, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 21 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.046568  1351 raft_consensus.cc:697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Becoming Leader. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:12.065191  1351 consensus_queue.cc:237] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:12.062423  1441 tablet_replica.cc:333] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:12.070124  1441 raft_consensus.cc:2243] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:12.071225  1441 raft_consensus.cc:2272] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:12.095183  1441 ts_tablet_manager.cc:1916] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:12.098454 27041 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:12.119742 27224 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:12.121340  1351 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:12.131536 27048 catalog_manager.cc:5697] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 reported cstate change: term changed from 18 to 19, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131). New cstate: current_term: 19 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.150686 27049 catalog_manager.cc:5697] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 20 to 21, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 21 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.154739 27299 raft_consensus.cc:1275] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:13:12.165879  1394 consensus_queue.cc:1048] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:13:12.185418  1441 ts_tablet_manager.cc:1929] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:13:12.185932  1441 log.cc:1199] T 1a6d314618684d688b91fe535777e47b P 9bc1278c649846e998b312b374274d08: Deleting WAL directory at /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/wals/1a6d314618684d688b91fe535777e47b
W20260709 13:13:12.189693 27804 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.188345 27042 catalog_manager.cc:5028] TS 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): tablet 1a6d314618684d688b91fe535777e47b (table test-workload [id=0c26814f2c474e2c9acd7c3103ba7f02]) successfully deleted
I20260709 13:13:12.228124 27302 raft_consensus.cc:1275] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 22 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:13:12.230029  1390 consensus_queue.cc:1048] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:13:12.252456  1321 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.253094  1321 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:12.255259  1321 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:12.285354 27195 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:12.287539 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 63360.4us
I20260709 13:13:12.291477 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:12.303722 27197 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:12.304561  1378 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:12.315186 27804 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.368865  1386 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.369400  1386 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.371766  1386 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:12.372861 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:12.403221 27269 leader_election.cc:336] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:12.403750 27269 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:12.404503  1386 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:12.485553 27269 consensus_peers.cc:597] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.497488 27833 raft_consensus.cc:1275] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:13:12.500070  1351 consensus_queue.cc:1048] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:13:12.517163  1386 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.517693  1386 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.519788  1386 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:12.526738 27269 leader_election.cc:336] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:12.533147 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:12.543144 27269 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:12.550557 27272 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:12.552084  1386 raft_consensus.cc:2749] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:12.571053 27833 raft_consensus.cc:1275] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:13:12.572511  1386 consensus_queue.cc:1048] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:13:12.653578  1394 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.654224  1394 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:12.656800  1394 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:12.658479 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:12.658504 27195 consensus_peers.cc:597] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.659201 27231 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 15.
I20260709 13:13:12.660823 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:12.661726  1394 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:12.662256  1394 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.663652  1394 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.687795  1394 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:12.691834  1394 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:12.698175 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:12.698905 27231 raft_consensus.cc:3060] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:12.718708 27231 raft_consensus.cc:2468] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:13:12.727737 27807 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:12.728976  1350 raft_consensus.cc:2804] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:13:12.730285 27804 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:12.733572  1350 raft_consensus.cc:697] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:12.734544  1350 consensus_queue.cc:237] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:12.745463 27804 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:12.746842 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.765970 27195 consensus_peers.cc:597] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.766930 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.790907 27269 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.792098 27804 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.792135 27195 consensus_peers.cc:597] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.800625 27055 catalog_manager.cc:5697] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 15 to 16, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.814213  1378 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.814924  1378 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.820669 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:12.821610 27299 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:13:12.833472  1378 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:12.834510 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:12.837622  1378 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:12.838038  1378 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:12.838408  1378 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:12.846686 27195 leader_election.cc:336] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:12.871536  1414 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.891338  1414 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.893579  1414 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:12.894980 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:12.895661 27299 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 13.
I20260709 13:13:12.896826 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:12.889104  1378 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.898885  1378 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:12.900498 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:12.903821  1321 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:12.911252 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.909937 27302 raft_consensus.cc:3060] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:12.912863  1321 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.913350  1321 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:12.916250 27804 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.920336  1321 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.921470 27302 raft_consensus.cc:2468] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:12.922813 27197 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:12.925103  1321 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:12.930194  1457 raft_consensus.cc:2804] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:12.930750  1457 raft_consensus.cc:697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:12.931824 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:12.932446 27302 raft_consensus.cc:3060] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:12.931595  1457 consensus_queue.cc:237] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:12.943838 27195 consensus_peers.cc:597] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:12.948787 27195 leader_election.cc:336] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:12.949549 27195 leader_election.cc:336] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:12.950304 27195 consensus_peers.cc:597] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.954200 27302 raft_consensus.cc:2468] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
W20260709 13:13:12.954428 27195 leader_election.cc:336] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:12.955267 27195 consensus_peers.cc:597] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.958353 27197 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:12.970417  1457 raft_consensus.cc:2804] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:12.971006  1457 raft_consensus.cc:697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
W20260709 13:13:12.972945 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:12.973222  1457 consensus_queue.cc:237] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.984395  1321 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:12.985112  1321 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:12.987507  1321 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:12.992583 27195 leader_election.cc:336] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:12.996992 27055 catalog_manager.cc:5697] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.025733 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:13.026456 27299 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 14.
I20260709 13:13:13.037776 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:13.040045  1321 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:13.041214  1321 raft_consensus.cc:493] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1010256288ec4502b330749e2e3d7c85)
I20260709 13:13:13.041934  1321 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:13.056113 27055 catalog_manager.cc:5697] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 13 to 14, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 14 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.053253  1321 raft_consensus.cc:515] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:13.063185  1378 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.063694  1378 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:13.067663 27195 leader_election.cc:336] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:13.065820  1378 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:13.074637 27195 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:13.082079  1321 leader_election.cc:290] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:13.110558 27195 consensus_peers.cc:597] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.119665 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:13.120399 27299 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:13:13.122190 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2ae66505104867808d4a844f249f6b" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:13.122668 27299 raft_consensus.cc:3060] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:13.123337 27195 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.125901 27195 consensus_peers.cc:597] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.130414 27299 raft_consensus.cc:2468] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 15.
I20260709 13:13:13.138325 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:13.144150  1378 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:13.144615  1378 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.145021  1378 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:13.149669 27197 leader_election.cc:304] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:13.150909  1321 raft_consensus.cc:2804] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:13.151541  1321 raft_consensus.cc:697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:13.152477  1321 consensus_queue.cc:237] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:13.162521 27195 consensus_peers.cc:597] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.186462  1458 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:13.187196  1458 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:13.190114 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:13.190841 27224 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:13.193251  1458 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:13.216774 27804 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.219564 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:13.220268 27301 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:13:13.226846 27055 catalog_manager.cc:5697] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 14 to 15, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 15 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.233223 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:13.234359  1372 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:13.234756  1372 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:13.235140  1372 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:13.240594 27269 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.241137 27269 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.260917 27224 raft_consensus.cc:1275] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Refusing update from remote peer f4afe81810944d70bc2cc31754392f3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:13:13.262948 27269 consensus_peers.cc:597] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.264055  1396 consensus_queue.cc:1048] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:13:13.269781  1372 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:13.273099 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:13.273635  1372 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:13.273819 27231 raft_consensus.cc:2393] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 16: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:13.275800  1378 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
W20260709 13:13:13.282470 27269 consensus_peers.cc:597] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.283361 27302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:13:13.296947 27195 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:13.299055 27804 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.300351  1378 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Requested vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:13.304287 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695ceba1143c428490ae6aad424a66ea" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:13.304926 27301 raft_consensus.cc:3060] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:13.311825 27301 raft_consensus.cc:2468] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:13:13.307965 27302 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 16.
I20260709 13:13:13.315603 27197 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85
I20260709 13:13:13.316489  1378 raft_consensus.cc:2804] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.317374  1378 raft_consensus.cc:697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 16 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:13.317445 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:13.318459  1372 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:13.318512  1378 consensus_queue.cc:237] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:13.319774  1372 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:13.331609  1372 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:13.319337 27269 consensus_peers.cc:597] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.367651 27269 consensus_peers.cc:597] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.367444 27055 catalog_manager.cc:5697] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 14 to 16, leader changed from 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 16 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.379552 27049 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 15 to 16, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 16 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:13.403455 27195 consensus_peers.cc:597] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.419816 27195 consensus_peers.cc:597] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.452987 27269 consensus_peers.cc:597] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.470736  1321 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.471387  1321 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:13.470790 26038 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27178)
I20260709 13:13:13.476749  1321 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:13.478641 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:13.480734 27195 consensus_peers.cc:597] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:13.491580 27269 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:13.479128 27301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:13.502269 27301 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:13:13.504004 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:13.504875  1321 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:13.505498  1321 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.506007  1321 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.516685  1321 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:13.519464  1321 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:13.526355 27301 raft_consensus.cc:1275] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:13:13.528163 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:13.531687 27299 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.530279 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:13.547601 27299 raft_consensus.cc:2468] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:13.550748  1457 consensus_queue.cc:1048] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:13:13.553891 27197 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:13.556630  1457 raft_consensus.cc:2804] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:13.557951  1457 raft_consensus.cc:697] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:13.560272  1457 consensus_queue.cc:237] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:13.584084 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 44233us
I20260709 13:13:13.588661 27301 raft_consensus.cc:1275] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:13.597148  1321 consensus_queue.cc:1048] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:13:13.611413 27804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111) [suppressed 308 similar messages]
I20260709 13:13:13.621093 27049 catalog_manager.cc:5697] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 16 to 17, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 17 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:13.628566 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:13.681021 27195 consensus_peers.cc:597] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.732841 27301 raft_consensus.cc:1275] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:13.737943  1321 consensus_queue.cc:1048] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:13:13.770422 27195 consensus_peers.cc:597] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:13.792987 27299 raft_consensus.cc:1240] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:13.794327  1396 consensus_queue.cc:1059] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:13.795130  1372 raft_consensus.cc:3055] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:13.795498  1372 raft_consensus.cc:740] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:13.796305  1372 consensus_queue.cc:260] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:13.797550  1372 raft_consensus.cc:3060] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:13.813795 27301 raft_consensus.cc:1275] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:13:13.816075  1378 consensus_queue.cc:1048] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:14.049849 27833 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:13:14.050280 27833 pending_rounds.cc:85] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 12
I20260709 13:13:14.050526 27833 pending_rounds.cc:107] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:13:14.050792 27833 raft_consensus.cc:2889] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:14.052706  1459 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:14.056293 27304 raft_consensus.cc:1275] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:13:14.065367  1459 consensus_queue.cc:1048] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:14.106474 27804 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.027415 26038 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27178)
I20260709 13:13:15.145620  1482 raft_consensus.cc:493] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.150683  1482 raft_consensus.cc:515] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.154913  1482 leader_election.cc:290] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:15.195786  1483 raft_consensus.cc:493] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.203974  1485 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.205212  1485 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } attrs { replace: true } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.206614  1487 raft_consensus.cc:493] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.207518  1487 raft_consensus.cc:515] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.196938  1483 raft_consensus.cc:515] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.212702  1482 raft_consensus.cc:493] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.215950  1484 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.210287  1485 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.222719  1487 leader_election.cc:290] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:15.224452  1482 raft_consensus.cc:515] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.227324  1483 leader_election.cc:290] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:15.232123 27231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39166 (request call id 1723) took 1041 ms. Trace:
W20260709 13:13:15.239725 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080034a8c0 after lost signal to thread 26041
I20260709 13:13:15.239756 27231 rpcz_store.cc:276] 0709 13:13:14.190190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.190509 (+   319us) service_pool.cc:224] Handling call
0709 13:13:14.190790 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.191143 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:14.191174 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:14.191216 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:13:14.191249 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.191412 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:15.231761 (+1040349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:15.242028 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.244375  1484 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.232957  1482 leader_election.cc:290] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:15.259893 27048 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56068 (request call id 380) took 1111 ms. Trace:
I20260709 13:13:15.279399  1484 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.268034 27048 rpcz_store.cc:276] 0709 13:13:14.148268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:14.148406 (+   138us) service_pool.cc:224] Handling call
0709 13:13:15.259501 (+1111095us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:15.297073  1489 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.298434 27049 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56082 (request call id 417) took 1106 ms. Trace:
I20260709 13:13:15.298264  1489 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.298892 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.298954 27049 rpcz_store.cc:276] 0709 13:13:14.192344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.175990 (+983646us) service_pool.cc:224] Handling call
0709 13:13:15.298197 (+122207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87200,"reported_tablets":1}
I20260709 13:13:15.300887  1484 raft_consensus.cc:493] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.301661  1484 raft_consensus.cc:515] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.303853  1489 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.304032  1484 leader_election.cc:290] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.305873  1489 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.307041 27298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.306875  1489 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.310118  1489 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.311005  1484 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.314560  1491 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.315299  1490 raft_consensus.cc:493] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.318202  1490 raft_consensus.cc:515] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.322558  1490 leader_election.cc:290] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.326313  1491 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.330581  1484 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.333323  1484 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.339048  1378 raft_consensus.cc:493] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.340023  1378 raft_consensus.cc:515] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.347146  1378 leader_election.cc:290] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.347944  1378 raft_consensus.cc:493] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.348912  1378 raft_consensus.cc:515] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.349567  1457 raft_consensus.cc:493] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.350181  1491 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:15.350596  1484 raft_consensus.cc:493] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.358135  1484 raft_consensus.cc:515] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.361323  1484 leader_election.cc:290] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.362110  1457 raft_consensus.cc:515] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.365855  1457 leader_election.cc:290] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.367781  1372 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.371065  1372 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.372745  1491 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.373301  1492 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.373725  1491 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.374301  1492 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.377254  1491 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.377648  1475 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.377985  1457 raft_consensus.cc:493] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.378548  1475 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.378947  1457 raft_consensus.cc:515] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } }
I20260709 13:13:15.381047  1475 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.381654  1457 leader_election.cc:290] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.381597  1475 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.383836  1378 leader_election.cc:290] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.384092  1475 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.383006  1372 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.390488  1475 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.400537  1321 raft_consensus.cc:493] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.401316  1321 raft_consensus.cc:515] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.404027  1321 leader_election.cc:290] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:15.405225 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08003583c0 after lost signal to thread 27089
I20260709 13:13:15.377170  1492 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.421391 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e466225c5a147b9b31f11fea1bcf893" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.428314 27269 leader_election.cc:336] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.429054 27269 leader_election.cc:336] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.443689 27269 leader_election.cc:336] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.444121 27269 leader_election.cc:336] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.432112 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.448683 27839 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 16.
I20260709 13:13:15.434139 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd61db1ee95e4b8baf0a3057db7c4d2a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.444633 27269 consensus_peers.cc:597] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:15.433916 27841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.432961 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f560534ffa48878a9e4d4766199287" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.452256 27269 leader_election.cc:336] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.452749 27269 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.433413 27832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.454547 27269 consensus_peers.cc:597] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.450867 27195 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 47311.9us
I20260709 13:13:15.498323 27837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1366d63dcc6742608d7574eb132c123a" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.500288 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d425a845db244636a6b92ed85545087c" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.492486  1483 raft_consensus.cc:493] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.501927  1483 raft_consensus.cc:515] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.492497  1482 raft_consensus.cc:493] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.504573  1482 raft_consensus.cc:515] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.507848 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02ecf580b8f4657acdf790942e85fd5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.508157 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9936add6bb224d4bbd8bcd5a38781ae5" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
W20260709 13:13:15.518432 27269 leader_election.cc:336] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.520969 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080005d340 after lost signal to thread 27256
W20260709 13:13:15.519179 27269 leader_election.cc:336] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.522660 27086 debug-util.cc:398] Leaking SignalData structure 0x7b0800368260 after lost signal to thread 27330
W20260709 13:13:15.522965 27086 debug-util.cc:398] Leaking SignalData structure 0x7b080036a9e0 after lost signal to thread 27331
I20260709 13:13:15.528973  1485 raft_consensus.cc:493] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.529227  1459 raft_consensus.cc:493] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.529651  1485 raft_consensus.cc:515] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:15.531077  1486 raft_consensus.cc:493] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.531665  1486 raft_consensus.cc:515] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.532399  1485 leader_election.cc:290] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.532927  1485 raft_consensus.cc:493] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.533489  1485 raft_consensus.cc:515] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.530025  1459 raft_consensus.cc:515] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.533782  1486 leader_election.cc:290] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.535035  1482 leader_election.cc:290] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.543262 27297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa050ea82d9b4a729f786c4fd23f4904" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.543463  1459 leader_election.cc:290] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:15.537040 27086 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4800 after lost signal to thread 27865
I20260709 13:13:15.543869 27303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62a963093f641fa81d5d816797099e1" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.537384  1483 leader_election.cc:290] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.540136  1487 raft_consensus.cc:493] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.542047 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a6d314618684d688b91fe535777e47b" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.544904  1487 raft_consensus.cc:515] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.545929 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.547435 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d526be8aec49c8863369b60c8e884c" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.548931 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.549431  1487 leader_election.cc:290] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.550879  1485 leader_election.cc:290] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.537617  1495 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.553776  1495 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.554602  1475 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.555281  1475 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.556757  1495 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.557355  1475 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:15.561201 27195 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.568663  1487 raft_consensus.cc:493] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.569384  1487 raft_consensus.cc:515] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.571660 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe318d32db494aafa007d9cb3d4cf02a" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.572364 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9a8d686c4b4ec199d64c6d3882b858" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.573187 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.578713 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031d182ea10543e59e77e0a87f18c0be" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.582235  1487 leader_election.cc:290] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.562455 27195 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:13:15.583221 27269 leader_election.cc:336] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.587042 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "897bd586cdb44a899e3c85e77da927c3" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.589082  1459 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.592597 27197 leader_election.cc:304] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.593437  1493 raft_consensus.cc:2749] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.593709 27197 leader_election.cc:304] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.594512  1493 raft_consensus.cc:2749] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.595170 27197 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.595831  1493 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:15.596242 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.596937  1493 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:15.597352  1493 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.597584 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b3919a88c74cac9b41f07419fbb92d" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:15.598266 27269 leader_election.cc:336] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.598820 27195 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.599438 27195 leader_election.cc:336] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.597801  1493 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:15.599790 27195 leader_election.cc:304] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.600687 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd31e5d20c484a9facfe437706e9bd6b" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.602104 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51fed810b66a4d09868add1d38749c15" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.602443 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b636aab71bc4cad87e3a5d644042885" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.604044  1485 raft_consensus.cc:493] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.604681  1485 raft_consensus.cc:515] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.606480  1485 leader_election.cc:290] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.606565  1498 raft_consensus.cc:493] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.607304  1498 raft_consensus.cc:515] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.609649  1459 raft_consensus.cc:493] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.610153  1498 leader_election.cc:290] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.610314  1459 raft_consensus.cc:515] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.612480  1459 leader_election.cc:290] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.613200  1485 raft_consensus.cc:493] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.616086  1486 raft_consensus.cc:2749] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:15.618374 27195 leader_election.cc:336] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.620584 27226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eef03c4dd654384acbb187b85475c25" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
W20260709 13:13:15.621291 27195 leader_election.cc:336] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.621773 27195 leader_election.cc:304] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.622431 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be324c341d044aa892e39ebca665c6c6" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.624189 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a3803047aa4a85bd0d761bdb45cead" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.626368 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3cb013cb450432ba238b716d88554e4" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.627116 27272 leader_election.cc:304] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.613783  1485 raft_consensus.cc:515] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.629637 27223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.630339 27230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2433340983a46c0b79d3ff64b3694b6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.631429  1486 raft_consensus.cc:2749] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:15.632475 27195 leader_election.cc:336] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.632990 27229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.634491 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.632499  1485 leader_election.cc:290] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:15.645141 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 56712.6us
I20260709 13:13:15.646857 27305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91cb18a432b4fefa2c9d4eff143e3d7" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.648185 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2d8b32b61494130ab83c26fc2d310e6" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.658281  1498 raft_consensus.cc:2749] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:15.659294 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.665184 27272 leader_election.cc:304] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.666795 27807 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.667608  1463 raft_consensus.cc:2749] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:15.668392  1495 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:15.669308 27272 leader_election.cc:304] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.669422 27271 leader_election.cc:304] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.670416 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06445e3c1bb74c8f862cf1af47256377" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.669615 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.672389  1493 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.674288 27224 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Rejecting Update request from peer 897d8be8580141d1ad3bb17946d3da89 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:15.674511 27195 leader_election.cc:336] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.675460 27195 leader_election.cc:336] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.675825 27195 leader_election.cc:304] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.676548  1486 raft_consensus.cc:2749] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:15.676806 27195 leader_election.cc:336] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.677297 27195 leader_election.cc:336] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.680143  1488 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.681716 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d9f53e5fed4e948f0828f157789667" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.683348 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a6377ffbb949a09216851d176dbcfc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.683940 27195 leader_election.cc:336] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.684613 27195 leader_election.cc:336] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:15.685058 27195 leader_election.cc:336] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.684957 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c3d4b3cf374582b470348b1f7dc027" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.686625 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63772c6ab6094654b0215f6a3be7d6fc" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.688112 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86bf2019fd7b421393e482331c89a37d" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.690322  1463 raft_consensus.cc:2749] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:15.690976 27197 leader_election.cc:304] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.692324  1498 raft_consensus.cc:2749] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:15.692711 27271 leader_election.cc:304] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.691620 27272 leader_election.cc:304] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.691762  1488 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:15.693665  1488 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.694563  1490 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:15.695243  1490 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.692672  1459 raft_consensus.cc:2749] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.696130  1488 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:15.693934 27271 leader_election.cc:304] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.697484  1490 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.694159  1498 raft_consensus.cc:2749] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:13:15.697979  1490 raft_consensus.cc:2749] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:15.700443 27271 leader_election.cc:304] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.701579 27833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64b1a67a0cc42479c0519e68bc68492" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.702332  1493 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.702819  1491 raft_consensus.cc:2749] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:15.703976 27271 leader_election.cc:304] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:15.704687 27269 consensus_peers.cc:597] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:15.705426  1491 raft_consensus.cc:2749] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.705374 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006b4229b8b346a4b6e1de5910f7b5a4" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.710484 27804 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.710901 27804 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.711961 27304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:15.715036 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:15.716691  1491 raft_consensus.cc:2749] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.721088 27300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
W20260709 13:13:15.720613 27195 consensus_peers.cc:597] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:15.728179 27269 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:15.728806  1488 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:15.729930 27197 leader_election.cc:304] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:15.731977 27804 leader_election.cc:336] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.732652 27272 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.736991  1463 raft_consensus.cc:2749] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:15.737449 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.742451  1495 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:15.742769 27804 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.743314 27804 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.743893 27804 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.744279 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.738328 27272 leader_election.cc:304] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.745016  1495 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.745796  1463 raft_consensus.cc:2749] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.745890 27272 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.747016  1463 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:15.747392  1493 raft_consensus.cc:2749] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.749776  1491 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:15.750854  1463 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:15.751266  1463 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 897d8be8580141d1ad3bb17946d3da89, State: Running, Role: LEADER
I20260709 13:13:15.752326  1463 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.756285  1463 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:15.758229  1491 raft_consensus.cc:493] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:15.758925  1491 raft_consensus.cc:515] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:15.761232  1491 leader_election.cc:290] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:15.763161 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b189bbd0aa4c6787e99f8cc041dd48" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
W20260709 13:13:15.765519 27269 leader_election.cc:336] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.767113 27231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba2f184437940dbb94ed0532f27e854" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.767692 27224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:15.774422 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.774747 27271 leader_election.cc:304] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.776660  1490 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:15.777741  1491 raft_consensus.cc:2749] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:15.782666 27804 leader_election.cc:336] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.783164 27804 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.783885  1488 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:15.784101 27804 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:15.788268 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:15.789914  1488 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:15.802639 27197 leader_election.cc:304] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.803498  1493 raft_consensus.cc:2749] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:15.804687 27197 leader_election.cc:304] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.805428  1493 raft_consensus.cc:2749] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.806536 27197 leader_election.cc:304] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.807205  1485 raft_consensus.cc:2749] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:15.807629 27197 leader_election.cc:304] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.808523  1485 raft_consensus.cc:2749] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:15.808743 27197 leader_election.cc:304] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.809643  1485 raft_consensus.cc:2749] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:15.818136 27197 leader_election.cc:304] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 1010256288ec4502b330749e2e3d7c85, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.819247 27197 leader_election.cc:304] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.819335  1493 raft_consensus.cc:2749] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:15.820308  1485 raft_consensus.cc:2749] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:15.831302 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
W20260709 13:13:15.834285 27804 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.834862 27804 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.835250 27804 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.836037  1488 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:15.837090 27804 leader_election.cc:336] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:15.837512 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:15.846256  1488 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:15.860877 27195 consensus_peers.cc:597] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:15.861366 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:15.862953  1459 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:13:15.937913 27804 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.976400 27804 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:15.983202 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:16.000247  1493 raft_consensus.cc:493] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4afe81810944d70bc2cc31754392f3d)
I20260709 13:13:16.001032  1493 raft_consensus.cc:515] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:16.004925  1493 leader_election.cc:290] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:16.006963 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:16.008102 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e37f81c47354aae99c01542f682acef" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:16.009902 27197 leader_election.cc:304] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc1278c649846e998b312b374274d08; no voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:16.012590  1493 raft_consensus.cc:2749] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:16.029032 26038 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27178)
W20260709 13:13:16.046201 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.086263 27195 consensus_peers.cc:597] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.273522 27269 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.295796 27195 consensus_peers.cc:597] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.296397 27195 consensus_peers.cc:597] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.296875 27195 consensus_peers.cc:597] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.308630 27195 consensus_peers.cc:597] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.311631 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.322883 27195 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.345041 27269 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.345248 27195 consensus_peers.cc:597] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.353891 27804 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.413161 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.417974 27195 consensus_peers.cc:597] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.444541 27804 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.541252 27804 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.554157 27804 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.666554 27269 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.765259 27269 consensus_peers.cc:597] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.809324 27269 consensus_peers.cc:597] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.871122 27269 consensus_peers.cc:597] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.886649 27269 consensus_peers.cc:597] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.913645 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:16.927085 27195 consensus_peers.cc:597] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.942762 27195 consensus_peers.cc:597] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:16.971036 27269 consensus_peers.cc:597] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:17.029557 26038 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 27178)
W20260709 13:13:17.130380 27195 consensus_peers.cc:597] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:17.135295 27195 consensus_peers.cc:597] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:17.150595 27253 debug-util.cc:398] Leaking SignalData structure 0x7b080034ba40 after lost signal to thread 26041
W20260709 13:13:17.151875 27253 debug-util.cc:398] Leaking SignalData structure 0x7b0800342300 after lost signal to thread 27089
W20260709 13:13:17.153327 27253 debug-util.cc:398] Leaking SignalData structure 0x7b080017dc80 after lost signal to thread 27256
W20260709 13:13:17.154490 27253 debug-util.cc:398] Leaking SignalData structure 0x7b08000cfd00 after lost signal to thread 27330
W20260709 13:13:17.156710 27253 debug-util.cc:398] Leaking SignalData structure 0x7b08000e92c0 after lost signal to thread 27865
I20260709 13:13:17.305440  1504 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:17.306084  1504 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:17.308269  1504 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:17.330842 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08" is_pre_election: true
I20260709 13:13:17.331620 27232 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:17.366572 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:17.367265 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:13:17.369776 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:17.374369  1504 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:17.374742  1504 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:17.375108  1504 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:17.394627  1504 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:17.397715 27232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9bc1278c649846e998b312b374274d08"
I20260709 13:13:17.398471 27232 raft_consensus.cc:2393] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4afe81810944d70bc2cc31754392f3d in current term 17: Already voted for candidate 9bc1278c649846e998b312b374274d08 in this term.
I20260709 13:13:17.399734  1504 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:17.397424 27269 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:17.404923 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "f4afe81810944d70bc2cc31754392f3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:17.424837 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4afe81810944d70bc2cc31754392f3d in term 17.
I20260709 13:13:17.426086 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:17.426863  1372 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:17.427309  1372 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Leader. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:17.428128  1372 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:17.469977 27049 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d reported cstate change: term changed from 16 to 17, leader changed from 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131) to f4afe81810944d70bc2cc31754392f3d (127.25.109.132). New cstate: current_term: 17 leader_uuid: "f4afe81810944d70bc2cc31754392f3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:17.580649 27195 consensus_peers.cc:597] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:17.646198 27804 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:17.716737 27195 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:17.762295  1513 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.762890  1513 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:17.765196  1513 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:17.769537 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89" is_pre_election: true
I20260709 13:13:17.770287 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 17.
I20260709 13:13:17.773344 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:17.776818 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:17.777807  1485 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:17.778281  1485 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.778648  1485 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:17.799919 27804 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:17.812129  1485 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:17.827739 27299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "897d8be8580141d1ad3bb17946d3da89"
I20260709 13:13:17.828351 27299 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:17.836463 27299 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc1278c649846e998b312b374274d08 in term 18.
I20260709 13:13:17.837448 27197 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08; no voters: 
I20260709 13:13:17.838685  1513 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:17.839630  1513 raft_consensus.cc:697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 LEADER]: Becoming Leader. State: Replica: 9bc1278c649846e998b312b374274d08, State: Running, Role: LEADER
I20260709 13:13:17.842796 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "9bc1278c649846e998b312b374274d08" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:17.843039  1513 consensus_queue.cc:237] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:17.845242 27804 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:17.852847  1485 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [CANDIDATE]: Term 18 election: Requested vote from peers 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:17.886884 27049 catalog_manager.cc:5697] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 reported cstate change: term changed from 17 to 18, leader changed from f4afe81810944d70bc2cc31754392f3d (127.25.109.132) to 9bc1278c649846e998b312b374274d08 (127.25.109.130). New cstate: current_term: 18 leader_uuid: "9bc1278c649846e998b312b374274d08" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:17.929143 27269 consensus_peers.cc:597] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:17.970515 27305 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:17.971925  1372 consensus_queue.cc:1059] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:13:17.980546 27195 consensus_peers.cc:597] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:18.000947  1504 raft_consensus.cc:3055] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:18.001451  1504 raft_consensus.cc:740] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4afe81810944d70bc2cc31754392f3d, State: Running, Role: LEADER
I20260709 13:13:18.002333  1504 consensus_queue.cc:260] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:18.003405  1504 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:18.008522 27231 raft_consensus.cc:1240] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 LEADER]: Rejecting Update request from peer f4afe81810944d70bc2cc31754392f3d for earlier term 17. Current term is 18. Ops: []
W20260709 13:13:18.022433 27804 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.030020 26038 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 27178)
W20260709 13:13:18.060606 27269 consensus_peers.cc:597] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.132540 27804 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.157370 27269 consensus_peers.cc:597] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:18.382042 27839 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:13:18.382505 27839 pending_rounds.cc:85] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Aborting all ops after (but not including) 12
I20260709 13:13:18.382715 27839 pending_rounds.cc:107] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:13:18.383030 27839 raft_consensus.cc:2889] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:18.386080  1513 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:13:18.472683 27305 raft_consensus.cc:1275] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Refusing update from remote peer 9bc1278c649846e998b312b374274d08: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:13:18.479781  1486 consensus_queue.cc:1048] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:13:18.505244 27804 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.526494 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.544631 27195 consensus_peers.cc:597] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.564599 27269 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.576726 27804 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.620980 27195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111) [suppressed 394 similar messages]
W20260709 13:13:18.633394 27195 consensus_peers.cc:597] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.647491 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.664924 27269 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.691324 27195 consensus_peers.cc:597] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.714527 27269 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.742252 27195 consensus_peers.cc:597] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.828979 27195 consensus_peers.cc:597] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.886535 27804 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.892618 27804 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:18.899057 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.938903 27195 consensus_peers.cc:597] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.972748 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.987926 27195 consensus_peers.cc:597] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:18.992281 27804 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.025135 27195 consensus_peers.cc:597] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.030509 26038 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 27178)
W20260709 13:13:19.081873 27195 consensus_peers.cc:597] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.088050 27804 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.108181 27269 consensus_peers.cc:597] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.135062 27197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:37965, user_credentials={real_user=slave}} blocked reactor thread for 45773.1us
W20260709 13:13:19.236508 27269 consensus_peers.cc:597] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.239184 27269 consensus_peers.cc:597] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.256491 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.327948 27195 consensus_peers.cc:597] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.340482 27269 consensus_peers.cc:597] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.361757 27269 consensus_peers.cc:597] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.421838 27269 consensus_peers.cc:597] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.427659 27269 consensus_peers.cc:597] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.567361 27195 consensus_peers.cc:597] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:19.749070 27195 consensus_peers.cc:597] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:19.847404 27195 consensus_peers.cc:597] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:19.904765 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
W20260709 13:13:20.001762 27195 consensus_peers.cc:597] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.078809 27804 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.082870 27195 consensus_peers.cc:597] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:20.140168 27804 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:20.144172 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:13:20.166388 27807 consensus_peers.cc:597] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.169086 27272 consensus_peers.cc:597] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.172222 27807 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.181213 27272 consensus_peers.cc:597] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.260136 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:20.260147 27807 consensus_peers.cc:597] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.261327 27807 consensus_peers.cc:597] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.262240 27807 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.263226 26038 tablet_replica.cc:333] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.264247 26038 raft_consensus.cc:2243] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.265014 26038 raft_consensus.cc:2272] T 9936add6bb224d4bbd8bcd5a38781ae5 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.268054 26038 tablet_replica.cc:333] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.270169 26038 raft_consensus.cc:2243] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.272667 26038 raft_consensus.cc:2272] T c8f560534ffa48878a9e4d4766199287 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.276286 26038 tablet_replica.cc:333] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.277257 26038 raft_consensus.cc:2243] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.278499 26038 raft_consensus.cc:2272] T b3cb013cb450432ba238b716d88554e4 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.281010 26038 tablet_replica.cc:333] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.292881 26038 raft_consensus.cc:2243] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.294293 26038 raft_consensus.cc:2272] T 9f9dfa4361254d838c2b61576ada60f4 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.297473 26038 tablet_replica.cc:333] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.298349 26038 raft_consensus.cc:2243] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.299431 26038 raft_consensus.cc:2272] T d6a8841c8bb041a1a423a427ed084489 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.299866 27299 consensus_queue.cc:237] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:20.305624 26038 tablet_replica.cc:333] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.307655 26038 raft_consensus.cc:2243] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:13:20.309648 27807 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.309721 26038 raft_consensus.cc:2272] T 695ceba1143c428490ae6aad424a66ea P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.312073 27807 consensus_peers.cc:597] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.312850 26038 tablet_replica.cc:333] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.313977 26038 raft_consensus.cc:2243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.315119 26038 raft_consensus.cc:2272] T 006b4229b8b346a4b6e1de5910f7b5a4 P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.318531 26038 tablet_replica.cc:333] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.319427 26038 raft_consensus.cc:2243] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.320931 26038 raft_consensus.cc:2272] T 63772c6ab6094654b0215f6a3be7d6fc P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.323854 26038 tablet_replica.cc:333] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.324625 26038 raft_consensus.cc:2243] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.325402 26038 raft_consensus.cc:2272] T d6c3d4b3cf374582b470348b1f7dc027 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.328075 26038 tablet_replica.cc:333] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.329176 26038 raft_consensus.cc:2243] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.332346 26038 raft_consensus.cc:2272] T 36d2fcee6798446ca0ae9140145ba175 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.335158 26038 tablet_replica.cc:333] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.336033 26038 raft_consensus.cc:2243] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.336645 26038 raft_consensus.cc:2272] T 86bf2019fd7b421393e482331c89a37d P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.338538 27832 raft_consensus.cc:1275] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Refusing update from remote peer 897d8be8580141d1ad3bb17946d3da89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:20.340332 26038 tablet_replica.cc:333] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.342315 26038 raft_consensus.cc:2243] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.342500  1527 consensus_queue.cc:1048] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:20.343415 26038 raft_consensus.cc:2272] T c956eb948d264e3fa713d592c530d94e P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.346081 26038 tablet_replica.cc:333] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.347168 26038 raft_consensus.cc:2243] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.349556 26038 raft_consensus.cc:2272] T 44c0f63822c7471ebdec8a5f3dfa21a9 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.351984 26038 tablet_replica.cc:333] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
W20260709 13:13:20.352351 27272 consensus_peers.cc:597] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.352746 26038 raft_consensus.cc:2243] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.353964 26038 raft_consensus.cc:2272] T 432318984ae54d3b86d6f16faa526523 P 9bc1278c649846e998b312b374274d08 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.356629 26038 tablet_replica.cc:333] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.357466 26038 raft_consensus.cc:2243] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.358031 26038 raft_consensus.cc:2272] T 06445e3c1bb74c8f862cf1af47256377 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.360692 26038 tablet_replica.cc:333] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.361446 26038 raft_consensus.cc:2243] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.362126 26038 raft_consensus.cc:2272] T 08a6377ffbb949a09216851d176dbcfc P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.371644 26038 tablet_replica.cc:333] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.372530 26038 raft_consensus.cc:2243] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.373909 26038 raft_consensus.cc:2272] T be324c341d044aa892e39ebca665c6c6 P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.376659 26038 tablet_replica.cc:333] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.377444 26038 raft_consensus.cc:2243] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.376947  1505 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:20.378218 26038 raft_consensus.cc:2272] T 9e466225c5a147b9b31f11fea1bcf893 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.380954 26038 tablet_replica.cc:333] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.381732 26038 raft_consensus.cc:2243] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.382776 26038 raft_consensus.cc:2272] T ae22f698260e475b89b90dcbd28bda00 P 9bc1278c649846e998b312b374274d08 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.383199 27839 raft_consensus.cc:2955] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:20.385278 26038 tablet_replica.cc:333] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.386113 26038 raft_consensus.cc:2243] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.387113 26038 raft_consensus.cc:2272] T fcf276ae949142ce87f50371f8505b9d P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.389719 26038 tablet_replica.cc:333] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.390635 26038 raft_consensus.cc:2243] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.391220 26038 raft_consensus.cc:2272] T 1366d63dcc6742608d7574eb132c123a P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.393760 26038 tablet_replica.cc:333] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.394583 26038 raft_consensus.cc:2243] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.395838 26038 raft_consensus.cc:2272] T af55c80b2afb4d89beeb86311b788bca P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.398169 26038 tablet_replica.cc:333] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.398976 26038 raft_consensus.cc:2243] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.399626 26038 raft_consensus.cc:2272] T d64b1a67a0cc42479c0519e68bc68492 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.402437 26038 tablet_replica.cc:333] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.403234 26038 raft_consensus.cc:2243] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.403856 26038 raft_consensus.cc:2272] T 1e37f81c47354aae99c01542f682acef P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.441357 26038 tablet_replica.cc:333] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.442286 26038 raft_consensus.cc:2243] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.443171 26038 raft_consensus.cc:2272] T 8ba2f184437940dbb94ed0532f27e854 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.451802 26038 tablet_replica.cc:333] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.452737 26038 raft_consensus.cc:2243] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.453653 26038 raft_consensus.cc:2272] T dd514c8b688c4f2e90b6ad46174723ef P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.456302 26038 tablet_replica.cc:333] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.457118 26038 raft_consensus.cc:2243] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.458124 26038 raft_consensus.cc:2272] T 54a3803047aa4a85bd0d761bdb45cead P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.460599 26038 tablet_replica.cc:333] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.461513 26038 raft_consensus.cc:2243] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.462211 26038 raft_consensus.cc:2272] T 2bd98a20f7c24448860d680b91e30ab5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.464670 26038 tablet_replica.cc:333] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.465505 26038 raft_consensus.cc:2243] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.466401 26038 raft_consensus.cc:2272] T 652ad18b41cd4991881cb7beaaa59f8c P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.465819 27049 catalog_manager.cc:5697] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d reported cstate change: config changed from index 6 to 12, VOTER 1010256288ec4502b330749e2e3d7c85 (127.25.109.129) evicted. New cstate: current_term: 14 leader_uuid: "897d8be8580141d1ad3bb17946d3da89" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } } }
I20260709 13:13:20.469099 26038 tablet_replica.cc:333] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.469923 26038 raft_consensus.cc:2243] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.470582 26038 raft_consensus.cc:2272] T 36d9f53e5fed4e948f0828f157789667 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.473381 26038 tablet_replica.cc:333] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.474225 26038 raft_consensus.cc:2243] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:13:20.487782 27804 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.494445 27807 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.497349 26038 raft_consensus.cc:2272] T dd2ae66505104867808d4a844f249f6b P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.500716 27272 consensus_peers.cc:597] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.502609 27272 consensus_peers.cc:597] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.503069 27804 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.505987 27272 consensus_peers.cc:597] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.512818 27807 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.522655 27269 consensus_peers.cc:597] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:20.518561 27272 consensus_peers.cc:597] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.515164 27807 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.526964 26038 tablet_replica.cc:333] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.527830 26038 raft_consensus.cc:2243] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.529381 27041 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e466225c5a147b9b31f11fea1bcf893 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 13:13:20.532182 27807 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.530562 26038 raft_consensus.cc:2272] T 38b3919a88c74cac9b41f07419fbb92d P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.534957 27804 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:20.537500 26038 tablet_replica.cc:333] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.538735 26038 raft_consensus.cc:2243] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.539790 26038 raft_consensus.cc:2272] T 6576306f90684fa797dc0cafcc53fcdb P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.541878 27269 consensus_peers.cc:597] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:20.544925 26038 tablet_replica.cc:333] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.545570 26038 raft_consensus.cc:2243] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.546625 26038 raft_consensus.cc:2272] T 2b36513461a9483c98c7adda698d5dad P 9bc1278c649846e998b312b374274d08 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.549278 26038 tablet_replica.cc:333] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.550105 26038 raft_consensus.cc:2243] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.550685 26038 raft_consensus.cc:2272] T 1f6d2e3ad5974f3986941a49bb1339d7 P 9bc1278c649846e998b312b374274d08 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.553591 27807 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.554165 26038 tablet_replica.cc:333] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.555063 26038 raft_consensus.cc:2243] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.555778 26038 raft_consensus.cc:2272] T c02ecf580b8f4657acdf790942e85fd5 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.558609 26038 tablet_replica.cc:333] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.559876 26038 raft_consensus.cc:2243] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.560607 26038 raft_consensus.cc:2272] T dd61db1ee95e4b8baf0a3057db7c4d2a P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.564875 26038 tablet_replica.cc:333] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.569471 26038 raft_consensus.cc:2243] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.570102 26038 raft_consensus.cc:2272] T 580a99e39c90417485c3e3481d14bbdc P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.572700 26038 tablet_replica.cc:333] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08: stopping tablet replica
W20260709 13:13:20.572613 27807 consensus_peers.cc:597] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.573442 27807 consensus_peers.cc:597] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.574400 26038 raft_consensus.cc:2243] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.575117 26038 raft_consensus.cc:2272] T 36bb684ea1124ce1a76a958bd405aa9b P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.578284 26038 tablet_replica.cc:333] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.578965 26038 raft_consensus.cc:2243] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.579989 26038 raft_consensus.cc:2272] T e2433340983a46c0b79d3ff64b3694b6 P 9bc1278c649846e998b312b374274d08 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.582535 26038 tablet_replica.cc:333] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.583289 26038 raft_consensus.cc:2243] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.584401 26038 raft_consensus.cc:2272] T 4eef03c4dd654384acbb187b85475c25 P 9bc1278c649846e998b312b374274d08 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.587069 26038 tablet_replica.cc:333] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.587786 26038 raft_consensus.cc:2243] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.588445 26038 raft_consensus.cc:2272] T 031d182ea10543e59e77e0a87f18c0be P 9bc1278c649846e998b312b374274d08 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.591058 26038 tablet_replica.cc:333] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.591995 26038 raft_consensus.cc:2243] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.592556 26038 raft_consensus.cc:2272] T 6e9a8d686c4b4ec199d64c6d3882b858 P 9bc1278c649846e998b312b374274d08 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.595351 26038 tablet_replica.cc:333] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08: stopping tablet replica
I20260709 13:13:20.596011 26038 raft_consensus.cc:2243] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.596562 26038 raft_consensus.cc:2272] T d425a845db244636a6b92ed85545087c P 9bc1278c649846e998b312b374274d08 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.614464 27272 consensus_peers.cc:597] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.651906 27039 catalog_manager.cc:4755] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e466225c5a147b9b31f11fea1bcf893: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:20.697029 27807 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.704574 27807 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.715617 27807 connection.cc:769] client connection to 127.25.109.130:33347 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:13:20.910175 27269 consensus_peers.cc:597] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.065575 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.076224 27804 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.232600 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.270993 27269 consensus_peers.cc:597] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:21.312242 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
W20260709 13:13:21.391812 27804 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:13:21.394414 27804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38249, user_credentials={real_user=slave}} blocked reactor thread for 161350us
I20260709 13:13:21.422843  1551 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.423475  1551 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.425897  1551 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:21.435451 27269 consensus_peers.cc:597] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:21.436700  1540 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.437268  1540 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.439865  1540 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
W20260709 13:13:21.446022 27807 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:21.450040 27272 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.453521 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
W20260709 13:13:21.458113 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.483765 27804 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.484211 27804 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
W20260709 13:13:21.485309 27804 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:13:21.485307  1557 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:21.485944 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.486704 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:21.489180  1551 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.489918  1551 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:21.490350 27804 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:21.492699 27839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ad18b41cd4991881cb7beaaa59f8c" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:21.494872 27271 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
I20260709 13:13:21.494918  1551 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:21.496408  1543 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:21.501034 27804 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:21.502475 27806 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.503631 27806 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.505148 27807 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:21.506117 27806 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:21.506376 27806 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.507052  1551 raft_consensus.cc:2749] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:21.521251 27806 consensus_peers.cc:597] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.534449 27806 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.541625 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:21.541836  1540 raft_consensus.cc:493] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.542817 26038 tablet_replica.cc:333] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.542456  1540 raft_consensus.cc:515] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:21.543742 26038 raft_consensus.cc:2243] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.544817  1540 leader_election.cc:290] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.544881 26038 raft_consensus.cc:2272] T aa050ea82d9b4a729f786c4fd23f4904 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.547811  1540 raft_consensus.cc:493] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.548277  1540 raft_consensus.cc:515] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:21.548888 26038 tablet_replica.cc:333] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.549782 26038 raft_consensus.cc:2243] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.550369 26038 raft_consensus.cc:2272] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.550930 27269 leader_election.cc:336] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:21.551954 27272 leader_election.cc:336] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.552387 27272 leader_election.cc:304] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.552851  1540 leader_election.cc:290] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.553110  1543 raft_consensus.cc:2749] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:21.555871 26038 tablet_replica.cc:333] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.556715 26038 raft_consensus.cc:2243] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.557430 26038 raft_consensus.cc:2272] T 897bd586cdb44a899e3c85e77da927c3 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.558791 27272 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.560075 26038 tablet_replica.cc:333] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.560037  1545 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.560695  1545 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.561098 26038 raft_consensus.cc:2243] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:13:21.562282 27806 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.562341 26038 raft_consensus.cc:2272] T 9936add6bb224d4bbd8bcd5a38781ae5 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.562829  1545 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:21.564301 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a8841c8bb041a1a423a427ed084489" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:21.565909 26038 tablet_replica.cc:333] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
W20260709 13:13:21.566393 27272 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.566785 26038 raft_consensus.cc:2243] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.566802 27272 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 9bc1278c649846e998b312b374274d08, f4afe81810944d70bc2cc31754392f3d
W20260709 13:13:21.567301 27269 leader_election.cc:336] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.567715  1545 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:21.567757 27269 leader_election.cc:304] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.568122 26038 raft_consensus.cc:2272] T f5d526be8aec49c8863369b60c8e884c P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.568512 27269 raft_consensus.cc:2686] T b3cb013cb450432ba238b716d88554e4 P 897d8be8580141d1ad3bb17946d3da89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:13:21.570371 26038 tablet_replica.cc:333] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.570891 26038 raft_consensus.cc:2243] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.571336 26038 raft_consensus.cc:2272] T fe318d32db494aafa007d9cb3d4cf02a P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.573097 26038 tablet_replica.cc:333] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.573586 26038 raft_consensus.cc:2243] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.573961 26038 raft_consensus.cc:2272] T 54a3803047aa4a85bd0d761bdb45cead P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.575744 26038 tablet_replica.cc:333] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.576225 26038 raft_consensus.cc:2243] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.576963 26038 raft_consensus.cc:2272] T 8ba2f184437940dbb94ed0532f27e854 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.578691 26038 tablet_replica.cc:333] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.579164 26038 raft_consensus.cc:2243] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.579681 26038 raft_consensus.cc:2272] T c8f560534ffa48878a9e4d4766199287 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.581470 26038 tablet_replica.cc:333] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.582192 26038 raft_consensus.cc:2243] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.582738 26038 raft_consensus.cc:2272] T 36d2fcee6798446ca0ae9140145ba175 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.584415 27806 consensus_peers.cc:597] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.585176 26038 tablet_replica.cc:333] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.586021 26038 raft_consensus.cc:2243] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.586711 26038 raft_consensus.cc:2272] T 006b4229b8b346a4b6e1de5910f7b5a4 P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.587647  1551 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.588171  1551 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.589285 26038 tablet_replica.cc:333] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.590101 26038 raft_consensus.cc:2243] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.590308  1551 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:21.590662 26038 raft_consensus.cc:2272] T 93b895e250184ee283d78483d5fcae92 P 897d8be8580141d1ad3bb17946d3da89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.593053 26038 tablet_replica.cc:333] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
W20260709 13:13:21.593493 27807 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.593705 26038 raft_consensus.cc:2243] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:21.594013 27806 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:21.594540 27806 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.594727 26038 raft_consensus.cc:2272] T 23b189bbd0aa4c6787e99f8cc041dd48 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.595266  1551 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:21.596928 26038 tablet_replica.cc:333] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.597589 26038 raft_consensus.cc:2243] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.598474 26038 raft_consensus.cc:2272] T 580a99e39c90417485c3e3481d14bbdc P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.600173 26038 tablet_replica.cc:333] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.600709 26038 raft_consensus.cc:2243] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.601146 26038 raft_consensus.cc:2272] T c956eb948d264e3fa713d592c530d94e P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.603060 26038 tablet_replica.cc:333] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.603582 26038 raft_consensus.cc:2243] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.604442 26038 raft_consensus.cc:2272] T a41c5fdb574f47168ed45c1838cbd31d P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.606146 26038 tablet_replica.cc:333] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.606679 26038 raft_consensus.cc:2243] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.607446 26038 raft_consensus.cc:2272] T b91cb18a432b4fefa2c9d4eff143e3d7 P 897d8be8580141d1ad3bb17946d3da89 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.609165 26038 tablet_replica.cc:333] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.609701 26038 raft_consensus.cc:2243] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.610198 26038 raft_consensus.cc:2272] T 06445e3c1bb74c8f862cf1af47256377 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.611832 26038 tablet_replica.cc:333] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.612471 26038 raft_consensus.cc:2243] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.612821 26038 raft_consensus.cc:2272] T be324c341d044aa892e39ebca665c6c6 P 897d8be8580141d1ad3bb17946d3da89 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.613418  1545 raft_consensus.cc:493] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.613955  1545 raft_consensus.cc:515] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:21.614784 26038 tablet_replica.cc:333] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.615437 26038 raft_consensus.cc:2243] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.615875  1545 leader_election.cc:290] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.616463 26038 raft_consensus.cc:2272] T b62a963093f641fa81d5d816797099e1 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.618973 26038 tablet_replica.cc:333] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.619571 26038 raft_consensus.cc:2243] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:21.619604 27269 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.620152 26038 raft_consensus.cc:2272] T bd31e5d20c484a9facfe437706e9bd6b P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.620134 27272 leader_election.cc:336] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.620735 27272 leader_election.cc:304] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.621381  1545 raft_consensus.cc:2749] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:21.622691 26038 tablet_replica.cc:333] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.623299 26038 raft_consensus.cc:2243] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.623703 26038 raft_consensus.cc:2272] T 1e37f81c47354aae99c01542f682acef P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.625360 26038 tablet_replica.cc:333] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.625803 26038 raft_consensus.cc:2243] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.626283 26038 raft_consensus.cc:2272] T ae22f698260e475b89b90dcbd28bda00 P 897d8be8580141d1ad3bb17946d3da89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.627867 26038 tablet_replica.cc:333] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.628461 26038 raft_consensus.cc:2243] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.629197 26038 raft_consensus.cc:2272] T d87c41315a07486aa13067ad7c47c34a P 897d8be8580141d1ad3bb17946d3da89 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.629567  1545 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.630038  1545 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.631424 26038 tablet_replica.cc:333] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.631908  1545 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:21.632229 26038 raft_consensus.cc:2243] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.632977 26038 raft_consensus.cc:2272] T 1b636aab71bc4cad87e3a5d644042885 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.633105 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d" is_pre_election: true
I20260709 13:13:21.633773 27835 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 18.
I20260709 13:13:21.634702 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 
I20260709 13:13:21.635334 26038 tablet_replica.cc:333] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
W20260709 13:13:21.635645 27272 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.635768  1545 raft_consensus.cc:2804] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:21.636111 26038 raft_consensus.cc:2243] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.636237  1545 raft_consensus.cc:493] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.636714  1545 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:21.636786 26038 raft_consensus.cc:2272] T e2433340983a46c0b79d3ff64b3694b6 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.638792 26038 tablet_replica.cc:333] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.639266  1543 raft_consensus.cc:493] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.639430 26038 raft_consensus.cc:2243] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.639999 26038 raft_consensus.cc:2272] T 4eef03c4dd654384acbb187b85475c25 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.639806  1543 raft_consensus.cc:515] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } }
I20260709 13:13:21.641987  1543 leader_election.cc:290] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.642117 26038 tablet_replica.cc:333] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.644548  1545 raft_consensus.cc:515] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.645543 26038 raft_consensus.cc:2243] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:21.645468 27269 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.646606  1545 leader_election.cc:290] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Requested vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), f4afe81810944d70bc2cc31754392f3d (127.25.109.132:42741)
I20260709 13:13:21.647749 27835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af55c80b2afb4d89beeb86311b788bca" candidate_uuid: "897d8be8580141d1ad3bb17946d3da89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4afe81810944d70bc2cc31754392f3d"
I20260709 13:13:21.648233 27835 raft_consensus.cc:3060] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:21.648241 26038 raft_consensus.cc:2272] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.650381 27272 leader_election.cc:336] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.650772 27272 leader_election.cc:304] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.651043 26038 tablet_replica.cc:333] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.651795 26038 raft_consensus.cc:2243] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:21.652208 27806 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.652468 26038 raft_consensus.cc:2272] T 695ceba1143c428490ae6aad424a66ea P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.654177 27272 leader_election.cc:336] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.654600 27835 raft_consensus.cc:2468] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 897d8be8580141d1ad3bb17946d3da89 in term 19.
I20260709 13:13:21.655087 26038 tablet_replica.cc:333] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.655594 27271 leader_election.cc:304] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 897d8be8580141d1ad3bb17946d3da89, f4afe81810944d70bc2cc31754392f3d; no voters: 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.655846 26038 raft_consensus.cc:2243] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:21.656222 27271 raft_consensus.cc:2686] T af55c80b2afb4d89beeb86311b788bca P 897d8be8580141d1ad3bb17946d3da89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:13:21.656435 26038 raft_consensus.cc:2272] T d6a8841c8bb041a1a423a427ed084489 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.658336 26038 tablet_replica.cc:333] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.658805 26038 raft_consensus.cc:2243] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.659564 26038 raft_consensus.cc:2272] T c2d8b32b61494130ab83c26fc2d310e6 P 897d8be8580141d1ad3bb17946d3da89 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.661293 26038 tablet_replica.cc:333] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.661753 26038 raft_consensus.cc:2243] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.662190 26038 raft_consensus.cc:2272] T 38b3919a88c74cac9b41f07419fbb92d P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.663771 26038 tablet_replica.cc:333] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.664201 26038 raft_consensus.cc:2243] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.664775 26038 raft_consensus.cc:2272] T 6576306f90684fa797dc0cafcc53fcdb P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.667093 26038 tablet_replica.cc:333] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.667796 26038 raft_consensus.cc:2243] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.668314 26038 raft_consensus.cc:2272] T 2bd98a20f7c24448860d680b91e30ab5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.670346 26038 tablet_replica.cc:333] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.670841 26038 raft_consensus.cc:2243] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.671281 26038 raft_consensus.cc:2272] T 652ad18b41cd4991881cb7beaaa59f8c P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.673036 26038 tablet_replica.cc:333] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.673705 26038 raft_consensus.cc:2243] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.674311 26038 raft_consensus.cc:2272] T dd2ae66505104867808d4a844f249f6b P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.676079 26038 tablet_replica.cc:333] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.676564 26038 raft_consensus.cc:2243] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.677309 26038 raft_consensus.cc:2272] T 1f6d2e3ad5974f3986941a49bb1339d7 P 897d8be8580141d1ad3bb17946d3da89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.679014 26038 tablet_replica.cc:333] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.679502 26038 raft_consensus.cc:2243] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.679920 26038 raft_consensus.cc:2272] T c02ecf580b8f4657acdf790942e85fd5 P 897d8be8580141d1ad3bb17946d3da89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.681819 26038 tablet_replica.cc:333] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.682482 26038 raft_consensus.cc:2243] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.683157 26038 raft_consensus.cc:2272] T 51fed810b66a4d09868add1d38749c15 P 897d8be8580141d1ad3bb17946d3da89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.685577 26038 tablet_replica.cc:333] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.686252 26038 raft_consensus.cc:2243] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.686751  1557 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.687294 26038 raft_consensus.cc:2272] T d425a845db244636a6b92ed85545087c P 897d8be8580141d1ad3bb17946d3da89 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.687292  1557 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.689931 26038 tablet_replica.cc:333] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.690497  1557 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.690660 26038 raft_consensus.cc:2243] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.691934 26038 raft_consensus.cc:2272] T 031d182ea10543e59e77e0a87f18c0be P 897d8be8580141d1ad3bb17946d3da89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.694684 26038 tablet_replica.cc:333] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
W20260709 13:13:21.695227 27039 catalog_manager.cc:4755] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e466225c5a147b9b31f11fea1bcf893: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.695372 26038 raft_consensus.cc:2243] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.696470 26038 raft_consensus.cc:2272] T 1a6d314618684d688b91fe535777e47b P 897d8be8580141d1ad3bb17946d3da89 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.698403 27806 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.699129 26038 tablet_replica.cc:333] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.699795 26038 raft_consensus.cc:2243] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:13:21.700584 27807 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.700645 26038 raft_consensus.cc:2272] T 9e466225c5a147b9b31f11fea1bcf893 P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.701192 27804 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.701645 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.702839  1557 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:21.703533 26038 tablet_replica.cc:333] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89: stopping tablet replica
I20260709 13:13:21.704185 26038 raft_consensus.cc:2243] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.705170 26038 raft_consensus.cc:2272] T 36bb684ea1124ce1a76a958bd405aa9b P 897d8be8580141d1ad3bb17946d3da89 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.707729 27806 consensus_peers.cc:597] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.712613  1551 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.713055  1551 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.715139  1551 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.717867  1557 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:13:21.719381 27804 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:21.719340  1557 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:21.721320 27807 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.721599  1557 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:21.721685 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.722568  1557 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:21.726363 27804 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:21.726888 27807 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.727270 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.727963  1557 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:21.772004  1557 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.772567  1557 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:21.773641 27804 consensus_peers.cc:597] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:21.775741  1557 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:21.776196 27269 connection.cc:466] server connection from 127.0.0.1:40558 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40558 (request call id 1851) could send its response
W20260709 13:13:21.779573 27807 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:21.782111 27806 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:21.782541 27806 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.783315  1557 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:21.790565 27806 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.803442 27806 consensus_peers.cc:597] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.821857  1557 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.822427  1557 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.824086  1557 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:21.827273 27804 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:21.827739 27807 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:21.828083 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.828634  1557 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:21.833913 27806 consensus_peers.cc:597] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.878585 27806 consensus_peers.cc:597] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.880790 27806 consensus_peers.cc:597] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.988658  1557 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:21.989189  1557 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:21.991163  1557 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:21.994168 27807 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:21.994560 27806 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:21.994978 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:21.995527  1557 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:22.005174  1557 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:22.005686  1557 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.007419  1557 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:22.011041 27804 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:22.011480 27807 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:22.011802 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:22.012341  1557 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:22.305013 27327 debug-util.cc:398] Leaking SignalData structure 0x7b080034d0e0 after lost signal to thread 26041
W20260709 13:13:22.306186 27327 debug-util.cc:398] Leaking SignalData structure 0x7b08000bec80 after lost signal to thread 27089
W20260709 13:13:22.307556 27327 debug-util.cc:398] Leaking SignalData structure 0x7b08000be980 after lost signal to thread 27330
W20260709 13:13:22.308755 27327 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1dc0 after lost signal to thread 27865
W20260709 13:13:22.432610 27804 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.560523 27807 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.626681 27807 consensus_peers.cc:597] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:22.739428  1557 raft_consensus.cc:493] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.739924  1557 raft_consensus.cc:515] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.741529  1557 leader_election.cc:290] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.745172 27806 leader_election.cc:336] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:22.745637 27807 leader_election.cc:336] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:22.746126 27807 leader_election.cc:304] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:22.746922  1557 raft_consensus.cc:2749] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:22.747594  1557 raft_consensus.cc:493] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.747995  1557 raft_consensus.cc:515] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.749651  1557 leader_election.cc:290] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.753036 27804 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:22.753587 27806 leader_election.cc:336] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.753994 27806 leader_election.cc:304] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.754709  1557 raft_consensus.cc:2749] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:22.766258  1557 raft_consensus.cc:493] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.766734  1557 raft_consensus.cc:515] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.768509  1557 leader_election.cc:290] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.771822 27807 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:22.772605 27806 leader_election.cc:336] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.772953 27806 leader_election.cc:304] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:22.773834  1562 raft_consensus.cc:2749] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:22.777326 27804 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:22.787848  1557 raft_consensus.cc:493] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.788324  1557 raft_consensus.cc:515] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.789762  1551 raft_consensus.cc:493] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.790343  1557 leader_election.cc:290] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:22.790410  1551 raft_consensus.cc:515] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.792614  1551 leader_election.cc:290] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.794183 27804 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:22.795579 26038 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27327)
W20260709 13:13:22.797485 27806 leader_election.cc:336] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.797951 27806 leader_election.cc:304] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.798651  1551 raft_consensus.cc:2749] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:13:22.799659 27806 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:22.800704 27804 leader_election.cc:336] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:22.801236 27807 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:22.801136 27804 leader_election.cc:304] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.801947  1551 raft_consensus.cc:2749] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:22.817366 27807 consensus_peers.cc:597] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.817857 27807 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.857084 27807 consensus_peers.cc:597] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.894028 27804 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:22.908169  1551 raft_consensus.cc:493] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.908718  1551 raft_consensus.cc:515] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.909436  1557 raft_consensus.cc:493] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.909960  1557 raft_consensus.cc:515] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.910772  1551 leader_election.cc:290] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:22.911993  1557 leader_election.cc:290] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.915349 27807 consensus_peers.cc:597] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:22.917073  1557 raft_consensus.cc:493] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.917546  1557 raft_consensus.cc:515] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:22.917909 27806 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:22.918527 27806 leader_election.cc:336] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.918704  1551 raft_consensus.cc:493] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
W20260709 13:13:22.919310 27804 leader_election.cc:336] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:22.919507  1557 leader_election.cc:290] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:22.919241  1551 raft_consensus.cc:515] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.919956 27804 leader_election.cc:304] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.920665  1557 raft_consensus.cc:2749] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:22.920827 27804 leader_election.cc:336] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:22.921350 27804 leader_election.cc:304] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.921991  1557 raft_consensus.cc:2749] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:22.921380  1551 leader_election.cc:290] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:22.923518  1551 raft_consensus.cc:493] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.923980  1551 raft_consensus.cc:515] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:22.925500 27806 leader_election.cc:336] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:22.925630 27804 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:22.926087 27806 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.927114  1551 leader_election.cc:290] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:22.930226 27804 leader_election.cc:336] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:22.930723 27804 leader_election.cc:304] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:22.931388  1557 raft_consensus.cc:2749] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:22.932238 27804 leader_election.cc:336] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:22.932662 27804 leader_election.cc:304] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
W20260709 13:13:22.932963 27806 leader_election.cc:336] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:22.933326  1557 raft_consensus.cc:2749] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:13:22.934831 27807 leader_election.cc:336] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:22.935283 27807 leader_election.cc:304] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:22.935940  1557 raft_consensus.cc:2749] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:22.937682 27807 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.980217 27807 consensus_peers.cc:597] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:22.994457  1551 raft_consensus.cc:493] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.994829  1557 raft_consensus.cc:493] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 897d8be8580141d1ad3bb17946d3da89)
I20260709 13:13:22.995060  1551 raft_consensus.cc:515] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.995383  1557 raft_consensus.cc:515] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:22.997236  1557 leader_election.cc:290] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
I20260709 13:13:22.999044  1551 leader_election.cc:290] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:23.001843 27804 leader_election.cc:336] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:23.002465 27806 leader_election.cc:336] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:23.002952 27806 leader_election.cc:304] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 897d8be8580141d1ad3bb17946d3da89
I20260709 13:13:23.003767  1551 raft_consensus.cc:2749] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:23.003832 27806 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:23.004930 27807 leader_election.cc:336] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.005411 27807 leader_election.cc:304] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.005960  1551 raft_consensus.cc:2749] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:23.066520 27807 consensus_peers.cc:597] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.104737 27807 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.111331 27807 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.173481 27807 consensus_peers.cc:597] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.189615 27807 consensus_peers.cc:597] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.237488 27807 consensus_peers.cc:597] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.255611 27804 consensus_peers.cc:597] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.299826 27039 catalog_manager.cc:4755] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e466225c5a147b9b31f11fea1bcf893: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:23.305192  1557 raft_consensus.cc:493] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.305761  1557 raft_consensus.cc:515] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.307930  1557 leader_election.cc:290] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:23.312762 27806 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:23.313422 27807 leader_election.cc:336] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.313868 27807 leader_election.cc:304] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.314613  1557 raft_consensus.cc:2749] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.340349  1557 raft_consensus.cc:493] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.340906  1557 raft_consensus.cc:515] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.343135  1557 leader_election.cc:290] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:23.346902 27804 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:23.347548 27807 leader_election.cc:336] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.347863 27807 leader_election.cc:304] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.348414  1557 raft_consensus.cc:2749] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:23.427342 27807 consensus_peers.cc:597] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d -> Peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Couldn't send request to peer 9bc1278c649846e998b312b374274d08. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:23.523119  1557 raft_consensus.cc:493] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.523692  1557 raft_consensus.cc:515] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.525730  1557 leader_election.cc:290] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:23.529392 27807 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:23.529999 27806 leader_election.cc:336] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
I20260709 13:13:23.530437 27806 leader_election.cc:304] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.531018  1557 raft_consensus.cc:2749] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.551235  1557 raft_consensus.cc:493] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.551831  1557 raft_consensus.cc:515] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "897d8be8580141d1ad3bb17946d3da89" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 37965 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.553936  1557 leader_election.cc:290] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347), 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965)
W20260709 13:13:23.560740 27806 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111)
W20260709 13:13:23.561604 27807 leader_election.cc:336] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.562079 27807 leader_election.cc:304] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 897d8be8580141d1ad3bb17946d3da89, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.562887  1557 raft_consensus.cc:2749] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:23.630508 27804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111) [suppressed 555 similar messages]
I20260709 13:13:23.632843  1557 raft_consensus.cc:493] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.634971  1557 raft_consensus.cc:515] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:23.634469 27804 consensus_peers.cc:597] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:23.640791  1557 leader_election.cc:290] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:23.643342 27804 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:23.645331 27807 leader_election.cc:336] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.647316 27807 leader_election.cc:304] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.648018  1557 raft_consensus.cc:2749] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:23.659484 27804 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.661593 27804 consensus_peers.cc:597] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:13:23.733039  1557 raft_consensus.cc:493] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.733567  1557 raft_consensus.cc:515] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.735426  1557 leader_election.cc:290] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:23.739580  1557 raft_consensus.cc:493] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
W20260709 13:13:23.739852 27804 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:23.740072  1557 raft_consensus.cc:515] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
W20260709 13:13:23.740764 27807 leader_election.cc:336] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.741328 27807 leader_election.cc:304] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.742030  1551 raft_consensus.cc:2749] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.742143  1557 leader_election.cc:290] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:23.746196 27804 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:23.746869 27807 leader_election.cc:336] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.747311 27807 leader_election.cc:304] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.748046  1551 raft_consensus.cc:2749] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:23.795627 27804 consensus_peers.cc:597] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.814221 27804 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:23.836167  1551 raft_consensus.cc:493] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.836779  1551 raft_consensus.cc:515] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.838912  1551 leader_election.cc:290] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
W20260709 13:13:23.843119 27807 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
W20260709 13:13:23.843592 27804 leader_election.cc:336] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:23.843986 27804 leader_election.cc:304] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.844630  1551 raft_consensus.cc:2749] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.858261  1551 raft_consensus.cc:493] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9bc1278c649846e998b312b374274d08)
I20260709 13:13:23.858855  1551 raft_consensus.cc:515] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1010256288ec4502b330749e2e3d7c85" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38249 } } peers { permanent_uuid: "9bc1278c649846e998b312b374274d08" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 33347 } } peers { permanent_uuid: "f4afe81810944d70bc2cc31754392f3d" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 42741 } attrs { promote: false } }
I20260709 13:13:23.861135  1551 leader_election.cc:290] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249), 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347)
I20260709 13:13:23.861682 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
W20260709 13:13:23.862630 27804 consensus_peers.cc:597] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:23.864598 27804 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
W20260709 13:13:23.865974 27807 leader_election.cc:336] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9bc1278c649846e998b312b374274d08 (127.25.109.130:33347): Network error: Client connection negotiation failed: client connection to 127.25.109.130:33347: connect: Connection refused (error 111)
I20260709 13:13:23.866382 27807 leader_election.cc:304] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4afe81810944d70bc2cc31754392f3d; no voters: 1010256288ec4502b330749e2e3d7c85, 9bc1278c649846e998b312b374274d08
I20260709 13:13:23.867084  1551 raft_consensus.cc:2749] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:23.873785 27804 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.878835 27804 consensus_peers.cc:597] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d -> Peer 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): Couldn't send request to peer 1010256288ec4502b330749e2e3d7c85. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:23.881541 27806 consensus_peers.cc:597] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.938201 27806 consensus_peers.cc:597] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.947906 27806 consensus_peers.cc:597] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:23.957444 26038 tablet_server.cc:179] TabletServer@127.25.109.132:0 shutting down...
I20260709 13:13:23.991897 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:23.992589 26038 tablet_replica.cc:333] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:23.993273 26038 raft_consensus.cc:2243] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.994184 26038 raft_consensus.cc:2272] T c8f560534ffa48878a9e4d4766199287 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.996627 26038 tablet_replica.cc:333] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:23.997205 26038 raft_consensus.cc:2243] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.997782 26038 raft_consensus.cc:2272] T 9e466225c5a147b9b31f11fea1bcf893 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.999699 26038 tablet_replica.cc:333] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.000272 26038 raft_consensus.cc:2243] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.001277 26038 raft_consensus.cc:2272] T 1e37f81c47354aae99c01542f682acef P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.003103 26038 tablet_replica.cc:333] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.003616 26038 raft_consensus.cc:2243] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.004403 26038 raft_consensus.cc:2272] T 1366d63dcc6742608d7574eb132c123a P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.006228 26038 tablet_replica.cc:333] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.006740 26038 raft_consensus.cc:2243] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.007488 26038 raft_consensus.cc:2272] T d64b1a67a0cc42479c0519e68bc68492 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.009254 26038 tablet_replica.cc:333] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.009770 26038 raft_consensus.cc:2243] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.010669 26038 raft_consensus.cc:2272] T fe318d32db494aafa007d9cb3d4cf02a P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.013139 26038 tablet_replica.cc:333] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.013944 26038 raft_consensus.cc:2243] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.014871 26038 raft_consensus.cc:2272] T c02ecf580b8f4657acdf790942e85fd5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.016294 27806 consensus_peers.cc:597] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:24.017062 26038 tablet_replica.cc:333] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.017623 26038 raft_consensus.cc:2243] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.018039 26038 raft_consensus.cc:2272] T 9f9dfa4361254d838c2b61576ada60f4 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.020718 26038 tablet_replica.cc:333] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.021458 26038 raft_consensus.cc:2243] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:24.022454 27806 consensus_peers.cc:597] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d -> Peer 897d8be8580141d1ad3bb17946d3da89 (127.25.109.131:37965): Couldn't send request to peer 897d8be8580141d1ad3bb17946d3da89. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:37965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:24.022492 26038 raft_consensus.cc:2272] T 1a6d314618684d688b91fe535777e47b P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.024690 26038 tablet_replica.cc:333] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.025276 26038 raft_consensus.cc:2243] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.025723 26038 raft_consensus.cc:2272] T 2b36513461a9483c98c7adda698d5dad P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.027508 26038 tablet_replica.cc:333] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.028028 26038 raft_consensus.cc:2243] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.028575 26038 raft_consensus.cc:2272] T f5d526be8aec49c8863369b60c8e884c P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.030320 26038 tablet_replica.cc:333] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.030833 26038 raft_consensus.cc:2243] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.031373 26038 raft_consensus.cc:2272] T d87c41315a07486aa13067ad7c47c34a P f4afe81810944d70bc2cc31754392f3d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.033159 26038 tablet_replica.cc:333] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.033655 26038 raft_consensus.cc:2243] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.034030 26038 raft_consensus.cc:2272] T fcf276ae949142ce87f50371f8505b9d P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.035946 26038 tablet_replica.cc:333] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.036460 26038 raft_consensus.cc:2243] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.037151 26038 raft_consensus.cc:2272] T bd31e5d20c484a9facfe437706e9bd6b P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.038947 26038 tablet_replica.cc:333] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.039495 26038 raft_consensus.cc:2243] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.040213 26038 raft_consensus.cc:2272] T 51fed810b66a4d09868add1d38749c15 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.042289 26038 tablet_replica.cc:333] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.042946 26038 raft_consensus.cc:2243] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.043640 26038 raft_consensus.cc:2272] T 06445e3c1bb74c8f862cf1af47256377 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.045786 26038 tablet_replica.cc:333] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.046269 26038 raft_consensus.cc:2243] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.047061 26038 raft_consensus.cc:2272] T 2bd98a20f7c24448860d680b91e30ab5 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.048781 26038 tablet_replica.cc:333] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.049327 26038 raft_consensus.cc:2243] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.049768 26038 raft_consensus.cc:2272] T e2433340983a46c0b79d3ff64b3694b6 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.051462 26038 tablet_replica.cc:333] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.051968 26038 raft_consensus.cc:2243] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.052824 26038 raft_consensus.cc:2272] T d6c3d4b3cf374582b470348b1f7dc027 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.054656 26038 tablet_replica.cc:333] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.055158 26038 raft_consensus.cc:2243] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.056113 26038 raft_consensus.cc:2272] T 23b189bbd0aa4c6787e99f8cc041dd48 P f4afe81810944d70bc2cc31754392f3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.058410 26038 tablet_replica.cc:333] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.058858 26038 raft_consensus.cc:2243] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.059571 26038 raft_consensus.cc:2272] T 36d9f53e5fed4e948f0828f157789667 P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.061411 26038 tablet_replica.cc:333] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.061893 26038 raft_consensus.cc:2243] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.062469 26038 raft_consensus.cc:2272] T 652ad18b41cd4991881cb7beaaa59f8c P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.064170 26038 tablet_replica.cc:333] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.064625 26038 raft_consensus.cc:2243] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.065274 26038 raft_consensus.cc:2272] T 6e9a8d686c4b4ec199d64c6d3882b858 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.067111 26038 tablet_replica.cc:333] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.067579 26038 raft_consensus.cc:2243] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.068001 26038 raft_consensus.cc:2272] T 432318984ae54d3b86d6f16faa526523 P f4afe81810944d70bc2cc31754392f3d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.069694 26038 tablet_replica.cc:333] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.070231 26038 raft_consensus.cc:2243] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.070582 26038 raft_consensus.cc:2272] T 44c0f63822c7471ebdec8a5f3dfa21a9 P f4afe81810944d70bc2cc31754392f3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.072376 26038 tablet_replica.cc:333] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.073024 26038 raft_consensus.cc:2243] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.073505 26038 raft_consensus.cc:2272] T b62a963093f641fa81d5d816797099e1 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.075598 26038 tablet_replica.cc:333] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.076108 26038 raft_consensus.cc:2243] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.076520 26038 raft_consensus.cc:2272] T dd514c8b688c4f2e90b6ad46174723ef P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.078169 26038 tablet_replica.cc:333] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.078665 26038 raft_consensus.cc:2243] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.079092 26038 raft_consensus.cc:2272] T af55c80b2afb4d89beeb86311b788bca P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.080806 26038 tablet_replica.cc:333] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.081272 26038 raft_consensus.cc:2243] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.082067 26038 raft_consensus.cc:2272] T 86bf2019fd7b421393e482331c89a37d P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.083694 26038 tablet_replica.cc:333] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.084173 26038 raft_consensus.cc:2243] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.084865 26038 raft_consensus.cc:2272] T 897bd586cdb44a899e3c85e77da927c3 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.086652 26038 tablet_replica.cc:333] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.087146 26038 raft_consensus.cc:2243] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.087549 26038 raft_consensus.cc:2272] T a41c5fdb574f47168ed45c1838cbd31d P f4afe81810944d70bc2cc31754392f3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.089291 26038 tablet_replica.cc:333] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.089825 26038 raft_consensus.cc:2243] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.090291 26038 raft_consensus.cc:2272] T d6a8841c8bb041a1a423a427ed084489 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.092002 26038 tablet_replica.cc:333] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.092489 26038 raft_consensus.cc:2243] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.092939 26038 raft_consensus.cc:2272] T c2d8b32b61494130ab83c26fc2d310e6 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.094650 26038 tablet_replica.cc:333] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.095134 26038 raft_consensus.cc:2243] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.095877 26038 raft_consensus.cc:2272] T 08a6377ffbb949a09216851d176dbcfc P f4afe81810944d70bc2cc31754392f3d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.097549 26038 tablet_replica.cc:333] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.098019 26038 raft_consensus.cc:2243] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.098721 26038 raft_consensus.cc:2272] T 006b4229b8b346a4b6e1de5910f7b5a4 P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.100484 26038 tablet_replica.cc:333] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.100956 26038 raft_consensus.cc:2243] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.101398 26038 raft_consensus.cc:2272] T 9936add6bb224d4bbd8bcd5a38781ae5 P f4afe81810944d70bc2cc31754392f3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.103039 26038 tablet_replica.cc:333] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.103530 26038 raft_consensus.cc:2243] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.104552 26038 raft_consensus.cc:2272] T dd61db1ee95e4b8baf0a3057db7c4d2a P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.106374 26038 tablet_replica.cc:333] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.106933 26038 raft_consensus.cc:2243] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.107719 26038 raft_consensus.cc:2272] T 93b895e250184ee283d78483d5fcae92 P f4afe81810944d70bc2cc31754392f3d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.109481 26038 tablet_replica.cc:333] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.109939 26038 raft_consensus.cc:2243] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.110371 26038 raft_consensus.cc:2272] T b91cb18a432b4fefa2c9d4eff143e3d7 P f4afe81810944d70bc2cc31754392f3d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.112124 26038 tablet_replica.cc:333] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.112581 26038 raft_consensus.cc:2243] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.113072 26038 raft_consensus.cc:2272] T aa050ea82d9b4a729f786c4fd23f4904 P f4afe81810944d70bc2cc31754392f3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.114905 26038 tablet_replica.cc:333] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.115407 26038 raft_consensus.cc:2243] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.115901 26038 raft_consensus.cc:2272] T 580a99e39c90417485c3e3481d14bbdc P f4afe81810944d70bc2cc31754392f3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.117573 26038 tablet_replica.cc:333] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.118016 26038 raft_consensus.cc:2243] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.118728 26038 raft_consensus.cc:2272] T 36d2fcee6798446ca0ae9140145ba175 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.120440 26038 tablet_replica.cc:333] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.120882 26038 raft_consensus.cc:2243] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.121579 26038 raft_consensus.cc:2272] T 1b636aab71bc4cad87e3a5d644042885 P f4afe81810944d70bc2cc31754392f3d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.123226 26038 tablet_replica.cc:333] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.123670 26038 raft_consensus.cc:2243] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.124161 26038 raft_consensus.cc:2272] T 8ba2f184437940dbb94ed0532f27e854 P f4afe81810944d70bc2cc31754392f3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.125865 26038 tablet_replica.cc:333] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d: stopping tablet replica
I20260709 13:13:24.126296 26038 raft_consensus.cc:2243] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.127084 26038 raft_consensus.cc:2272] T 63772c6ab6094654b0215f6a3be7d6fc P f4afe81810944d70bc2cc31754392f3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.469964 26038 tablet_server.cc:196] TabletServer@127.25.109.132:0 shutdown complete.
I20260709 13:13:24.538391 26038 master.cc:562] Master@127.25.109.190:33321 shutting down...
W20260709 13:13:25.356297 27039 catalog_manager.cc:4755] TS 1010256288ec4502b330749e2e3d7c85 (127.25.109.129:38249): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e466225c5a147b9b31f11fea1bcf893: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38249: connect: Connection refused (error 111)
I20260709 13:13:25.526640 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.527766 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.528244 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P b1a1bf33a5434d58a8638deed0153f03: stopping tablet replica
I20260709 13:13:25.746101 26038 master.cc:584] Master@127.25.109.190:33321 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (216049 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:13:25.861088 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:37007
I20260709 13:13:25.862534 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.868059  1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.869012  1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.870826  1573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.870895 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:25.874261 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.874452 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.874634 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602805874603 us; error 0 us; skew 500 ppm
I20260709 13:13:25.875180 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.877512 26038 webserver.cc:533] Webserver started at http://127.25.109.190:38793/ using document root <none> and password file <none>
I20260709 13:13:25.878093 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.878264 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.878528 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.879760 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "ab00e6e9f3204c779d447ee29e534e73"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-zhdc"
I20260709 13:13:25.884174 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:25.887558  1578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.888236 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:25.888530 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "ab00e6e9f3204c779d447ee29e534e73"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-zhdc"
I20260709 13:13:25.888824 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.910653 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.912011 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.949785 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:37007
I20260709 13:13:25.949908  1629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:37007 every 8 connection(s)
I20260709 13:13:25.954365  1630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.965183  1630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73: Bootstrap starting.
I20260709 13:13:25.970090  1630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.974321  1630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73: No bootstrap required, opened a new log
I20260709 13:13:25.976634  1630 raft_consensus.cc:359] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER }
I20260709 13:13:25.977145  1630 raft_consensus.cc:385] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.977365  1630 raft_consensus.cc:740] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab00e6e9f3204c779d447ee29e534e73, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.978072  1630 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER }
I20260709 13:13:25.978545  1630 raft_consensus.cc:399] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:25.978754  1630 raft_consensus.cc:493] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:25.979071  1630 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.983367  1630 raft_consensus.cc:515] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER }
I20260709 13:13:25.983915  1630 leader_election.cc:304] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab00e6e9f3204c779d447ee29e534e73; no voters: 
I20260709 13:13:25.985076  1630 leader_election.cc:290] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:25.985503  1633 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.986970  1633 raft_consensus.cc:697] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 1 LEADER]: Becoming Leader. State: Replica: ab00e6e9f3204c779d447ee29e534e73, State: Running, Role: LEADER
I20260709 13:13:25.987677  1633 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER }
I20260709 13:13:25.988037  1630 sys_catalog.cc:565] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:25.995514  1634 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab00e6e9f3204c779d447ee29e534e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER } }
I20260709 13:13:25.995754  1635 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab00e6e9f3204c779d447ee29e534e73. Latest consensus state: current_term: 1 leader_uuid: "ab00e6e9f3204c779d447ee29e534e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab00e6e9f3204c779d447ee29e534e73" member_type: VOTER } }
I20260709 13:13:25.996407  1634 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.996577  1635 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.999468  1639 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:26.007489  1639 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:26.008446 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:26.016978  1639 catalog_manager.cc:1383] Generated new cluster ID: 3324b97cf4264cb6aab65daec13f7def
I20260709 13:13:26.017267  1639 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:26.050577  1639 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:26.051919  1639 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:26.067194  1639 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73: Generated new TSK 0
I20260709 13:13:26.067772  1639 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:26.074874 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.081167  1651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.082266  1652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.086453 26038 server_base.cc:1061] running on GCE node
W20260709 13:13:26.086457  1654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.091205 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.091413 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.091619 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602806091599 us; error 0 us; skew 500 ppm
I20260709 13:13:26.092227 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.094686 26038 webserver.cc:533] Webserver started at http://127.25.109.129:45189/ using document root <none> and password file <none>
I20260709 13:13:26.095183 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.095345 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.095647 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.096832 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.101231 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:26.104451  1659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.105237 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:26.105525 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.105764 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.119531 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.120680 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.122215 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.125031 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.125200 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.125501 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.125674 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.166683 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:38637
I20260709 13:13:26.166785  1721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:38637 every 8 connection(s)
I20260709 13:13:26.171952 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.179235  1726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.182427  1727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.185038  1722 heartbeater.cc:344] Connected to a master server at 127.25.109.190:37007
W20260709 13:13:26.185362  1729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.185585  1722 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.186484  1722 heartbeater.cc:507] Master 127.25.109.190:37007 requested a full tablet report, sending...
I20260709 13:13:26.186523 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:26.188736  1595 ts_manager.cc:194] Registered new tserver with Master: 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:26.189014 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.189288 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.189473 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602806189458 us; error 0 us; skew 500 ppm
I20260709 13:13:26.190322 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.190896  1595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37534
I20260709 13:13:26.193601 26038 webserver.cc:533] Webserver started at http://127.25.109.130:36867/ using document root <none> and password file <none>
I20260709 13:13:26.194211 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.194417 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.194690 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.195958 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.200596 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:26.204095  1734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.204989 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:26.205307 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.205617 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.230930 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.232191 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.233659 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.236014 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.236234 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.236464 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.236625 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.277400 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:37637
I20260709 13:13:26.277494  1796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:37637 every 8 connection(s)
I20260709 13:13:26.282534 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.289155  1800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.290850  1801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.292559  1803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.292950 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:26.294147 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.294380 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.294601 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602806294582 us; error 0 us; skew 500 ppm
I20260709 13:13:26.294739  1797 heartbeater.cc:344] Connected to a master server at 127.25.109.190:37007
I20260709 13:13:26.295285  1797 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.295311 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.296139  1797 heartbeater.cc:507] Master 127.25.109.190:37007 requested a full tablet report, sending...
I20260709 13:13:26.297966 26038 webserver.cc:533] Webserver started at http://127.25.109.131:36621/ using document root <none> and password file <none>
I20260709 13:13:26.298465  1595 ts_manager.cc:194] Registered new tserver with Master: 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:26.298565 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.298919 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.299196 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.299952  1595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37544
I20260709 13:13:26.300480 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.305016 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:26.308465  1808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.309324 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:26.309619 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.309861 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.324846 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.326148 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.327629 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.329860 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.330112 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.330345 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.330521 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.372318 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:33969
I20260709 13:13:26.372447  1870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:33969 every 8 connection(s)
I20260709 13:13:26.377431 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.385576  1875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.387360  1874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.388867  1871 heartbeater.cc:344] Connected to a master server at 127.25.109.190:37007
I20260709 13:13:26.389339  1871 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:26.390648  1877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.390776  1871 heartbeater.cc:507] Master 127.25.109.190:37007 requested a full tablet report, sending...
I20260709 13:13:26.391548 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:26.392699 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.393005 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.393199 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602806393184 us; error 0 us; skew 500 ppm
I20260709 13:13:26.393515  1595 ts_manager.cc:194] Registered new tserver with Master: f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:26.393882 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.395108  1595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37556
I20260709 13:13:26.396756 26038 webserver.cc:533] Webserver started at http://127.25.109.132:44323/ using document root <none> and password file <none>
I20260709 13:13:26.397296 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.397500 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.397787 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.398999 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-3-root/instance:
uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.403335 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:26.407025  1882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.408186 26038 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:13:26.408592 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:26.409075 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.425344 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.426715 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.428226 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.430603 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.430866 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.431097 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.431263 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.472519 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.132:36955
I20260709 13:13:26.472661  1944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.132:36955 every 8 connection(s)
I20260709 13:13:26.490830  1945 heartbeater.cc:344] Connected to a master server at 127.25.109.190:37007
I20260709 13:13:26.491338  1945 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.492090  1945 heartbeater.cc:507] Master 127.25.109.190:37007 requested a full tablet report, sending...
I20260709 13:13:26.493974  1595 ts_manager.cc:194] Registered new tserver with Master: d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:26.494297 26038 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018597994s
I20260709 13:13:26.495435  1595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37562
I20260709 13:13:26.522639  1595 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37574:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:13:26.770737  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 2961890859c44bf99c4531325d5d5dda (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:26.772315  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961890859c44bf99c4531325d5d5dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.772221  1910 tablet_service.cc:1511] Processing CreateTablet for tablet 2961890859c44bf99c4531325d5d5dda (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:26.773671  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961890859c44bf99c4531325d5d5dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.780357  1686 tablet_service.cc:1511] Processing CreateTablet for tablet ea6b19867dd34bddba378c80d0f7f88b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:26.781821  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6b19867dd34bddba378c80d0f7f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.783448  1909 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd57330f2d548d086f9d7a41e682ee5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:26.784865  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd57330f2d548d086f9d7a41e682ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.786374  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd57330f2d548d086f9d7a41e682ee5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:26.787815  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd57330f2d548d086f9d7a41e682ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.798418  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 826a8ad6d33b46ecb299a4c360f2eabf (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:26.800355  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826a8ad6d33b46ecb299a4c360f2eabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.800212  1908 tablet_service.cc:1511] Processing CreateTablet for tablet ab95aaaee39e4e359c7dc696ab38ebf5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:26.801645  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95aaaee39e4e359c7dc696ab38ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.803272  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 6f635924519644d2b33d03b432f2f0dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:26.804587  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f635924519644d2b33d03b432f2f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.807252  1906 tablet_service.cc:1511] Processing CreateTablet for tablet 64617ce40ab24976ab92cd93d4a43fc2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:26.808835  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 6f635924519644d2b33d03b432f2f0dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:26.809921  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64617ce40ab24976ab92cd93d4a43fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.809847  1905 tablet_service.cc:1511] Processing CreateTablet for tablet d8a09118e3c24ab680616b74c499467f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:26.810333  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f635924519644d2b33d03b432f2f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.811849  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a09118e3c24ab680616b74c499467f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.832474  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 64617ce40ab24976ab92cd93d4a43fc2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:26.834024  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64617ce40ab24976ab92cd93d4a43fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.840296  1901 tablet_service.cc:1511] Processing CreateTablet for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:26.841730  1901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.835271  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9cece044e64d77b14148afae56b5a0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:26.843573  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cece044e64d77b14148afae56b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.836143  1904 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9cece044e64d77b14148afae56b5a0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:26.836504  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 6c81fffe19c343e488f9511f34ee3166 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:26.852873  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c81fffe19c343e488f9511f34ee3166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.838380  1903 tablet_service.cc:1511] Processing CreateTablet for tablet 6c81fffe19c343e488f9511f34ee3166 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:26.855185  1904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cece044e64d77b14148afae56b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.839064  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 10013cf9834c48139cae7a7418d8cfc5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:26.856709  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10013cf9834c48139cae7a7418d8cfc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.839593  1902 tablet_service.cc:1511] Processing CreateTablet for tablet 49403423e3f14ee3b8a3680660ceb467 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:26.837782  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03e9a428544fe4bd57cb92c09bc12e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:26.859452  1902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49403423e3f14ee3b8a3680660ceb467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.860157  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03e9a428544fe4bd57cb92c09bc12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.862394  1903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c81fffe19c343e488f9511f34ee3166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.885293  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:26.900626  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 799285a16a0448ffa4198dd63be9c7b1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:26.902027  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799285a16a0448ffa4198dd63be9c7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.904011  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 799285a16a0448ffa4198dd63be9c7b1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:26.908679  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799285a16a0448ffa4198dd63be9c7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.909461  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 024e65939c3e424ba2affe47d09b8ff1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:26.909292  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 381e5c55f4de4d3997b89df0724ef37d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:26.910763  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e65939c3e424ba2affe47d09b8ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.914419  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381e5c55f4de4d3997b89df0724ef37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.917755  1682 tablet_service.cc:1511] Processing CreateTablet for tablet a7887b321a8542bc8499248d7af82425 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:26.918367  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.919087  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7887b321a8542bc8499248d7af82425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.928588  1908 tablet_service.cc:1511] Processing CreateTablet for tablet a7887b321a8542bc8499248d7af82425 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:26.936336  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7887b321a8542bc8499248d7af82425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.938114  1905 tablet_service.cc:1511] Processing CreateTablet for tablet 024e65939c3e424ba2affe47d09b8ff1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:26.939411  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e65939c3e424ba2affe47d09b8ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.943110  1902 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1204d86fd546ac9b9805231af432d6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:26.943324  1681 tablet_service.cc:1511] Processing CreateTablet for tablet f45f5c68e96e495fb422b6f5d1734b44 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:26.944437  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f5c68e96e495fb422b6f5d1734b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.944437  1902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1204d86fd546ac9b9805231af432d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.950542  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa4b01ab9a44167bda5a2e595a210c7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:26.951802  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa4b01ab9a44167bda5a2e595a210c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.951831  1687 tablet_service.cc:1511] Processing CreateTablet for tablet e23ddfe5abd743ceb5a11392adbf8f21 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:26.953303  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23ddfe5abd743ceb5a11392adbf8f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.954914  1961 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:26.962807  1962 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:26.969636  1961 tablet_bootstrap.cc:654] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.975373  1761 tablet_service.cc:1511] Processing CreateTablet for tablet ea6b19867dd34bddba378c80d0f7f88b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:26.975972  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 71ac1c31917741069cdbad88e94789ff (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:26.976933  1761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6b19867dd34bddba378c80d0f7f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.977265  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ac1c31917741069cdbad88e94789ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.979192  1910 tablet_service.cc:1511] Processing CreateTablet for tablet d87e09536d0847e4b4f25725f653c052 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:26.979261  1760 tablet_service.cc:1511] Processing CreateTablet for tablet ab95aaaee39e4e359c7dc696ab38ebf5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:26.980602  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87e09536d0847e4b4f25725f653c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.980741  1760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95aaaee39e4e359c7dc696ab38ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.983284  1759 tablet_service.cc:1511] Processing CreateTablet for tablet 826a8ad6d33b46ecb299a4c360f2eabf (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:26.985129  1759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826a8ad6d33b46ecb299a4c360f2eabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.987700  1758 tablet_service.cc:1511] Processing CreateTablet for tablet 6f635924519644d2b33d03b432f2f0dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:26.989491  1758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f635924519644d2b33d03b432f2f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.991667  1757 tablet_service.cc:1511] Processing CreateTablet for tablet d8a09118e3c24ab680616b74c499467f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:26.993523  1757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a09118e3c24ab680616b74c499467f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.995654  1756 tablet_service.cc:1511] Processing CreateTablet for tablet 10013cf9834c48139cae7a7418d8cfc5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:26.997653  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10013cf9834c48139cae7a7418d8cfc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.999464  1762 tablet_service.cc:1511] Processing CreateTablet for tablet 2961890859c44bf99c4531325d5d5dda (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:27.001103  1762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2961890859c44bf99c4531325d5d5dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.007756  1755 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9cece044e64d77b14148afae56b5a0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:27.009683  1755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cece044e64d77b14148afae56b5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.012591  1754 tablet_service.cc:1511] Processing CreateTablet for tablet 49403423e3f14ee3b8a3680660ceb467 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:27.006353  1903 tablet_service.cc:1511] Processing CreateTablet for tablet e23ddfe5abd743ceb5a11392adbf8f21 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:27.015739  1754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49403423e3f14ee3b8a3680660ceb467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.033668  1903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23ddfe5abd743ceb5a11392adbf8f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.024071  1904 tablet_service.cc:1511] Processing CreateTablet for tablet 71ac1c31917741069cdbad88e94789ff (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:27.051272  1681 tablet_service.cc:1511] Processing CreateTablet for tablet e8060ba9d7934ce88c1dc9d768e1bfce (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:27.053083  1687 tablet_service.cc:1511] Processing CreateTablet for tablet a5895ed0fa1543c7b85a1646e8f8d99d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:27.049821  1962 tablet_bootstrap.cc:654] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.053670  1904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ac1c31917741069cdbad88e94789ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.058151  1753 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03e9a428544fe4bd57cb92c09bc12e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:27.062974  1753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03e9a428544fe4bd57cb92c09bc12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.068631  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8060ba9d7934ce88c1dc9d768e1bfce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.055332  1580 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 68736.1us
I20260709 13:13:27.078215  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 9edd4d5916bd457ebee0a8735672f478 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:27.078418  1836 tablet_service.cc:1511] Processing CreateTablet for tablet ea6b19867dd34bddba378c80d0f7f88b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:27.079524  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edd4d5916bd457ebee0a8735672f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.079804  1836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea6b19867dd34bddba378c80d0f7f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.083918  1906 tablet_service.cc:1511] Processing CreateTablet for tablet f45f5c68e96e495fb422b6f5d1734b44 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:27.085395  1678 tablet_service.cc:1511] Processing CreateTablet for tablet abff7eb16e2f4ed2a372f6fb6e6944e0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 13:13:27.059422  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:27.085994  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f5c68e96e495fb422b6f5d1734b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.121953  1828 tablet_service.cc:1511] Processing CreateTablet for tablet 49403423e3f14ee3b8a3680660ceb467 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:27.124943  1828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49403423e3f14ee3b8a3680660ceb467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.091899  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5895ed0fa1543c7b85a1646e8f8d99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.059046  1685 tablet_service.cc:1511] Processing CreateTablet for tablet f92e2274307749e7b3c88af5cc18eeec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:27.095082  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 6c54b72c5fca48d3aebdcb078b3259e2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:27.097199  1835 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd57330f2d548d086f9d7a41e682ee5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:27.098711  1901 tablet_service.cc:1511] Processing CreateTablet for tablet e8060ba9d7934ce88c1dc9d768e1bfce (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:27.133008  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c54b72c5fca48d3aebdcb078b3259e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.133061  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd57330f2d548d086f9d7a41e682ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.133047  1901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8060ba9d7934ce88c1dc9d768e1bfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.099016  1908 tablet_service.cc:1511] Processing CreateTablet for tablet f92e2274307749e7b3c88af5cc18eeec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:27.099864  1834 tablet_service.cc:1511] Processing CreateTablet for tablet ab95aaaee39e4e359c7dc696ab38ebf5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:27.143024  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95aaaee39e4e359c7dc696ab38ebf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.102385  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 826a8ad6d33b46ecb299a4c360f2eabf (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:27.146807  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abff7eb16e2f4ed2a372f6fb6e6944e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.146942  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 826a8ad6d33b46ecb299a4c360f2eabf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.975427  1684 tablet_service.cc:1511] Processing CreateTablet for tablet cb5217ef91e14dcdac796f4a5a1626f7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:27.150859  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5217ef91e14dcdac796f4a5a1626f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.108610  1909 tablet_service.cc:1511] Processing CreateTablet for tablet 9edd4d5916bd457ebee0a8735672f478 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:27.153119  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edd4d5916bd457ebee0a8735672f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.112051  1832 tablet_service.cc:1511] Processing CreateTablet for tablet 64617ce40ab24976ab92cd93d4a43fc2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:27.153573  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7367c106e34612bcfd73ecbf29dc01 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:27.114693  1831 tablet_service.cc:1511] Processing CreateTablet for tablet d8a09118e3c24ab680616b74c499467f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:27.154968  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7367c106e34612bcfd73ecbf29dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.117064  1830 tablet_service.cc:1511] Processing CreateTablet for tablet 10013cf9834c48139cae7a7418d8cfc5 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:27.119562  1829 tablet_service.cc:1511] Processing CreateTablet for tablet 6c81fffe19c343e488f9511f34ee3166 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:27.157935  1827 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03e9a428544fe4bd57cb92c09bc12e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:27.154980  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64617ce40ab24976ab92cd93d4a43fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.166399  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a09118e3c24ab680616b74c499467f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.167287  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7e5823ed724e64809a4092d83dbdec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:27.172030  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10013cf9834c48139cae7a7418d8cfc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.175604  1760 tablet_service.cc:1511] Processing CreateTablet for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:27.176923  1760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c06e30d8c0f4a09a24ebb8e781f18dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.178407  1827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03e9a428544fe4bd57cb92c09bc12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.181313  1829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c81fffe19c343e488f9511f34ee3166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.189371  1961 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:27.189942  1961 ts_tablet_manager.cc:1403] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.014s
I20260709 13:13:27.193080  1961 raft_consensus.cc:359] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.193836  1722 heartbeater.cc:499] Master 127.25.109.190:37007 was elected leader, sending a full tablet report...
I20260709 13:13:27.195475  1756 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1204d86fd546ac9b9805231af432d6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:27.197667  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1204d86fd546ac9b9805231af432d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.199046  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7e5823ed724e64809a4092d83dbdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.199919  1902 tablet_service.cc:1511] Processing CreateTablet for tablet ebae9483f2ce49e68f23279ac74cfbf4 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:27.202337  1902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae9483f2ce49e68f23279ac74cfbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.200969  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e2274307749e7b3c88af5cc18eeec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.206394  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e2274307749e7b3c88af5cc18eeec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.208079  1762 tablet_service.cc:1511] Processing CreateTablet for tablet 381e5c55f4de4d3997b89df0724ef37d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:27.208669  1962 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:27.209234  1962 ts_tablet_manager.cc:1403] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.247s	user 0.007s	sys 0.009s
I20260709 13:13:27.209438  1762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381e5c55f4de4d3997b89df0724ef37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.217181  1905 tablet_service.cc:1511] Processing CreateTablet for tablet 63426b4990cb4e66baddcc699073609b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:27.193802  1961 raft_consensus.cc:385] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.223340  1961 raft_consensus.cc:740] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.239300  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 09e3bee67221424696e7ac634661ab94 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:27.248482  1753 tablet_service.cc:1511] Processing CreateTablet for tablet d87e09536d0847e4b4f25725f653c052 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:27.251832  1906 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7e5823ed724e64809a4092d83dbdec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:27.252614  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63426b4990cb4e66baddcc699073609b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.255190  1901 tablet_service.cc:1511] Processing CreateTablet for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:27.251017  1903 tablet_service.cc:1511] Processing CreateTablet for tablet 6c54b72c5fca48d3aebdcb078b3259e2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:27.250876  1961 consensus_queue.cc:260] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.283389  1965 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:27.297724  1909 tablet_service.cc:1511] Processing CreateTablet for tablet 633e916bc3f7458f9700a7de1ffe30de (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:27.298251  1753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87e09536d0847e4b4f25725f653c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.302347  1797 heartbeater.cc:499] Master 127.25.109.190:37007 was elected leader, sending a full tablet report...
I20260709 13:13:27.279562  1901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.306370  1903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c54b72c5fca48d3aebdcb078b3259e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.306273  1761 tablet_service.cc:1511] Processing CreateTablet for tablet 024e65939c3e424ba2affe47d09b8ff1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:27.307090  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 22a73eb01dda4e8c9b2d0f84b2974e65 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:27.241816  1962 raft_consensus.cc:359] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.316129  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7e5823ed724e64809a4092d83dbdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.316018  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 633e916bc3f7458f9700a7de1ffe30de (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:27.313257  1962 raft_consensus.cc:385] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.322486  1962 raft_consensus.cc:740] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.323138  1758 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7367c106e34612bcfd73ecbf29dc01 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:27.323961  1961 ts_tablet_manager.cc:1434] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.005s
I20260709 13:13:27.325037  1827 tablet_service.cc:1511] Processing CreateTablet for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:27.327589  1831 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1204d86fd546ac9b9805231af432d6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:27.328882  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1204d86fd546ac9b9805231af432d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.330479  1966 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:27.330395  1962 consensus_queue.cc:260] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.331111  1759 tablet_service.cc:1511] Processing CreateTablet for tablet e23ddfe5abd743ceb5a11392adbf8f21 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:27.332906  1755 tablet_service.cc:1511] Processing CreateTablet for tablet cb5217ef91e14dcdac796f4a5a1626f7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:27.332975  1835 tablet_service.cc:1511] Processing CreateTablet for tablet 799285a16a0448ffa4198dd63be9c7b1 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:27.334080  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633e916bc3f7458f9700a7de1ffe30de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.308147  1757 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa4b01ab9a44167bda5a2e595a210c7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:27.340425  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a73eb01dda4e8c9b2d0f84b2974e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.340979  1754 tablet_service.cc:1511] Processing CreateTablet for tablet 6c54b72c5fca48d3aebdcb078b3259e2 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:27.347412  1965 tablet_bootstrap.cc:654] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.351457  1966 tablet_bootstrap.cc:654] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.341681  1827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.381172  1832 tablet_service.cc:1511] Processing CreateTablet for tablet 71ac1c31917741069cdbad88e94789ff (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:27.382627  1961 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:27.385445  1834 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7e5823ed724e64809a4092d83dbdec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:27.388738  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ac1c31917741069cdbad88e94789ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.389952  1760 tablet_service.cc:1511] Processing CreateTablet for tablet e8060ba9d7934ce88c1dc9d768e1bfce (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:27.343082  1910 tablet_service.cc:1511] Processing CreateTablet for tablet 22a73eb01dda4e8c9b2d0f84b2974e65 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:27.391965  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a73eb01dda4e8c9b2d0f84b2974e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.345176  1761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024e65939c3e424ba2affe47d09b8ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.397975  1871 heartbeater.cc:499] Master 127.25.109.190:37007 was elected leader, sending a full tablet report...
I20260709 13:13:27.403076  1762 tablet_service.cc:1511] Processing CreateTablet for tablet ebae9483f2ce49e68f23279ac74cfbf4 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:27.364760  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 175c1595f94b42a2a3a55a81907d9ca9 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:27.406832  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175c1595f94b42a2a3a55a81907d9ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.406898  1945 heartbeater.cc:499] Master 127.25.109.190:37007 was elected leader, sending a full tablet report...
I20260709 13:13:27.408355  1962 ts_tablet_manager.cc:1434] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.011s
I20260709 13:13:27.364842  1679 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7ce33e05c432bae9a05f6c1235ffd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:27.368330  1828 tablet_service.cc:1511] Processing CreateTablet for tablet a7887b321a8542bc8499248d7af82425 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:27.377738  1833 tablet_service.cc:1511] Processing CreateTablet for tablet d87e09536d0847e4b4f25725f653c052 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:27.379834  1836 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa4b01ab9a44167bda5a2e595a210c7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:27.411132  1756 tablet_service.cc:1511] Processing CreateTablet for tablet a5895ed0fa1543c7b85a1646e8f8d99d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:27.363162  1830 tablet_service.cc:1511] Processing CreateTablet for tablet 381e5c55f4de4d3997b89df0724ef37d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:27.417932  1904 tablet_service.cc:1511] Processing CreateTablet for tablet be2c8382c1d946388b362b876a2f85f6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:27.419355  1904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2c8382c1d946388b362b876a2f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.422531  1723 tablet.cc:2406] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:27.404632  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799285a16a0448ffa4198dd63be9c7b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.411041  1908 tablet_service.cc:1511] Processing CreateTablet for tablet fbae727a35c2401ba95837189c5fb36c (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:27.432802  1908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae727a35c2401ba95837189c5fb36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.380786  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e3bee67221424696e7ac634661ab94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.435942  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7ce33e05c432bae9a05f6c1235ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.440724  1962 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:27.442598  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633e916bc3f7458f9700a7de1ffe30de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.449766  1961 tablet_bootstrap.cc:654] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.406949  1968 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.473114  1828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7887b321a8542bc8499248d7af82425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.474116  1685 tablet_service.cc:1511] Processing CreateTablet for tablet fbae727a35c2401ba95837189c5fb36c (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:27.475139  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 95515768424547f5a244a3c431e77af8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:27.475842  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 5e539b2d67f744f882c34f0039a390b7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:27.476989  1758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7367c106e34612bcfd73ecbf29dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.477600  1762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae9483f2ce49e68f23279ac74cfbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.477381  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad89189227840cfa6fd1096b4ca2ed6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:27.475615  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae727a35c2401ba95837189c5fb36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.478569  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87e09536d0847e4b4f25725f653c052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.480554  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad89189227840cfa6fd1096b4ca2ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.482357  1757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa4b01ab9a44167bda5a2e595a210c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.483124  1836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa4b01ab9a44167bda5a2e595a210c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.483748  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7e5823ed724e64809a4092d83dbdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.482009  1682 tablet_service.cc:1511] Processing CreateTablet for tablet be2c8382c1d946388b362b876a2f85f6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:27.486369  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381e5c55f4de4d3997b89df0724ef37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.486852  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2c8382c1d946388b362b876a2f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.491037  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95515768424547f5a244a3c431e77af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.491534  1829 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7367c106e34612bcfd73ecbf29dc01 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:27.492887  1829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7367c106e34612bcfd73ecbf29dc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.494392  1755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5217ef91e14dcdac796f4a5a1626f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.498399  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5895ed0fa1543c7b85a1646e8f8d99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.498747  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e539b2d67f744f882c34f0039a390b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.502440  1754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c54b72c5fca48d3aebdcb078b3259e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.503803  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 0001ab95b0df41219d8182675cadcadd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:27.505155  1678 tablet_service.cc:1511] Processing CreateTablet for tablet ca1fd895a5da448497336f82b5d7c68f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:27.508358  1967 raft_consensus.cc:493] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.508281  1753 tablet_service.cc:1511] Processing CreateTablet for tablet f92e2274307749e7b3c88af5cc18eeec (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:27.510692  1902 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad89189227840cfa6fd1096b4ca2ed6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:27.525300  1902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad89189227840cfa6fd1096b4ca2ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.511525  1968 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.523008  1967 raft_consensus.cc:515] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.527549  1906 tablet_service.cc:1511] Processing CreateTablet for tablet 95515768424547f5a244a3c431e77af8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:27.528261  1967 leader_election.cc:290] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:27.528956  1906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95515768424547f5a244a3c431e77af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.543108  1760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8060ba9d7934ce88c1dc9d768e1bfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.556649  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1fd895a5da448497336f82b5d7c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.558677  1965 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:27.558597  1968 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:27.578974  1753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92e2274307749e7b3c88af5cc18eeec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.590090  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0001ab95b0df41219d8182675cadcadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.567304  1965 ts_tablet_manager.cc:1403] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.284s	user 0.012s	sys 0.008s
I20260709 13:13:27.605662  1901 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaacc9a4b49abbc8a573403e1d836 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:27.607077  1901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaacc9a4b49abbc8a573403e1d836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.615350  1903 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9d93f2b6f149aab543319fc847c471 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:27.617533  1903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9d93f2b6f149aab543319fc847c471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.619201  1965 raft_consensus.cc:359] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.619992  1965 raft_consensus.cc:385] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.620287  1965 raft_consensus.cc:740] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.604564  1759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23ddfe5abd743ceb5a11392adbf8f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.643965  1831 tablet_service.cc:1511] Processing CreateTablet for tablet cb5217ef91e14dcdac796f4a5a1626f7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:27.650560  1962 tablet_bootstrap.cc:700] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent opening tablet: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:13:27.651341  1962 tablet_bootstrap.cc:654] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.667277  1904 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfa49cabd9d408cad9a18a6f67ec10e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:27.668920  1904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfa49cabd9d408cad9a18a6f67ec10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.690316  1965 consensus_queue.cc:260] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.685621  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb5217ef91e14dcdac796f4a5a1626f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.712819  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 4266e947d76f4ade89d52bf8b7488b8d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:27.715268  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9d93f2b6f149aab543319fc847c471 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:27.724200  1832 tablet_service.cc:1511] Processing CreateTablet for tablet f45f5c68e96e495fb422b6f5d1734b44 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:27.727217  1830 tablet_service.cc:1511] Processing CreateTablet for tablet ebae9483f2ce49e68f23279ac74cfbf4 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:27.739951  1684 tablet_service.cc:1511] Processing CreateTablet for tablet e657952244e94190a86359d442ba3335 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:27.748140  1828 tablet_service.cc:1511] Processing CreateTablet for tablet a5895ed0fa1543c7b85a1646e8f8d99d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:27.731703  1905 tablet_service.cc:1511] Processing CreateTablet for tablet 4266e947d76f4ade89d52bf8b7488b8d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:27.754673  1905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266e947d76f4ade89d52bf8b7488b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.767410  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266e947d76f4ade89d52bf8b7488b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.766172  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebae9483f2ce49e68f23279ac74cfbf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.776764  1834 tablet_service.cc:1511] Processing CreateTablet for tablet abff7eb16e2f4ed2a372f6fb6e6944e0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:27.834617  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abff7eb16e2f4ed2a372f6fb6e6944e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.841972  1760 tablet_service.cc:1511] Processing CreateTablet for tablet fbae727a35c2401ba95837189c5fb36c (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:27.783035  1762 tablet_service.cc:1511] Processing CreateTablet for tablet abff7eb16e2f4ed2a372f6fb6e6944e0 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:27.843350  1760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae727a35c2401ba95837189c5fb36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.784740  1758 tablet_service.cc:1511] Processing CreateTablet for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:27.844399  1758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d27c1df32e4d62bdcd7c81e3dcddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.753790  1836 tablet_service.cc:1511] Processing CreateTablet for tablet 9edd4d5916bd457ebee0a8735672f478 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:27.787302  1966 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:27.846499  1966 ts_tablet_manager.cc:1403] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.516s	user 0.016s	sys 0.022s
I20260709 13:13:27.846822  1836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edd4d5916bd457ebee0a8735672f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.850555  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:27.791020  1754 tablet_service.cc:1511] Processing CreateTablet for tablet 63426b4990cb4e66baddcc699073609b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:27.851841  1754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63426b4990cb4e66baddcc699073609b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.849675  1966 raft_consensus.cc:359] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:27.854517  1966 raft_consensus.cc:385] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.854864  1966 raft_consensus.cc:740] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.855691  1966 consensus_queue.cc:260] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:27.857537  1910 tablet_service.cc:1511] Processing CreateTablet for tablet f83bd1fbb8394658b54b12ae731dc56a (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:27.858841  1910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83bd1fbb8394658b54b12ae731dc56a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.872922  1883 leader_election.cc:343] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.797845  1831 tablet_service.cc:1511] Processing CreateTablet for tablet 633e916bc3f7458f9700a7de1ffe30de (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:27.802676  1761 tablet_service.cc:1511] Processing CreateTablet for tablet 09e3bee67221424696e7ac634661ab94 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:27.805594  1753 tablet_service.cc:1511] Processing CreateTablet for tablet 22a73eb01dda4e8c9b2d0f84b2974e65 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:27.874756  1761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e3bee67221424696e7ac634661ab94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.878679  1753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a73eb01dda4e8c9b2d0f84b2974e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.812974  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:27.816409  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 09e3bee67221424696e7ac634661ab94 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:27.883700  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e3bee67221424696e7ac634661ab94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.819960  1909 tablet_service.cc:1511] Processing CreateTablet for tablet 895498f388084e08825b03b57b266577 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:27.822293  1756 tablet_service.cc:1511] Processing CreateTablet for tablet 175c1595f94b42a2a3a55a81907d9ca9 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:27.822603  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:27.885202  1772 raft_consensus.cc:2468] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:27.823094  1829 tablet_service.cc:1511] Processing CreateTablet for tablet 63426b4990cb4e66baddcc699073609b (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:27.886812  1829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63426b4990cb4e66baddcc699073609b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.886962  1660 leader_election.cc:304] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
W20260709 13:13:27.887929  1661 leader_election.cc:343] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.888293  1967 raft_consensus.cc:2804] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.888809  1967 raft_consensus.cc:493] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.889199  1967 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.832696  1757 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7ce33e05c432bae9a05f6c1235ffd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:27.895124  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895498f388084e08825b03b57b266577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.902792  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633e916bc3f7458f9700a7de1ffe30de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.906071  1907 tablet_service.cc:1511] Processing CreateTablet for tablet 30c63166b5cb40ff87aacce96cd3f111 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:27.906853  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 36ba3b40ea604e49a8568edd5462a025 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:27.907519  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c63166b5cb40ff87aacce96cd3f111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.908299  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ba3b40ea604e49a8568edd5462a025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.912264  1967 raft_consensus.cc:515] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.912767  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 895498f388084e08825b03b57b266577 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:27.914094  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895498f388084e08825b03b57b266577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.914211  1827 tablet_service.cc:1511] Processing CreateTablet for tablet f1d7ce33e05c432bae9a05f6c1235ffd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:27.915558  1827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7ce33e05c432bae9a05f6c1235ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.916236  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:27.925042  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f5c68e96e495fb422b6f5d1734b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.925450  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9d93f2b6f149aab543319fc847c471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.902305  1835 tablet_service.cc:1511] Processing CreateTablet for tablet 175c1595f94b42a2a3a55a81907d9ca9 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:27.941224  1762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abff7eb16e2f4ed2a372f6fb6e6944e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.942381  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e657952244e94190a86359d442ba3335. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.943581  1579 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 111551us
I20260709 13:13:27.911062  1683 tablet_service.cc:1511] Processing CreateTablet for tablet f83bd1fbb8394658b54b12ae731dc56a (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:27.945590  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83bd1fbb8394658b54b12ae731dc56a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:27.946120  1661 leader_election.cc:343] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.947865  1828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5895ed0fa1543c7b85a1646e8f8d99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.948012  1755 tablet_service.cc:1511] Processing CreateTablet for tablet 0001ab95b0df41219d8182675cadcadd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:27.948721  1962 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:27.949231  1962 ts_tablet_manager.cc:1403] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.509s	user 0.030s	sys 0.042s
I20260709 13:13:27.952181  1967 leader_election.cc:290] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:27.953859  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175c1595f94b42a2a3a55a81907d9ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.953960  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:27.954627  1772 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.955152  1965 ts_tablet_manager.cc:1434] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.357s	user 0.022s	sys 0.047s
I20260709 13:13:27.957476  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175c1595f94b42a2a3a55a81907d9ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.953627  1962 raft_consensus.cc:359] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.958362  1962 raft_consensus.cc:385] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.958667  1962 raft_consensus.cc:740] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.959429  1962 consensus_queue.cc:260] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:27.964944  1962 ts_tablet_manager.cc:1434] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:27.965902  1962 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:27.978179  1755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0001ab95b0df41219d8182675cadcadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:27.981002  1962 tablet_bootstrap.cc:654] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.982241  1965 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:27.983163  1759 tablet_service.cc:1511] Processing CreateTablet for tablet 5e539b2d67f744f882c34f0039a390b7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:27.988703  1965 tablet_bootstrap.cc:654] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.003005  1759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e539b2d67f744f882c34f0039a390b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.005291  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:27.991750  1754 tablet_service.cc:1511] Processing CreateTablet for tablet 95515768424547f5a244a3c431e77af8 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:13:28.006942  1885 leader_election.cc:343] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.007551  1754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95515768424547f5a244a3c431e77af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.007441  1885 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:28.008812  1968 raft_consensus.cc:2749] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.018594  1772 raft_consensus.cc:2468] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:28.022558  1757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d7ce33e05c432bae9a05f6c1235ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.028426  1961 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.028952  1961 ts_tablet_manager.cc:1403] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.647s	user 0.020s	sys 0.045s
I20260709 13:13:28.032023  1961 raft_consensus.cc:359] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.032730  1961 raft_consensus.cc:385] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.033031  1961 raft_consensus.cc:740] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.037374  1660 leader_election.cc:304] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:28.038936  1967 raft_consensus.cc:2804] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.039186  1961 consensus_queue.cc:260] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.042943  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 0001ab95b0df41219d8182675cadcadd (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:28.049643  1966 ts_tablet_manager.cc:1434] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.203s	user 0.017s	sys 0.025s
I20260709 13:13:28.055058  1753 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaacc9a4b49abbc8a573403e1d836 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:28.056353  1753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaacc9a4b49abbc8a573403e1d836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.064172  1830 tablet_service.cc:1511] Processing CreateTablet for tablet be2c8382c1d946388b362b876a2f85f6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:28.079633  1829 tablet_service.cc:1511] Processing CreateTablet for tablet 5e539b2d67f744f882c34f0039a390b7 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:28.081120  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0001ab95b0df41219d8182675cadcadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.081743  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be2c8382c1d946388b362b876a2f85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.079592  1966 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.079625  1762 tablet_service.cc:1511] Processing CreateTablet for tablet ca1fd895a5da448497336f82b5d7c68f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:28.093885  1829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e539b2d67f744f882c34f0039a390b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.101183  1968 raft_consensus.cc:493] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.101696  1968 raft_consensus.cc:515] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.103847  1968 leader_election.cc:290] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.105341  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:28.106014  1697 raft_consensus.cc:2468] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:28.106420  1961 ts_tablet_manager.cc:1434] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.012s
I20260709 13:13:28.107584  1756 tablet_service.cc:1511] Processing CreateTablet for tablet 4266e947d76f4ade89d52bf8b7488b8d (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:28.108625  1885 leader_election.cc:304] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.112025  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4266e947d76f4ade89d52bf8b7488b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.112325  1968 raft_consensus.cc:2804] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.112736  1968 raft_consensus.cc:493] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.113062  1968 raft_consensus.cc:3060] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.113986  1965 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.107918  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:28.115803  1883 leader_election.cc:343] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.114492  1965 ts_tablet_manager.cc:1403] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.011s
I20260709 13:13:28.123620  1962 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.124158  1962 ts_tablet_manager.cc:1403] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.012s
I20260709 13:13:28.124580  1968 raft_consensus.cc:515] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.128742  1685 tablet_service.cc:1511] Processing CreateTablet for tablet b4f3dde06d094fd381efb549e6f2ec75 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:28.114660  1831 tablet_service.cc:1511] Processing CreateTablet for tablet 2ad89189227840cfa6fd1096b4ca2ed6 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:28.130029  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f3dde06d094fd381efb549e6f2ec75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.132764  1836 tablet_service.cc:1511] Processing CreateTablet for tablet ca1fd895a5da448497336f82b5d7c68f (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:28.131088  1831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ad89189227840cfa6fd1096b4ca2ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.134845  1961 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.138423  1762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1fd895a5da448497336f82b5d7c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.097373  1967 raft_consensus.cc:697] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:28.131762  1965 raft_consensus.cc:359] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.146700  1758 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53188 (request call id 26) took 1046 ms. Trace:
I20260709 13:13:28.147471  1909 tablet_service.cc:1511] Processing CreateTablet for tablet b4f3dde06d094fd381efb549e6f2ec75 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:28.148003  1967 consensus_queue.cc:237] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.148726  1909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f3dde06d094fd381efb549e6f2ec75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:28.153165  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:28.127252  1962 raft_consensus.cc:359] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.146704  1965 raft_consensus.cc:385] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.154956  1962 raft_consensus.cc:385] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.147212  1758 rpcz_store.cc:276] 0709 13:13:27.100197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.783842 (+683645us) service_pool.cc:224] Handling call
0709 13:13:27.843941 (+ 60099us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:13:27.844042 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:13:27.985922 (+141880us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:28.142671 (+156749us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:28.146573 (+  3902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:28.155321  1962 raft_consensus.cc:740] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.156284  1962 consensus_queue.cc:260] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.155206  1965 raft_consensus.cc:740] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.110786  1755 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfa49cabd9d408cad9a18a6f67ec10e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:28.157605  1758 tablet_service.cc:1511] Processing CreateTablet for tablet e657952244e94190a86359d442ba3335 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:28.158529  1755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfa49cabd9d408cad9a18a6f67ec10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.158041  1965 consensus_queue.cc:260] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.163548  1832 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9d93f2b6f149aab543319fc847c471 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:28.157681  1836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1fd895a5da448497336f82b5d7c68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.131045  1834 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaacc9a4b49abbc8a573403e1d836 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:28.171144  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:28.171770  1697 raft_consensus.cc:3060] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.176153  1966 tablet_bootstrap.cc:654] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.178304  1758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e657952244e94190a86359d442ba3335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.179425  1697 raft_consensus.cc:2468] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:28.180802  1885 leader_election.cc:304] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.159960  1761 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53188 (request call id 27) took 1054 ms. Trace:
I20260709 13:13:28.188282  1907 tablet_service.cc:1511] Processing CreateTablet for tablet e0ec621eac4f4ceaa9cc2b261a096071 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:28.189328  1685 tablet_service.cc:1511] Processing CreateTablet for tablet e0ec621eac4f4ceaa9cc2b261a096071 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:28.190657  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ec621eac4f4ceaa9cc2b261a096071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.189548  1907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ec621eac4f4ceaa9cc2b261a096071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.198436  1832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9d93f2b6f149aab543319fc847c471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.203079  1965 ts_tablet_manager.cc:1434] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:13:28.204186  1965 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.210582  1756 tablet_service.cc:1511] Processing CreateTablet for tablet 895498f388084e08825b03b57b266577 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:28.211910  1756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895498f388084e08825b03b57b266577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.212420  1968 leader_election.cc:290] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.213228  1968 raft_consensus.cc:2804] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.213563  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:28.214531  1834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaacc9a4b49abbc8a573403e1d836. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:28.215114  1883 leader_election.cc:343] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.213686  1968 raft_consensus.cc:697] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:28.216236  1968 consensus_queue.cc:237] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.190385  1827 tablet_service.cc:1511] Processing CreateTablet for tablet 5bfa49cabd9d408cad9a18a6f67ec10e (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:28.219401  1827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfa49cabd9d408cad9a18a6f67ec10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.218075  1830 tablet_service.cc:1511] Processing CreateTablet for tablet f83bd1fbb8394658b54b12ae731dc56a (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:28.227775  1961 tablet_bootstrap.cc:654] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.240928  1760 tablet_service.cc:1511] Processing CreateTablet for tablet 36ba3b40ea604e49a8568edd5462a025 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:28.242375  1830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83bd1fbb8394658b54b12ae731dc56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.246299  1760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ba3b40ea604e49a8568edd5462a025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.247745  1829 tablet_service.cc:1511] Processing CreateTablet for tablet 36ba3b40ea604e49a8568edd5462a025 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:28.183535  1761 rpcz_store.cc:276] 0709 13:13:27.105580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.795522 (+689942us) service_pool.cc:224] Handling call
0709 13:13:27.873985 (+ 78463us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:13:27.874361 (+   376us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:13:28.011280 (+136919us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:28.159448 (+148168us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:28.159900 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:28.252060  1885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 71353.5us
I20260709 13:13:28.238708  1828 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36144 (request call id 21) took 1059 ms. Trace:
I20260709 13:13:28.260689  1828 rpcz_store.cc:276] 0709 13:13:27.179276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:27.747098 (+567822us) service_pool.cc:224] Handling call
0709 13:13:27.749051 (+  1953us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:13:27.749223 (+   172us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:13:28.062385 (+313162us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:28.193310 (+130925us) tablet_replica.cc:206] Creating consensus instance
0709 13:13:28.237633 (+ 44323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:28.262590  1833 tablet_service.cc:1511] Processing CreateTablet for tablet 30c63166b5cb40ff87aacce96cd3f111 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:28.262938  1828 tablet_service.cc:1511] Processing CreateTablet for tablet e0ec621eac4f4ceaa9cc2b261a096071 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:28.263921  1833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c63166b5cb40ff87aacce96cd3f111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.265774  1983 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.266321  1983 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.269040  1983 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:28.192792  1835 tablet_service.cc:1511] Processing CreateTablet for tablet e657952244e94190a86359d442ba3335 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:28.260623  1595 catalog_manager.cc:5697] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.279980  1965 tablet_bootstrap.cc:654] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.296188  1828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ec621eac4f4ceaa9cc2b261a096071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.306799  1757 tablet_service.cc:1511] Processing CreateTablet for tablet b4f3dde06d094fd381efb549e6f2ec75 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:28.296679  1761 tablet_service.cc:1511] Processing CreateTablet for tablet 30c63166b5cb40ff87aacce96cd3f111 (DEFAULT_TABLE table=test-workload [id=eba9620995014b358363870bb2e6bf82]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:28.320096  1962 ts_tablet_manager.cc:1434] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.196s	user 0.013s	sys 0.001s
I20260709 13:13:28.321193  1962 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.326246  1757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f3dde06d094fd381efb549e6f2ec75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.339306  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:28.341598  1810 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.322700  1835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e657952244e94190a86359d442ba3335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.349049  1966 tablet_bootstrap.cc:492] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.362442  1966 ts_tablet_manager.cc:1403] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.283s	user 0.030s	sys 0.012s
I20260709 13:13:28.364985  1829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ba3b40ea604e49a8568edd5462a025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.350915  1761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c63166b5cb40ff87aacce96cd3f111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.368217  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:28.370309  1811 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.370975  1811 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:28.374847  1983 raft_consensus.cc:2749] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.365532  1966 raft_consensus.cc:359] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.379702  1966 raft_consensus.cc:385] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.380120  1966 raft_consensus.cc:740] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.381040  1966 consensus_queue.cc:260] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.393725  1962 tablet_bootstrap.cc:654] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.400866  1966 ts_tablet_manager.cc:1434] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:13:28.401998  1966 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.421732  1965 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.422374  1965 ts_tablet_manager.cc:1403] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.218s	user 0.029s	sys 0.040s
I20260709 13:13:28.425554  1961 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.428360  1961 ts_tablet_manager.cc:1403] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.294s	user 0.022s	sys 0.027s
I20260709 13:13:28.431725  1961 raft_consensus.cc:359] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.432469  1961 raft_consensus.cc:385] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.432844  1961 raft_consensus.cc:740] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.433599  1961 consensus_queue.cc:260] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.427376  1965 raft_consensus.cc:359] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.434588  1965 raft_consensus.cc:385] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.434948  1965 raft_consensus.cc:740] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.435734  1965 consensus_queue.cc:260] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.439678  1965 ts_tablet_manager.cc:1434] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:13:28.440766  1965 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.441471  1966 tablet_bootstrap.cc:654] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.445856  1961 ts_tablet_manager.cc:1434] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:28.451505  1981 raft_consensus.cc:493] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.452294  1981 raft_consensus.cc:515] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.452842  1961 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.461079  1961 tablet_bootstrap.cc:654] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.451395  1965 tablet_bootstrap.cc:654] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.464148  1981 leader_election.cc:290] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:28.467993  1962 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.468616  1962 ts_tablet_manager.cc:1403] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.001s
I20260709 13:13:28.472407  1962 raft_consensus.cc:359] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.473462  1962 raft_consensus.cc:385] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.473811  1962 raft_consensus.cc:740] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.474915  1966 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.474782  1962 consensus_queue.cc:260] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.475580  1966 ts_tablet_manager.cc:1403] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.002s
I20260709 13:13:28.476238  1961 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.479147  1966 raft_consensus.cc:359] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.480216  1966 raft_consensus.cc:385] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.480525  1966 raft_consensus.cc:740] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.481410  1966 consensus_queue.cc:260] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.483839  1966 ts_tablet_manager.cc:1434] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:28.484807  1966 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.478798  1961 ts_tablet_manager.cc:1403] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:13:28.491209  1966 tablet_bootstrap.cc:654] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.492527  1965 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.493139  1965 ts_tablet_manager.cc:1403] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.010s
I20260709 13:13:28.485261  1962 ts_tablet_manager.cc:1434] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:13:28.496440  1962 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.497454  1965 raft_consensus.cc:359] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.495036  1961 raft_consensus.cc:359] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.498344  1961 raft_consensus.cc:385] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.498698  1965 raft_consensus.cc:385] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.499078  1965 raft_consensus.cc:740] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.499961  1965 consensus_queue.cc:260] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.502719  1965 ts_tablet_manager.cc:1434] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:13:28.503134  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab95aaaee39e4e359c7dc696ab38ebf5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:28.498713  1961 raft_consensus.cc:740] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.503804  1846 raft_consensus.cc:2468] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:28.504396  1965 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.504689  1592 catalog_manager.cc:5697] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.510140  1736 leader_election.cc:304] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:28.504369  1961 consensus_queue.cc:260] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.513252  1962 tablet_bootstrap.cc:654] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.514595  1981 raft_consensus.cc:2804] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.515002  1981 raft_consensus.cc:493] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.515331  1981 raft_consensus.cc:3060] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.517546  1961 ts_tablet_manager.cc:1434] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:13:28.518610  1961 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.519533  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab95aaaee39e4e359c7dc696ab38ebf5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:28.520183  1920 raft_consensus.cc:2468] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:28.523469  1981 raft_consensus.cc:515] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.527136  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab95aaaee39e4e359c7dc696ab38ebf5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:28.527822  1846 raft_consensus.cc:3060] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.527985  1961 tablet_bootstrap.cc:654] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.530537  1965 tablet_bootstrap.cc:654] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.532627  1962 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.533144  1962 ts_tablet_manager.cc:1403] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:13:28.536249  1962 raft_consensus.cc:359] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.536947  1962 raft_consensus.cc:385] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.537237  1962 raft_consensus.cc:740] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.537977  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab95aaaee39e4e359c7dc696ab38ebf5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:28.538071  1962 consensus_queue.cc:260] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.538697  1920 raft_consensus.cc:3060] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.540841  1962 ts_tablet_manager.cc:1434] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:28.541823  1962 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.548834  1920 raft_consensus.cc:2468] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:28.550535  1846 raft_consensus.cc:2468] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:28.525785  1981 leader_election.cc:290] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:28.553617  1736 leader_election.cc:304] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:28.552461  1966 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.551893  1962 tablet_bootstrap.cc:654] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.554569  1966 ts_tablet_manager.cc:1403] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.010s
I20260709 13:13:28.558349  1966 raft_consensus.cc:359] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.558935  1966 raft_consensus.cc:385] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.559253  1966 raft_consensus.cc:740] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.560022  1966 consensus_queue.cc:260] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.560701  1962 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.561183  1962 ts_tablet_manager.cc:1403] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:13:28.562598  1966 ts_tablet_manager.cc:1434] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:28.563910  1966 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.564525  1965 tablet_bootstrap.cc:492] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.564203  1962 raft_consensus.cc:359] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.564966  1962 raft_consensus.cc:385] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.565050  1965 ts_tablet_manager.cc:1403] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.009s
I20260709 13:13:28.565307  1962 raft_consensus.cc:740] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.554728  1961 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.554553  1981 raft_consensus.cc:2804] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.566331  1961 ts_tablet_manager.cc:1403] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.003s
I20260709 13:13:28.568177  1965 raft_consensus.cc:359] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.568897  1965 raft_consensus.cc:385] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.569176  1965 raft_consensus.cc:740] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.570116  1965 consensus_queue.cc:260] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.570286  1961 raft_consensus.cc:359] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.571303  1961 raft_consensus.cc:385] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.571710  1961 raft_consensus.cc:740] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.572536  1961 consensus_queue.cc:260] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.575248  1961 ts_tablet_manager.cc:1434] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:13:28.576304  1961 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.578454  1962 consensus_queue.cc:260] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.581097  1962 ts_tablet_manager.cc:1434] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.004s
I20260709 13:13:28.582367  1962 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.597759  1961 tablet_bootstrap.cc:654] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.597759  1966 tablet_bootstrap.cc:654] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.601464  1981 raft_consensus.cc:697] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:28.601905  1962 tablet_bootstrap.cc:654] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.602942  2016 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.603688  2016 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.606532  1981 consensus_queue.cc:237] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.607909  1965 ts_tablet_manager.cc:1434] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.042s	user 0.029s	sys 0.012s
I20260709 13:13:28.608712  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:28.609716  2016 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
W20260709 13:13:28.610260  1736 leader_election.cc:343] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.615758  1965 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.623271  1962 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.623267  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:28.623942  1962 ts_tablet_manager.cc:1403] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.017s
I20260709 13:13:28.624127  1965 tablet_bootstrap.cc:654] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.624500  1961 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
W20260709 13:13:28.625160  1737 leader_election.cc:343] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.625666  1737 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:28.627072  1962 raft_consensus.cc:359] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.627609  2015 raft_consensus.cc:2749] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:28.627907  1962 raft_consensus.cc:385] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.628269  1962 raft_consensus.cc:740] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.625165  1961 ts_tablet_manager.cc:1403] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.009s
I20260709 13:13:28.629299  1966 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.629150  1962 consensus_queue.cc:260] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.629980  1966 ts_tablet_manager.cc:1403] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.004s
I20260709 13:13:28.631875  1962 ts_tablet_manager.cc:1434] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:28.633381  1962 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.633096  1966 raft_consensus.cc:359] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.634460  1961 raft_consensus.cc:359] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.635565  1961 raft_consensus.cc:385] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.635933  1961 raft_consensus.cc:740] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.633855  1966 raft_consensus.cc:385] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.636777  1966 raft_consensus.cc:740] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.636912  1961 consensus_queue.cc:260] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.637598  1966 consensus_queue.cc:260] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.639720  1961 ts_tablet_manager.cc:1434] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:28.640130  1966 ts_tablet_manager.cc:1434] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:28.640833  1961 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.641161  1966 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.643332  1593 catalog_manager.cc:5697] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.648363  1961 tablet_bootstrap.cc:654] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.647658  1966 tablet_bootstrap.cc:654] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.658841  1965 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.659578  1965 ts_tablet_manager.cc:1403] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.007s
I20260709 13:13:28.666123  1966 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.666632  1966 ts_tablet_manager.cc:1403] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 13:13:28.669589  1966 raft_consensus.cc:359] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.670545  1966 raft_consensus.cc:385] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.670315  1965 raft_consensus.cc:359] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.671705  1966 raft_consensus.cc:740] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.671851  1965 raft_consensus.cc:385] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.672272  1965 raft_consensus.cc:740] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.672678  1966 consensus_queue.cc:260] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.673089  1965 consensus_queue.cc:260] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.675788  1965 ts_tablet_manager.cc:1434] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:13:28.676863  1965 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.680661  1966 ts_tablet_manager.cc:1434] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:13:28.681819  1966 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:28.683737  1965 tablet_bootstrap.cc:654] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.697224  1962 tablet_bootstrap.cc:654] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.699015  1968 consensus_queue.cc:1048] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.700160  1966 tablet_bootstrap.cc:654] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.703907  1961 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.704397  1961 ts_tablet_manager.cc:1403] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.028s
I20260709 13:13:28.708245  1961 raft_consensus.cc:359] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.709194  1961 raft_consensus.cc:385] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.709565  1961 raft_consensus.cc:740] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.710032  1967 consensus_queue.cc:1048] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.710479  1961 consensus_queue.cc:260] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.713768  1962 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:28.714377  1962 ts_tablet_manager.cc:1403] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.013s
I20260709 13:13:28.717296  1962 raft_consensus.cc:359] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.720033  1962 raft_consensus.cc:385] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.720235  1967 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.720535  1962 raft_consensus.cc:740] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.726718  1846 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.715715  1961 ts_tablet_manager.cc:1434] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:13:28.728344  1961 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.721557  1967 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.735626  1961 tablet_bootstrap.cc:654] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.737262  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:28.738225  1845 raft_consensus.cc:2468] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:28.739938  1661 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:28.741179  1961 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.741820  1961 ts_tablet_manager.cc:1403] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:13:28.746170  1967 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:28.754613  1961 raft_consensus.cc:359] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.755424  1961 raft_consensus.cc:385] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.755712  1961 raft_consensus.cc:740] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.756794  1961 consensus_queue.cc:260] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.759202  1961 ts_tablet_manager.cc:1434] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:28.725445  1962 consensus_queue.cc:260] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.760069  1968 raft_consensus.cc:493] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.760418  1961 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.760528  1968 raft_consensus.cc:515] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.766038  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9cece044e64d77b14148afae56b5a0" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:28.766672  1697 raft_consensus.cc:2468] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:28.767912  1885 leader_election.cc:304] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.768849  1989 raft_consensus.cc:2804] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.769222  1989 raft_consensus.cc:493] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.769533  1989 raft_consensus.cc:3060] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.773468  2031 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.774220  1983 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.774125  2031 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.774995  1983 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.776952  2031 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:28.777554  2031 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.778196  2031 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.780279  2031 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.781942  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:28.783915  1811 leader_election.cc:343] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.785118  1990 raft_consensus.cc:493] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.784121  1961 tablet_bootstrap.cc:654] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.785722  1990 raft_consensus.cc:515] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.790781  1990 leader_election.cc:290] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:28.777488  1983 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.793475  1961 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.794008  1961 ts_tablet_manager.cc:1403] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 13:13:28.796005  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:28.796904  1961 raft_consensus.cc:359] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.797647  1961 raft_consensus.cc:385] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.797935  1961 raft_consensus.cc:740] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.798180  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:28.800752  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:28.800580  1961 consensus_queue.cc:260] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:28.801263  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:28.801407  1772 raft_consensus.cc:2468] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:28.801885  1920 raft_consensus.cc:2468] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:28.803130  1883 leader_election.cc:304] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.804040  1990 raft_consensus.cc:2804] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.803905  1961 ts_tablet_manager.cc:1434] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:28.804725  1990 raft_consensus.cc:493] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.805214  1990 raft_consensus.cc:3060] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:28.804352  1661 leader_election.cc:343] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:28.806358  1661 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.810801  1661 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:28.803925  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:28.815624  1990 raft_consensus.cc:515] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.816185  1920 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:28.808193  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:28.817780  1990 leader_election.cc:290] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:28.817982  1772 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:28.809005  1968 leader_election.cc:290] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.809630  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9cece044e64d77b14148afae56b5a0" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:28.819325  1660 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:28.753093  2028 consensus_queue.cc:1048] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:28.805673  1961 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:28.821902  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:28.822532  1769 raft_consensus.cc:3060] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.823385  2028 raft_consensus.cc:2804] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.823905  2028 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.824316  2028 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.828723  2031 raft_consensus.cc:2804] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.829079  2031 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.829394  2031 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.829763  1961 tablet_bootstrap.cc:654] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.813892  1989 raft_consensus.cc:515] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.817031  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:28.747249  2032 raft_consensus.cc:2804] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.842913  1981 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.850330  1965 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:28.859485  1981 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:28.860868  1883 leader_election.cc:343] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.844233  1968 raft_consensus.cc:493] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.864986  1769 raft_consensus.cc:2468] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:28.853770  2032 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.876199  1983 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.876796  1989 leader_election.cc:290] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.878774  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9cece044e64d77b14148afae56b5a0" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:28.879475  1968 raft_consensus.cc:515] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:28.881682  1883 consensus_peers.cc:597] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.881999  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9cece044e64d77b14148afae56b5a0" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:28.882656  1770 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:28.883471  1981 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:28.885180  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:28.888129  1962 ts_tablet_manager.cc:1434] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.000s
I20260709 13:13:28.890671  1965 ts_tablet_manager.cc:1403] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.005s
I20260709 13:13:28.915823  1962 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:28.891750  2032 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.901132  1697 raft_consensus.cc:3060] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.917449  1846 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:28.921325  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:28.922487  1736 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
W20260709 13:13:28.923112  1737 leader_election.cc:343] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.923480  1981 raft_consensus.cc:2804] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:28.923859  1981 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.924160  1981 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:28.925768  1990 raft_consensus.cc:493] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.926299  1990 raft_consensus.cc:515] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.926870  1883 leader_election.cc:304] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.900264  1983 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.930624  1990 leader_election.cc:290] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:28.931097  1968 leader_election.cc:290] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:28.938304  1983 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:28.939410  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:28.940088  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:28.941039  1809 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:28.941874  1811 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.942523  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:28.942483  1811 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:28.943462  1697 raft_consensus.cc:2468] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:28.958288  1965 raft_consensus.cc:359] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:28.959236  1965 raft_consensus.cc:385] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.959617  1965 raft_consensus.cc:740] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.960587  1965 consensus_queue.cc:260] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
W20260709 13:13:28.970646  1885 leader_election.cc:343] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.971799  1885 leader_election.cc:304] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:28.975210  1965 ts_tablet_manager.cc:1434] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:13:28.976672  1965 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:28.987721  1961 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:28.988245  1961 ts_tablet_manager.cc:1403] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.007s
I20260709 13:13:28.989192  2015 consensus_queue.cc:1048] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.991171  1961 raft_consensus.cc:359] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.991926  1961 raft_consensus.cc:385] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.992257  1961 raft_consensus.cc:740] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.992676  2028 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:28.993089  1961 consensus_queue.cc:260] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:28.996083  1966 tablet_bootstrap.cc:492] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:28.996618  1966 ts_tablet_manager.cc:1403] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.315s	user 0.053s	sys 0.081s
I20260709 13:13:28.947232  1990 raft_consensus.cc:2804] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:28.950251  1983 raft_consensus.cc:2749] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.003053  1962 tablet_bootstrap.cc:654] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.013417  1961 ts_tablet_manager.cc:1434] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:13:29.015683  1961 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
W20260709 13:13:29.013245  1883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 86473us
W20260709 13:13:29.017839  1883 leader_election.cc:343] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.007166  2031 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.018085  1966 raft_consensus.cc:359] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.018947  1966 raft_consensus.cc:385] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.019263  1966 raft_consensus.cc:740] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.020078  1966 consensus_queue.cc:260] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.020095  2031 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.020179  2032 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.021735  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.015547  1983 raft_consensus.cc:493] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.022496  1983 raft_consensus.cc:515] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.023193  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.023701  2032 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.023814  1919 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.025068  1983 leader_election.cc:290] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.025722  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.028193  2028 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.029565  1981 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.030272  1809 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.030990  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.031648  1981 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.032043  1771 raft_consensus.cc:2393] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:29.031544  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a09118e3c24ab680616b74c499467f" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.033000  1770 raft_consensus.cc:2468] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:29.033771  2028 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.035097  1917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.038615  1961 tablet_bootstrap.cc:654] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.034289  2028 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.037456  1983 raft_consensus.cc:2804] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.046526  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.047152  1916 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.040015  1661 leader_election.cc:343] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.052688  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.053390  1770 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.055308  1919 raft_consensus.cc:2468] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.043708  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.050262  2044 raft_consensus.cc:2804] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.045168  1983 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.056501  2044 raft_consensus.cc:697] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:29.056677  1916 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.052173  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.057633  2044 consensus_queue.cc:237] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.058704  1844 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.060981  1965 tablet_bootstrap.cc:654] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.052137  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:29.039793  1990 raft_consensus.cc:697] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
W20260709 13:13:29.053375  1661 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:29.064507  1737 leader_election.cc:343] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.056561  1983 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.067466  2028 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.068020  1966 ts_tablet_manager.cc:1434] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:13:29.077628  1966 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.080446  1843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.061931  1883 leader_election.cc:304] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:29.068650  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.082937  1771 raft_consensus.cc:2468] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:29.084407  1660 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:29.085259  2032 raft_consensus.cc:2804] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.085635  2032 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.085951  2032 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.086380  1966 tablet_bootstrap.cc:654] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.093317  2046 raft_consensus.cc:2804] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.094152  2046 raft_consensus.cc:493] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.094556  2046 raft_consensus.cc:3060] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.078231  1661 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:29.095929  2028 raft_consensus.cc:2804] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.096184  1661 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.096596  2028 raft_consensus.cc:697] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:29.097236  2031 raft_consensus.cc:2804] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.097716  2031 raft_consensus.cc:697] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
W20260709 13:13:29.097971  1661 leader_election.cc:343] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.098543  2031 consensus_queue.cc:237] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.100916  1990 consensus_queue.cc:237] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.102607  2028 consensus_queue.cc:237] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.103346  2032 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.110039  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.110729  1842 raft_consensus.cc:3060] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.109665  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a09118e3c24ab680616b74c499467f" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.111496  1841 raft_consensus.cc:2468] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:29.114727  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.115496  1771 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.115700  1962 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.116392  1962 ts_tablet_manager.cc:1403] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.201s	user 0.016s	sys 0.009s
I20260709 13:13:29.118683  1843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49403423e3f14ee3b8a3680660ceb467" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.119719  1962 raft_consensus.cc:359] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.120563  1962 raft_consensus.cc:385] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.120877  1962 raft_consensus.cc:740] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.121105  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.124305  1981 consensus_queue.cc:1048] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:29.130333  1661 leader_election.cc:343] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.104537  1770 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.110576  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:29.140450  1884 leader_election.cc:343] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.140905  1884 leader_election.cc:304] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.074613  1844 raft_consensus.cc:2468] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.141875  2036 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.142414  1967 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.142576  1661 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:29.143179  1967 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.143922  1842 raft_consensus.cc:2468] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:29.143666  2040 raft_consensus.cc:2804] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.121658  1962 consensus_queue.cc:260] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.144574  1989 raft_consensus.cc:2749] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.142272  2032 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.145864  1967 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.161753  1962 ts_tablet_manager.cc:1434] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:13:29.163098  1962 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.170948  1962 tablet_bootstrap.cc:654] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.142416  2036 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.159317  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.180799  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.192900  1920 raft_consensus.cc:2468] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
W20260709 13:13:29.204428  1661 leader_election.cc:343] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.201188  1983 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.228086  1965 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.228637  1965 ts_tablet_manager.cc:1403] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.252s	user 0.016s	sys 0.014s
I20260709 13:13:29.229789  1846 raft_consensus.cc:2393] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:29.224078  2040 raft_consensus.cc:697] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:29.230225  1771 raft_consensus.cc:2468] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.239815  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.241420  1660 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.245822  1736 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.247002  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:29.247991  1981 raft_consensus.cc:2749] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:29.248515  1811 leader_election.cc:343] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.241447  1810 leader_election.cc:304] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:29.236608  1966 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.249969  1965 raft_consensus.cc:359] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.251801  1966 ts_tablet_manager.cc:1403] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.175s	user 0.030s	sys 0.013s
I20260709 13:13:29.252103  1965 raft_consensus.cc:385] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.252982  1965 raft_consensus.cc:740] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
W20260709 13:13:29.250535  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:29.250111  2051 raft_consensus.cc:2749] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.254944  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.255748  1770 raft_consensus.cc:2393] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:29.255571  2046 raft_consensus.cc:515] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.256829  1809 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.257733  2051 raft_consensus.cc:2749] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.258387  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a09118e3c24ab680616b74c499467f" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.259166  1770 raft_consensus.cc:3060] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.259342  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a09118e3c24ab680616b74c499467f" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.259986  1846 raft_consensus.cc:3060] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.260272  1660 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.245851  1983 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.261487  2036 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.262221  2036 raft_consensus.cc:493] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.262624  2046 leader_election.cc:290] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.262643  2036 raft_consensus.cc:515] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.229090  1661 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.264400  2031 raft_consensus.cc:2804] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.264789  2031 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.265153  2031 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.266013  2036 leader_election.cc:290] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.268617  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.269282  2059 raft_consensus.cc:2804] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.270424  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.273424  1966 raft_consensus.cc:359] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.271124  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.274114  1966 raft_consensus.cc:385] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.274363  1845 raft_consensus.cc:2468] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:29.274446  1966 raft_consensus.cc:740] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.275710  2059 raft_consensus.cc:697] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:29.275300  1966 consensus_queue.cc:260] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:29.276410  1661 leader_election.cc:343] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.277544  1966 ts_tablet_manager.cc:1434] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:13:29.278533  1965 consensus_queue.cc:260] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.279100  1966 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.277201  2040 consensus_queue.cc:237] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.277324  2059 consensus_queue.cc:237] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.272029  1770 raft_consensus.cc:2468] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:29.281282  1661 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
W20260709 13:13:29.282487  1661 leader_election.cc:343] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.283106  1661 leader_election.cc:304] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.284833  1962 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.285158  2036 raft_consensus.cc:2804] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.290475  2028 raft_consensus.cc:2749] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.290763  2036 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.291339  2036 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.285977  1966 tablet_bootstrap.cc:654] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.288161  1846 raft_consensus.cc:2468] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:29.288946  1965 ts_tablet_manager.cc:1434] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:13:29.290416  1962 ts_tablet_manager.cc:1403] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.016s
I20260709 13:13:29.293749  1965 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.294785  1961 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.295445  1961 ts_tablet_manager.cc:1403] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.281s	user 0.021s	sys 0.013s
I20260709 13:13:29.302877  1592 catalog_manager.cc:5697] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.298688  1883 leader_election.cc:304] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:29.307727  1990 raft_consensus.cc:2804] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.308209  1990 raft_consensus.cc:697] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:29.308854  1990 consensus_queue.cc:237] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.301003  1593 catalog_manager.cc:5697] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.313125  1965 tablet_bootstrap.cc:654] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.299438  1983 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.316172  1983 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.317448  1961 raft_consensus.cc:359] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.318339  1961 raft_consensus.cc:385] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.318663  1961 raft_consensus.cc:740] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.319734  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.319866  1961 consensus_queue.cc:260] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.320703  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.321511  1770 raft_consensus.cc:2393] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:29.323087  1961 ts_tablet_manager.cc:1434] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:13:29.323062  1809 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.324301  2051 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.326949  1961 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.324321  1983 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.333318  1965 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.333613  1966 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.333418  1962 raft_consensus.cc:359] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.333885  1965 ts_tablet_manager.cc:1403] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:13:29.334304  1966 ts_tablet_manager.cc:1403] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.018s
I20260709 13:13:29.336609  1965 raft_consensus.cc:359] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.337323  1965 raft_consensus.cc:385] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.337600  1965 raft_consensus.cc:740] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.337975  1966 raft_consensus.cc:359] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.339244  1966 raft_consensus.cc:385] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.339632  1966 raft_consensus.cc:740] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.340767  1966 consensus_queue.cc:260] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.341886  1965 consensus_queue.cc:260] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.343971  1966 ts_tablet_manager.cc:1434] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:29.345310  1966 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.348960  1962 raft_consensus.cc:385] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.349378  1962 raft_consensus.cc:740] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.350891  2051 raft_consensus.cc:2749] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.352214  1965 ts_tablet_manager.cc:1434] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:29.351783  2031 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.355000  1965 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.362592  1965 tablet_bootstrap.cc:654] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.350414  1962 consensus_queue.cc:260] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.364671  2031 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.364979  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
W20260709 13:13:29.370018  1661 leader_election.cc:343] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.374392  2036 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.365715  1962 ts_tablet_manager.cc:1434] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:13:29.366340  1990 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.376675  1962 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.376287  1990 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.378006  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.378624  1770 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.366596  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.367620  1966 tablet_bootstrap.cc:654] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.368458  1961 tablet_bootstrap.cc:654] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.386521  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.381983  1918 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.391448  1885 leader_election.cc:343] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.392331  1990 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.394274  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:29.396080  1883 leader_election.cc:343] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.396795  1883 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.398260  1990 raft_consensus.cc:2749] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.399475  1962 tablet_bootstrap.cc:654] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.400101  2015 raft_consensus.cc:493] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.403594  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.404816  1846 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.410511  1918 raft_consensus.cc:2468] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.400838  1770 raft_consensus.cc:2468] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.403574  2015 raft_consensus.cc:515] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.401917  2036 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:29.414894  1846 raft_consensus.cc:2468] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:29.414915  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.415638  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f635924519644d2b33d03b432f2f0dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.416358  1661 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:29.417299  2036 raft_consensus.cc:2804] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.417824  1736 leader_election.cc:304] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:29.413702  2015 leader_election.cc:290] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.418176  2036 raft_consensus.cc:697] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:29.419365  2014 raft_consensus.cc:2749] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.420682  2036 consensus_queue.cc:237] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.428197  1966 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.428123  1661 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.428743  1966 ts_tablet_manager.cc:1403] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.002s
I20260709 13:13:29.429296  2031 raft_consensus.cc:2804] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.429823  2031 raft_consensus.cc:697] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:29.430689  2031 consensus_queue.cc:237] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.431558  1966 raft_consensus.cc:359] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.432207  1966 raft_consensus.cc:385] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.432469  1966 raft_consensus.cc:740] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.433205  1966 consensus_queue.cc:260] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.435796  1966 ts_tablet_manager.cc:1434] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:29.437940  1965 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.438172  1961 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.438582  1965 ts_tablet_manager.cc:1403] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.084s	user 0.034s	sys 0.035s
I20260709 13:13:29.438849  1961 ts_tablet_manager.cc:1403] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.000s
I20260709 13:13:29.442111  1965 raft_consensus.cc:359] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.442960  1965 raft_consensus.cc:385] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.443213  1965 raft_consensus.cc:740] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.444054  1965 consensus_queue.cc:260] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.444510  1961 raft_consensus.cc:359] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.445506  1961 raft_consensus.cc:385] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.445856  1961 raft_consensus.cc:740] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.448962  1961 consensus_queue.cc:260] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.450129  1962 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.450767  1962 ts_tablet_manager.cc:1403] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.009s
I20260709 13:13:29.450789  1965 ts_tablet_manager.cc:1434] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:29.452126  1965 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.454905  1966 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.453924  1962 raft_consensus.cc:359] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.456969  2051 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.457058  1962 raft_consensus.cc:385] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.457715  1962 raft_consensus.cc:740] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.458716  1962 consensus_queue.cc:260] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.460220  1965 tablet_bootstrap.cc:654] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.460703  1962 ts_tablet_manager.cc:1434] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:13:29.461705  1962 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.462981  2046 consensus_queue.cc:1048] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.467454  1966 tablet_bootstrap.cc:654] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.457721  2051 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.470330  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.470533  2051 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.471122  1918 raft_consensus.cc:2393] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:29.471799  1962 tablet_bootstrap.cc:654] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.472316  1961 ts_tablet_manager.cc:1434] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:13:29.473512  1961 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.476491  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.479476  1811 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:29.480928  2051 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.482714  1961 tablet_bootstrap.cc:654] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.485507  1962 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.486004  1962 ts_tablet_manager.cc:1403] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:13:29.488758  1962 raft_consensus.cc:359] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.494406  1962 raft_consensus.cc:385] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.494692  1962 raft_consensus.cc:740] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.496451  1962 consensus_queue.cc:260] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.500577  1961 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.501247  1961 ts_tablet_manager.cc:1403] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.001s
I20260709 13:13:29.505093  1770 raft_consensus.cc:3060] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.509680  2051 raft_consensus.cc:2749] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.517082  2046 consensus_queue.cc:1048] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.518785  1961 raft_consensus.cc:359] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.519914  1961 raft_consensus.cc:385] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.520264  1961 raft_consensus.cc:740] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.517948  1965 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.521441  1961 consensus_queue.cc:260] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.522128  1965 ts_tablet_manager.cc:1403] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.002s
I20260709 13:13:29.524698  1961 ts_tablet_manager.cc:1434] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:13:29.525914  1961 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.526541  1592 catalog_manager.cc:5697] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.528103  1965 raft_consensus.cc:359] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.531623  1965 raft_consensus.cc:385] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.531996  1965 raft_consensus.cc:740] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.536195  2036 consensus_queue.cc:1048] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.547817  2036 consensus_queue.cc:1048] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:29.546309  1592 catalog_manager.cc:5697] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.550346  1965 consensus_queue.cc:260] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.553365  1962 ts_tablet_manager.cc:1434] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.001s
I20260709 13:13:29.557341  1966 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.557827  1966 ts_tablet_manager.cc:1403] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.103s	user 0.033s	sys 0.050s
I20260709 13:13:29.557648  2046 consensus_queue.cc:1048] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.560961  1966 raft_consensus.cc:359] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.561718  1966 raft_consensus.cc:385] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.561765  1962 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.562088  1966 raft_consensus.cc:740] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.563014  1966 consensus_queue.cc:260] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.554553  1961 tablet_bootstrap.cc:654] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.565408  1966 ts_tablet_manager.cc:1434] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:29.566414  1966 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.572132  1966 tablet_bootstrap.cc:654] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.572656  1595 catalog_manager.cc:5697] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } }
I20260709 13:13:29.574317  1965 ts_tablet_manager.cc:1434] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:13:29.575528  1965 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.578205  2040 raft_consensus.cc:493] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.578729  2040 raft_consensus.cc:515] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.580996  2040 leader_election.cc:290] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.583918  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.584558  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:29.586426  1661 leader_election.cc:343] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:29.588420  1660 leader_election.cc:343] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.588709  1968 consensus_queue.cc:1048] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.591615  1660 leader_election.cc:304] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:29.596104  1965 tablet_bootstrap.cc:654] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.596575  2031 consensus_queue.cc:1048] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:29.598462  2031 raft_consensus.cc:2749] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.600443  1961 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.600811  1962 tablet_bootstrap.cc:654] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.608198  2051 raft_consensus.cc:493] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.608728  2051 raft_consensus.cc:515] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.610219  1961 ts_tablet_manager.cc:1403] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.005s
I20260709 13:13:29.610849  2051 leader_election.cc:290] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.612411  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1204d86fd546ac9b9805231af432d6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.612990  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1204d86fd546ac9b9805231af432d6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.613528  1918 raft_consensus.cc:2468] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:29.613056  1961 raft_consensus.cc:359] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.614500  1961 raft_consensus.cc:385] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:29.614537  1809 leader_election.cc:343] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.614904  1961 raft_consensus.cc:740] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.615461  1810 leader_election.cc:304] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:29.615623  1961 consensus_queue.cc:260] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.617118  1966 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.617615  1966 ts_tablet_manager.cc:1403] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.028s
I20260709 13:13:29.618911  2051 raft_consensus.cc:2804] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.619268  1962 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.619289  2051 raft_consensus.cc:493] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.619787  1962 ts_tablet_manager.cc:1403] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.002s
I20260709 13:13:29.619874  2051 raft_consensus.cc:3060] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.620162  1966 raft_consensus.cc:359] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.620850  1966 raft_consensus.cc:385] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.621115  1966 raft_consensus.cc:740] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.621718  1966 consensus_queue.cc:260] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.622476  1962 raft_consensus.cc:359] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.623121  1962 raft_consensus.cc:385] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.623363  1962 raft_consensus.cc:740] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.623764  1966 ts_tablet_manager.cc:1434] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:29.624711  1966 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.626296  1962 consensus_queue.cc:260] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.629006  1965 tablet_bootstrap.cc:492] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.629465  1965 ts_tablet_manager.cc:1403] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:13:29.630257  1966 tablet_bootstrap.cc:654] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.630741  2040 consensus_queue.cc:1048] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.630580  2051 raft_consensus.cc:515] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.632107  1965 raft_consensus.cc:359] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.632781  1965 raft_consensus.cc:385] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.633121  1965 raft_consensus.cc:740] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.633546  2051 leader_election.cc:290] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.625909  1961 ts_tablet_manager.cc:1434] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:13:29.633786  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1204d86fd546ac9b9805231af432d6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:29.634985  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f1204d86fd546ac9b9805231af432d6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.635322  1961 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.635578  1920 raft_consensus.cc:3060] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.644783  1962 ts_tablet_manager.cc:1434] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:13:29.648362  1920 raft_consensus.cc:2468] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:29.649025  1962 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.646797  1594 catalog_manager.cc:5697] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.651291  1594 catalog_manager.cc:5697] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.633949  1965 consensus_queue.cc:260] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.655738  1770 raft_consensus.cc:3060] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.657313  1965 ts_tablet_manager.cc:1434] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:13:29.657526  1810 leader_election.cc:304] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:29.658442  1983 raft_consensus.cc:493] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.658885  1983 raft_consensus.cc:515] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.660856  1983 leader_election.cc:290] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.661315  1983 raft_consensus.cc:2804] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.661700  1983 raft_consensus.cc:697] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:29.662868  1965 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.663610  1770 raft_consensus.cc:2468] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:29.663861  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.666297  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.666884  1919 raft_consensus.cc:2468] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
W20260709 13:13:29.668071  1811 leader_election.cc:343] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.669037  1810 leader_election.cc:304] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.669272  1961 tablet_bootstrap.cc:654] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.668299  1594 catalog_manager.cc:5697] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.672554  2036 raft_consensus.cc:493] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.674989  1966 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.674691  2036 raft_consensus.cc:515] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.675449  1966 ts_tablet_manager.cc:1403] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.029s
I20260709 13:13:29.673372  2051 raft_consensus.cc:2804] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.675690  1594 catalog_manager.cc:5697] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.677881  1770 raft_consensus.cc:3060] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.676190  2051 raft_consensus.cc:493] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.678368  2051 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.682832  2036 leader_election.cc:290] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:29.685616  1983 consensus_queue.cc:237] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.685631  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.687151  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:29.687668  1661 leader_election.cc:343] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.688514  1966 raft_consensus.cc:359] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.689167  1966 raft_consensus.cc:385] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.689441  1966 raft_consensus.cc:740] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.691109  1966 consensus_queue.cc:260] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.695376  1966 ts_tablet_manager.cc:1434] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
W20260709 13:13:29.695995  1661 leader_election.cc:343] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.696472  1661 leader_election.cc:304] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:29.697258  2036 raft_consensus.cc:2749] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.698261  1966 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.699872  2036 consensus_queue.cc:1048] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.707741  1966 tablet_bootstrap.cc:654] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.721252  1918 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.722795  1962 tablet_bootstrap.cc:654] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.727494  1965 tablet_bootstrap.cc:654] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.726882  2051 raft_consensus.cc:515] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.743131  2031 consensus_queue.cc:1048] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.748508  1968 raft_consensus.cc:493] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.749262  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:29.749099  1968 raft_consensus.cc:515] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.749924  1920 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.756022  1592 catalog_manager.cc:5697] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.754750  1968 leader_election.cc:290] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.756888  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.766410  1697 raft_consensus.cc:2468] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:29.766490  2031 consensus_queue.cc:1048] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.758586  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:29.767910  1885 leader_election.cc:304] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
W20260709 13:13:29.768466  1884 leader_election.cc:343] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.768796  1968 raft_consensus.cc:2804] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.769174  1968 raft_consensus.cc:493] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.769526  1968 raft_consensus.cc:3060] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.771415  1962 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:29.771893  1962 ts_tablet_manager.cc:1403] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.005s
I20260709 13:13:29.765836  1920 raft_consensus.cc:2468] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:29.774924  2051 leader_election.cc:290] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.775414  1962 raft_consensus.cc:359] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.775111  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:29.786523  1961 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.787184  1961 ts_tablet_manager.cc:1403] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.005s
I20260709 13:13:29.776208  1962 raft_consensus.cc:385] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.775377  1810 leader_election.cc:304] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:29.788311  1962 raft_consensus.cc:740] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
W20260709 13:13:29.789948  1811 leader_election.cc:343] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.790340  1962 consensus_queue.cc:260] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.796782  1965 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.797273  1965 ts_tablet_manager.cc:1403] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.006s
I20260709 13:13:29.794267  2051 raft_consensus.cc:2804] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.798135  2051 raft_consensus.cc:697] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:29.799185  2031 consensus_queue.cc:1048] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.800200  1965 raft_consensus.cc:359] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.800885  1965 raft_consensus.cc:385] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.801151  1965 raft_consensus.cc:740] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.801820  1965 consensus_queue.cc:260] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:29.796223  1961 raft_consensus.cc:359] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.803637  1961 raft_consensus.cc:385] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.803278  2051 consensus_queue.cc:237] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.803871  1965 ts_tablet_manager.cc:1434] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:29.803929  1961 raft_consensus.cc:740] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.804960  1965 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:29.804808  1961 consensus_queue.cc:260] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.809671  1966 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.811182  1965 tablet_bootstrap.cc:654] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.810201  1961 ts_tablet_manager.cc:1434] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:13:29.811334  1966 ts_tablet_manager.cc:1403] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.003s
I20260709 13:13:29.812080  1962 ts_tablet_manager.cc:1434] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:13:29.814220  1961 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.815690  1966 raft_consensus.cc:359] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.816390  1966 raft_consensus.cc:385] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.816709  1966 raft_consensus.cc:740] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.816762  1962 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:29.817425  1966 consensus_queue.cc:260] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.821254  1968 raft_consensus.cc:515] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.821593  2046 consensus_queue.cc:1048] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.828014  1961 tablet_bootstrap.cc:654] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.833688  1966 ts_tablet_manager.cc:1434] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:29.835116  1966 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.836771  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:29.837584  1846 raft_consensus.cc:3060] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.837723  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7887b321a8542bc8499248d7af82425" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:29.838388  1697 raft_consensus.cc:3060] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.837109  1968 leader_election.cc:290] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:29.845535  2036 consensus_queue.cc:1048] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.847177  1846 raft_consensus.cc:2468] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:29.849017  1966 tablet_bootstrap.cc:654] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.849627  1884 leader_election.cc:304] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:29.850633  1697 raft_consensus.cc:2468] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:29.853319  1962 tablet_bootstrap.cc:654] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.880466  1966 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:29.881088  1966 ts_tablet_manager.cc:1403] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.046s	user 0.035s	sys 0.000s
I20260709 13:13:29.859982  1968 raft_consensus.cc:2804] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.887296  1968 raft_consensus.cc:697] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:29.888538  1968 consensus_queue.cc:237] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.890424  1594 catalog_manager.cc:5697] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:29.891553  1661 consensus_peers.cc:597] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:29.887331  1966 raft_consensus.cc:359] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.892380  1966 raft_consensus.cc:385] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.888653  2046 consensus_queue.cc:1048] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:29.892755  1966 raft_consensus.cc:740] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.893616  1966 consensus_queue.cc:260] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.895983  1966 ts_tablet_manager.cc:1434] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:29.896932  1966 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:29.902570  2036 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.903069  2036 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.903677  1961 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:29.904126  1961 ts_tablet_manager.cc:1403] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:13:29.905673  2036 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.907224  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.908180  1919 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:29.908547  1961 raft_consensus.cc:359] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.909194  1961 raft_consensus.cc:385] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.909473  1961 raft_consensus.cc:740] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.909508  1661 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:29.911372  2036 raft_consensus.cc:2804] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.910914  1961 consensus_queue.cc:260] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:29.912097  2036 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.912555  2036 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.913771  1961 ts_tablet_manager.cc:1434] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:29.916235  2059 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.916843  2059 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.918702  1961 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:29.920130  2059 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.926513  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:29.933091  1965 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:29.933729  1965 ts_tablet_manager.cc:1403] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.019s
I20260709 13:13:29.937682  2051 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.938323  2051 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.927080  2059 consensus_queue.cc:1048] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:29.934257  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.941032  2051 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:29.943147  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:29.944432  1966 tablet_bootstrap.cc:654] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:29.949160  1811 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.952943  1961 tablet_bootstrap.cc:654] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.933076  1919 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:29.955225  1661 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:29.956326  2059 raft_consensus.cc:2804] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.956842  2059 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.957263  2059 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:29.960542  1660 leader_election.cc:343] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.961094  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:29.962824  1809 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:29.963501  1809 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:29.965214  2051 raft_consensus.cc:2749] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:29.970700  1965 raft_consensus.cc:359] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.971628  1965 raft_consensus.cc:385] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.971959  1965 raft_consensus.cc:740] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.972810  1965 consensus_queue.cc:260] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:29.976274  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:29.990136  1769 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:29.989300  2059 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:29.976084  1594 catalog_manager.cc:5697] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.998970  1965 ts_tablet_manager.cc:1434] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.002s
I20260709 13:13:29.999823  1965 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:30.001094  1962 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.001521  1962 ts_tablet_manager.cc:1403] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.189s	user 0.009s	sys 0.007s
I20260709 13:13:29.988703  2036 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.006652  1962 raft_consensus.cc:359] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.007287  1962 raft_consensus.cc:385] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.007557  1962 raft_consensus.cc:740] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.008244  1962 consensus_queue.cc:260] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.010872  1962 ts_tablet_manager.cc:1434] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:30.013343  1962 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.018908  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:30.019562  1919 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.021811  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:30.021986  2036 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.022478  1920 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.023069  2059 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.028795  1962 tablet_bootstrap.cc:654] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.031338  1920 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:30.031759  1965 tablet_bootstrap.cc:654] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.034165  1966 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.038642  2046 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.038638  2059 consensus_queue.cc:1048] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.058422  2046 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.060891  2046 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.063180  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.063527  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:30.064672  1883 leader_election.cc:343] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:30.065342  1885 leader_election.cc:343] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.066198  1885 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:30.041414  1961 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.042865  1919 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:30.045172  2014 raft_consensus.cc:493] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.052623  2051 raft_consensus.cc:493] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.053694  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.055310  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.066731  1966 ts_tablet_manager.cc:1403] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.005s
I20260709 13:13:30.067059  1661 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.087780  1661 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
W20260709 13:13:30.088687  1660 leader_election.cc:343] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.088853  1966 raft_consensus.cc:359] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.089650  1966 raft_consensus.cc:385] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.089960  1966 raft_consensus.cc:740] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.090924  2036 raft_consensus.cc:2804] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.072252  2014 raft_consensus.cc:515] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.091459  2036 raft_consensus.cc:697] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:30.091606  2031 raft_consensus.cc:2804] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.092200  2031 raft_consensus.cc:697] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:30.092339  2036 consensus_queue.cc:237] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.092967  2014 leader_election.cc:290] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.073434  1771 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.093051  2031 consensus_queue.cc:237] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.094696  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.095813  2040 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.074718  1961 ts_tablet_manager.cc:1403] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.160s	user 0.003s	sys 0.015s
I20260709 13:13:30.096302  2040 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.096622  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.098434  2040 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.099261  1961 raft_consensus.cc:359] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.099920  1961 raft_consensus.cc:385] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.100116  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.085759  1962 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.100986  1770 raft_consensus.cc:2393] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:30.101109  1962 ts_tablet_manager.cc:1403] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.023s
I20260709 13:13:30.102766  1771 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:30.102725  1983 consensus_queue.cc:1048] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.104353  1962 raft_consensus.cc:359] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.104986  1962 raft_consensus.cc:385] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.105199  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.105371  1962 raft_consensus.cc:740] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.106142  1846 raft_consensus.cc:2393] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:30.090660  1966 consensus_queue.cc:260] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.072590  2051 raft_consensus.cc:515] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.107100  1962 consensus_queue.cc:260] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.107649  1845 raft_consensus.cc:2468] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:30.108780  2051 leader_election.cc:290] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.068748  1968 raft_consensus.cc:2749] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.109915  1962 ts_tablet_manager.cc:1434] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:13:30.110662  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.111258  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.111290  1769 raft_consensus.cc:2468] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:30.112820  1962 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.114085  1661 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:30.115383  1736 leader_election.cc:304] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:30.116509  2028 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.105000  1965 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:30.117390  1965 ts_tablet_manager.cc:1403] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.017s
I20260709 13:13:30.120090  1965 raft_consensus.cc:359] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.120718  1965 raft_consensus.cc:385] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.120966  1965 raft_consensus.cc:740] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.122324  1809 leader_election.cc:304] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:30.123303  1962 tablet_bootstrap.cc:654] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.121639  1983 raft_consensus.cc:493] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.124125  1983 raft_consensus.cc:515] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.126336  2014 raft_consensus.cc:2804] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.126724  2014 raft_consensus.cc:493] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.127081  2014 raft_consensus.cc:3060] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.121639  1965 consensus_queue.cc:260] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.130334  2051 raft_consensus.cc:2804] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.130734  2051 raft_consensus.cc:493] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.131153  2051 raft_consensus.cc:3060] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.141280  1966 ts_tablet_manager.cc:1434] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:13:30.142504  1966 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.146878  1591 catalog_manager.cc:5697] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.100207  1961 raft_consensus.cc:740] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.153842  1961 consensus_queue.cc:260] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.155202  1695 raft_consensus.cc:2468] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:30.156780  1961 ts_tablet_manager.cc:1434] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.003s
I20260709 13:13:30.158841  1966 tablet_bootstrap.cc:654] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.159739  1983 leader_election.cc:290] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.160960  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:30.162240  1810 leader_election.cc:343] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.163432  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:30.165017  1811 leader_election.cc:343] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.165575  1811 leader_election.cc:304] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.166556  1983 raft_consensus.cc:2749] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.180826  1966 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.182082  2046 raft_consensus.cc:493] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.182792  1961 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.183404  1966 ts_tablet_manager.cc:1403] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 13:13:30.183084  2046 raft_consensus.cc:515] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.187987  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.189245  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.190121  1695 raft_consensus.cc:2468] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.191851  1885 leader_election.cc:304] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.192896  1968 raft_consensus.cc:2804] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.193315  1968 raft_consensus.cc:493] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.193708  1968 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:30.197254  1883 leader_election.cc:343] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.206674  2046 leader_election.cc:290] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.213065  2031 raft_consensus.cc:493] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.213757  2031 raft_consensus.cc:515] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.189188  1966 raft_consensus.cc:359] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.243103  1966 raft_consensus.cc:385] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.243448  1966 raft_consensus.cc:740] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.245076  1961 tablet_bootstrap.cc:654] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.247665  1966 consensus_queue.cc:260] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.249140  2031 leader_election.cc:290] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:30.250140  1966 ts_tablet_manager.cc:1434] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.020s
I20260709 13:13:30.251070  1966 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.251571  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.252835  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.253649  1918 raft_consensus.cc:2393] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:30.255861  2121 raft_consensus.cc:493] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.256438  2121 raft_consensus.cc:515] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.246929  2028 raft_consensus.cc:2749] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.267171  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.266440  1966 tablet_bootstrap.cc:654] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.266474  1661 leader_election.cc:304] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:30.271497  2031 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.272795  1990 consensus_queue.cc:1048] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.264868  1965 ts_tablet_manager.cc:1434] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.147s	user 0.035s	sys 0.078s
I20260709 13:13:30.274313  1965 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
W20260709 13:13:30.279057  1736 leader_election.cc:343] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.267784  2014 raft_consensus.cc:515] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.289832  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:30.290520  1697 raft_consensus.cc:3060] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.291177  2128 raft_consensus.cc:493] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.291682  2128 raft_consensus.cc:515] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.295562  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.282531  1968 raft_consensus.cc:515] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.298974  1697 raft_consensus.cc:2468] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:30.300217  1737 leader_election.cc:304] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:30.300365  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
W20260709 13:13:30.300546  1809 leader_election.cc:343] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.300935  1696 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.261971  2051 raft_consensus.cc:515] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.303866  2051 leader_election.cc:290] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.303992  2123 raft_consensus.cc:2804] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.304679  2051 consensus_queue.cc:1048] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.309136  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.309895  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.310375  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
W20260709 13:13:30.310953  1736 leader_election.cc:343] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.311250  1697 raft_consensus.cc:2393] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:30.311440  1736 leader_election.cc:304] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:30.309216  1696 raft_consensus.cc:2468] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:30.312405  2125 raft_consensus.cc:2749] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.313642  1885 leader_election.cc:304] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.314636  2046 raft_consensus.cc:2804] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.314713  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381e5c55f4de4d3997b89df0724ef37d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:30.315455  2046 raft_consensus.cc:697] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:30.315596  1846 raft_consensus.cc:2393] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:30.316390  2046 consensus_queue.cc:237] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.318253  2121 leader_election.cc:290] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:30.320873  2014 leader_election.cc:290] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.326749  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:30.328383  1810 leader_election.cc:343] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.328866  1810 leader_election.cc:304] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.329732  2128 leader_election.cc:290] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:30.330001  1966 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.330514  1966 ts_tablet_manager.cc:1403] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 13:13:30.322885  1968 leader_election.cc:290] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.323104  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.325871  1962 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.330627  2128 raft_consensus.cc:2749] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.331245  1962 ts_tablet_manager.cc:1403] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.220s	user 0.035s	sys 0.024s
W20260709 13:13:30.331710  1883 leader_election.cc:343] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.280872  2031 raft_consensus.cc:2749] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.297937  1965 tablet_bootstrap.cc:654] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.341524  1983 consensus_queue.cc:1048] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.347872  1968 consensus_queue.cc:1048] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:30.346246  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:30.355103  1961 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.355576  1961 ts_tablet_manager.cc:1403] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.008s
I20260709 13:13:30.355943  1965 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:30.356539  1965 ts_tablet_manager.cc:1403] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.002s
I20260709 13:13:30.356825  1594 catalog_manager.cc:5697] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.366206  2123 raft_consensus.cc:697] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:30.368232  2123 consensus_queue.cc:237] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.369527  2128 consensus_queue.cc:1048] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.374382  1966 raft_consensus.cc:359] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.375286  1966 raft_consensus.cc:385] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.375622  1966 raft_consensus.cc:740] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.376466  1966 consensus_queue.cc:260] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.379498  1966 ts_tablet_manager.cc:1434] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:13:30.380694  1966 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.389026  1962 raft_consensus.cc:359] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.389933  1962 raft_consensus.cc:385] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.390221  1962 raft_consensus.cc:740] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.391191  1962 consensus_queue.cc:260] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.393621  1962 ts_tablet_manager.cc:1434] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:13:30.394793  1962 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.394948  1965 raft_consensus.cc:359] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.395969  1965 raft_consensus.cc:385] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.396314  1965 raft_consensus.cc:740] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.397205  1965 consensus_queue.cc:260] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.400012  1965 ts_tablet_manager.cc:1434] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:13:30.401154  1965 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:30.403674  1962 tablet_bootstrap.cc:654] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.413635  1961 raft_consensus.cc:359] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.415169  1961 raft_consensus.cc:385] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.415442  1961 raft_consensus.cc:740] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.416085  1961 consensus_queue.cc:260] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.417971  1809 leader_election.cc:304] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:30.419180  2131 raft_consensus.cc:2749] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.421942  1966 tablet_bootstrap.cc:654] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.423851  1961 ts_tablet_manager.cc:1434] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 13:13:30.424916  1961 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.432452  1965 tablet_bootstrap.cc:654] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.435447  1961 tablet_bootstrap.cc:654] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.441593  1966 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.442090  1966 ts_tablet_manager.cc:1403] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:13:30.443058  1591 catalog_manager.cc:5697] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.444607  1966 raft_consensus.cc:359] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.445307  1966 raft_consensus.cc:385] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.445585  1966 raft_consensus.cc:740] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.446357  1966 consensus_queue.cc:260] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.448493  1966 ts_tablet_manager.cc:1434] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:13:30.449368  1966 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.452170  1962 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.452638  1962 ts_tablet_manager.cc:1403] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 13:13:30.457067  1966 tablet_bootstrap.cc:654] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.465226  1962 raft_consensus.cc:359] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.466259  1962 raft_consensus.cc:385] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.466609  1962 raft_consensus.cc:740] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.470085  1594 catalog_manager.cc:5697] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.494867  2123 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.495473  2123 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.497725  2123 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.500516  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.504078  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:30.510097  1737 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:30.510820  1736 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.511387  1736 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.512957  2123 raft_consensus.cc:2749] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.514266  1962 consensus_queue.cc:260] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.519459  2059 consensus_queue.cc:1048] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.529651  2059 consensus_queue.cc:1048] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.531399  1983 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.531967  1983 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.534135  1983 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:30.535233  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:30.536662  1810 leader_election.cc:343] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.538995  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:30.541597  1809 leader_election.cc:343] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.542238  1809 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.544674  1983 raft_consensus.cc:2749] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.547410  1962 ts_tablet_manager.cc:1434] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 13:13:30.548768  1962 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.561767  2123 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.562368  2123 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.563509  1961 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.564164  1961 ts_tablet_manager.cc:1403] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.139s	user 0.066s	sys 0.048s
I20260709 13:13:30.564313  2123 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.567302  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.568225  1919 raft_consensus.cc:2393] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:30.569659  1966 tablet_bootstrap.cc:492] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.569603  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.573093  1962 tablet_bootstrap.cc:654] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.579087  1737 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.580231  2123 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.581004  1965 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:30.581620  1965 ts_tablet_manager.cc:1403] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.181s	user 0.035s	sys 0.057s
I20260709 13:13:30.570281  1966 ts_tablet_manager.cc:1403] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.042s
I20260709 13:13:30.587327  1965 raft_consensus.cc:359] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.589754  1965 raft_consensus.cc:385] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.590242  1965 raft_consensus.cc:740] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.591212  1965 consensus_queue.cc:260] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.593436  1965 ts_tablet_manager.cc:1434] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:13:30.597465  2123 raft_consensus.cc:2749] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.602238  1961 raft_consensus.cc:359] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.602859  1961 raft_consensus.cc:385] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.603075  1961 raft_consensus.cc:740] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.604910  1961 consensus_queue.cc:260] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.609416  1962 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.609653  1961 ts_tablet_manager.cc:1434] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:13:30.604542  2123 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.611469  1962 ts_tablet_manager.cc:1403] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.018s
I20260709 13:13:30.612349  1961 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.614974  1962 raft_consensus.cc:359] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.610883  1965 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:30.619520  1961 tablet_bootstrap.cc:654] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.619990  1962 raft_consensus.cc:385] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.620286  1962 raft_consensus.cc:740] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.618424  2123 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.630170  1966 raft_consensus.cc:359] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.632686  1966 raft_consensus.cc:385] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.633002  1966 raft_consensus.cc:740] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.624090  2059 consensus_queue.cc:1048] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:13:30.633824  1966 consensus_queue.cc:260] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.638793  1965 tablet_bootstrap.cc:654] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.639737  1962 consensus_queue.cc:260] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.641885  1962 ts_tablet_manager.cc:1434] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:13:30.642793  1962 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.649354  2123 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:30.650347  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.651090  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:30.651835  1736 leader_election.cc:343] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:30.652535  1736 leader_election.cc:343] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.652908  1736 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:30.653996  2123 raft_consensus.cc:2749] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.654234  1962 tablet_bootstrap.cc:654] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.658598  1983 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.659273  1983 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.662894  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.663511  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:30.664572  1810 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:30.665360  1811 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.665972  1811 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.667001  2131 raft_consensus.cc:2749] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.661934  1983 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.670411  1966 ts_tablet_manager.cc:1434] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:13:30.673137  1962 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.673770  1962 ts_tablet_manager.cc:1403] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
I20260709 13:13:30.676934  1962 raft_consensus.cc:359] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.677559  1962 raft_consensus.cc:385] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.677798  1962 raft_consensus.cc:740] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.678519  1962 consensus_queue.cc:260] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.680546  1962 ts_tablet_manager.cc:1434] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:30.682474  2059 consensus_queue.cc:1048] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.689838  1962 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.696110  1961 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.696512  1961 ts_tablet_manager.cc:1403] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.085s	user 0.044s	sys 0.018s
I20260709 13:13:30.696935  1983 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.697431  1983 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.685505  1966 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.699461  1983 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.699203  1961 raft_consensus.cc:359] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.701330  1961 raft_consensus.cc:385] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.701658  1961 raft_consensus.cc:740] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.701483  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.702632  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.703043  1961 consensus_queue.cc:260] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:30.704334  1811 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.704563  1966 tablet_bootstrap.cc:654] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.704730  2040 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.705334  1961 ts_tablet_manager.cc:1434] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:30.705188  2040 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
W20260709 13:13:30.706029  1809 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.706518  1961 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.706491  1809 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:30.705332  2046 raft_consensus.cc:493] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.707417  2040 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.707768  1962 tablet_bootstrap.cc:654] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.707850  2046 raft_consensus.cc:515] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.727524  2046 leader_election.cc:290] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.711354  1983 raft_consensus.cc:2749] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.728248  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.728929  1846 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.729554  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.730240  1695 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.730434  1884 leader_election.cc:304] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:30.731381  2046 raft_consensus.cc:2804] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.731741  2046 raft_consensus.cc:493] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.732062  2046 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.712881  1961 tablet_bootstrap.cc:654] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.714393  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.734359  1919 raft_consensus.cc:2468] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:30.716693  1965 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:30.735582  1965 ts_tablet_manager.cc:1403] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.011s
I20260709 13:13:30.739207  1968 consensus_queue.cc:1048] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.719182  1966 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.719605  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.741201  1966 ts_tablet_manager.cc:1403] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.009s
W20260709 13:13:30.741537  1660 leader_election.cc:343] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.746547  1661 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:30.748772  2040 raft_consensus.cc:2804] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.749217  2040 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.749590  2040 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.744102  1966 raft_consensus.cc:359] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.750975  1966 raft_consensus.cc:385] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.751271  1966 raft_consensus.cc:740] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.751971  1966 consensus_queue.cc:260] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.754402  1966 ts_tablet_manager.cc:1434] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:30.742440  1965 raft_consensus.cc:359] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.750260  1962 tablet_bootstrap.cc:492] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.755101  1962 ts_tablet_manager.cc:1403] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.008s
I20260709 13:13:30.757831  1962 raft_consensus.cc:359] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.758621  1962 raft_consensus.cc:385] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.758936  1962 raft_consensus.cc:740] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.759701  1965 raft_consensus.cc:385] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.760048  1965 raft_consensus.cc:740] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.760885  1965 consensus_queue.cc:260] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.761930  1962 consensus_queue.cc:260] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.764366  1962 ts_tablet_manager.cc:1434] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:30.765400  2046 raft_consensus.cc:515] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.766251  1965 ts_tablet_manager.cc:1434] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:13:30.769975  1961 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.767407  1966 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:30.770489  1961 ts_tablet_manager.cc:1403] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.016s
I20260709 13:13:30.770711  1965 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:30.773087  1961 raft_consensus.cc:359] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.773705  1961 raft_consensus.cc:385] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.773974  1961 raft_consensus.cc:740] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.774633  1961 consensus_queue.cc:260] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.775830  1966 tablet_bootstrap.cc:654] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.776594  1961 ts_tablet_manager.cc:1434] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:30.777554  1961 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.778102  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:30.778687  1846 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.768428  2040 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.769306  1962 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:30.782960  1961 tablet_bootstrap.cc:654] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.785840  1846 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:30.787148  1962 tablet_bootstrap.cc:654] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.787086  1884 leader_election.cc:304] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:30.788439  1968 raft_consensus.cc:2804] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.789135  1968 raft_consensus.cc:697] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:30.790072  1968 consensus_queue.cc:237] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.790900  2040 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:30.792644  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
W20260709 13:13:30.798532  1660 leader_election.cc:343] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.802628  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:30.803499  1919 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:30.808125  1883 consensus_peers.cc:597] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:30.810413  2123 consensus_queue.cc:1048] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:30.812752  1990 raft_consensus.cc:493] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.813446  1990 raft_consensus.cc:515] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.819880  1990 leader_election.cc:290] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.823033  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.826766  1845 raft_consensus.cc:2468] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.824803  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.825981  1968 raft_consensus.cc:493] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.828575  1968 raft_consensus.cc:515] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.831045  2131 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.831534  2131 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.832173  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:30.832985  1771 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.834092  2131 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.834537  1883 leader_election.cc:304] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.828253  1770 raft_consensus.cc:2468] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.836129  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.841771  1883 leader_election.cc:304] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.843914  1990 raft_consensus.cc:2804] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.844492  1990 raft_consensus.cc:493] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.845000  1990 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.856010  1965 tablet_bootstrap.cc:654] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.860735  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:30.861596  1696 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.838798  1919 raft_consensus.cc:2468] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:30.898006  1594 catalog_manager.cc:5697] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.904137  1696 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:30.896119  2046 leader_election.cc:290] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.914104  2166 raft_consensus.cc:2804] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:30.914695  2166 raft_consensus.cc:493] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.915143  2166 raft_consensus.cc:3060] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.926719  2167 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.927433  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:30.927778  2164 raft_consensus.cc:493] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.928731  1961 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:30.928565  2164 raft_consensus.cc:515] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.929265  1961 ts_tablet_manager.cc:1403] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.152s	user 0.051s	sys 0.069s
I20260709 13:13:30.940712  1961 raft_consensus.cc:359] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.941520  1961 raft_consensus.cc:385] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.941924  1961 raft_consensus.cc:740] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.942183  2166 raft_consensus.cc:515] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.942734  1961 consensus_queue.cc:260] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:30.943080  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.944029  1845 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:30.945150  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.945380  1961 ts_tablet_manager.cc:1434] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:13:30.945742  1770 raft_consensus.cc:3060] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.946606  1961 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:30.934129  1968 leader_election.cc:290] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.939936  1810 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:30.959004  1962 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:30.959713  1962 ts_tablet_manager.cc:1403] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.191s	user 0.042s	sys 0.026s
I20260709 13:13:30.960762  1990 raft_consensus.cc:515] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.962206  2131 raft_consensus.cc:2749] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:30.934331  1661 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:30.963008  1962 raft_consensus.cc:359] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.964540  1962 raft_consensus.cc:385] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:30.964859  1962 raft_consensus.cc:740] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:30.932261  2167 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:30.984272  1966 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:30.984784  1966 ts_tablet_manager.cc:1403] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.218s	user 0.052s	sys 0.046s
I20260709 13:13:30.985692  2167 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.981627  1770 raft_consensus.cc:2468] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:30.987203  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.987463  1883 leader_election.cc:304] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:30.988135  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7367c106e34612bcfd73ecbf29dc01" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:30.988745  1839 raft_consensus.cc:3060] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:30.990991  1885 leader_election.cc:343] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:30.971369  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.973628  2132 consensus_queue.cc:1048] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.975519  2164 leader_election.cc:290] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:30.993844  2164 raft_consensus.cc:2804] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:30.994338  2164 raft_consensus.cc:697] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:30.995184  2164 consensus_queue.cc:237] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.996608  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:30.997555  1839 raft_consensus.cc:2468] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:30.997815  1990 leader_election.cc:290] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.998867  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:30.999610  1770 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.999714  2028 raft_consensus.cc:493] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.000221  2028 raft_consensus.cc:515] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:30.977293  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 45989.1us
I20260709 13:13:30.978118  2040 raft_consensus.cc:2804] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.002107  2040 raft_consensus.cc:697] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:31.002988  2040 consensus_queue.cc:237] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.003453  2028 leader_election.cc:290] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.004325  2028 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.004739  2028 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:30.978282  1961 tablet_bootstrap.cc:654] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:30.979789  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:30.983212  1962 consensus_queue.cc:260] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:30.969564  2166 leader_election.cc:290] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:30.989856  1966 raft_consensus.cc:359] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.008411  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.014768  1962 ts_tablet_manager.cc:1434] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:13:31.010161  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.015767  1962 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:31.010488  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.011543  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.017136  2040 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.014667  1845 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:31.013372  1966 raft_consensus.cc:385] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.017760  2040 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.018144  1966 raft_consensus.cc:740] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.006664  2028 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.013125  1697 raft_consensus.cc:2468] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:31.018940  1966 consensus_queue.cc:260] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.020073  2040 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:31.018930  1661 leader_election.cc:343] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:31.013617  1884 leader_election.cc:343] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.021224  1966 ts_tablet_manager.cc:1434] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:13:31.021700  1885 leader_election.cc:304] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:31.022562  1966 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.022866  1968 raft_consensus.cc:2804] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.023257  1968 raft_consensus.cc:493] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.023664  1968 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.026130  1962 tablet_bootstrap.cc:654] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.028350  1770 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
W20260709 13:13:31.019068  1660 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.029641  1883 leader_election.cc:304] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.030690  2167 raft_consensus.cc:2804] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.031514  1661 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:31.033528  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.031520  2167 raft_consensus.cc:697] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:31.035705  2040 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.036127  2040 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:31.031689  1884 leader_election.cc:343] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.036644  1884 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:31.036444  2167 consensus_queue.cc:237] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
W20260709 13:13:31.038344  1660 leader_election.cc:343] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.039078  2166 raft_consensus.cc:2749] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:31.039089  1661 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.038072  1968 raft_consensus.cc:515] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.041671  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.042287  1845 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.043255  1966 tablet_bootstrap.cc:654] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.033669  1965 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.045125  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:31.045502  1968 leader_election.cc:290] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.045709  1697 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.045683  1965 ts_tablet_manager.cc:1403] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.275s	user 0.012s	sys 0.010s
I20260709 13:13:31.051193  1845 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:31.039255  1660 leader_election.cc:304] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:31.055725  1697 raft_consensus.cc:2468] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:31.056030  1965 raft_consensus.cc:359] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.056715  1965 raft_consensus.cc:385] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.056986  1965 raft_consensus.cc:740] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.057200  2028 raft_consensus.cc:2749] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.057060  1885 leader_election.cc:304] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.036482  2040 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.058115  2166 raft_consensus.cc:2804] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.058773  2166 raft_consensus.cc:697] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:31.059823  2166 consensus_queue.cc:237] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.062875  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.063524  1770 raft_consensus.cc:2468] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:31.057665  1965 consensus_queue.cc:260] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.085875  1660 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.088809  2059 raft_consensus.cc:2804] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.089449  2059 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.089901  2059 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.100466  1961 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.101146  1961 ts_tablet_manager.cc:1403] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.155s	user 0.010s	sys 0.002s
I20260709 13:13:31.118552  1965 ts_tablet_manager.cc:1434] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.005s
I20260709 13:13:31.119488  1965 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.140343  1965 tablet_bootstrap.cc:654] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.142733  1594 catalog_manager.cc:5697] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.145423  1961 raft_consensus.cc:359] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.145249  1594 catalog_manager.cc:5697] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.148787  1961 raft_consensus.cc:385] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.149302  1961 raft_consensus.cc:740] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.153228  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.151820  2040 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.150873  2059 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.160776  1966 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.161300  1966 ts_tablet_manager.cc:1403] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.139s	user 0.030s	sys 0.031s
W20260709 13:13:31.161707  1884 leader_election.cc:343] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.164016  1966 raft_consensus.cc:359] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.164717  1966 raft_consensus.cc:385] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.165022  1966 raft_consensus.cc:740] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.165222  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:31.165676  1966 consensus_queue.cc:260] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
W20260709 13:13:31.167109  1661 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.167822  1966 ts_tablet_manager.cc:1434] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:31.168754  1966 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.168391  1961 consensus_queue.cc:260] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.171388  1961 ts_tablet_manager.cc:1434] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:13:31.172556  1961 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.174340  2040 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.174772  2059 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.175139  1966 tablet_bootstrap.cc:654] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.180233  2167 consensus_queue.cc:1048] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:31.181743  1961 tablet_bootstrap.cc:654] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.182853  1965 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.183419  1965 ts_tablet_manager.cc:1403] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.022s
I20260709 13:13:31.186837  1965 raft_consensus.cc:359] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.187770  1965 raft_consensus.cc:385] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.188129  1965 raft_consensus.cc:740] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.188805  1965 consensus_queue.cc:260] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.191387  1965 ts_tablet_manager.cc:1434] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:31.192698  1965 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.195441  1966 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.196201  1966 ts_tablet_manager.cc:1403] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 13:13:31.194634  1594 catalog_manager.cc:5697] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.198999  1966 raft_consensus.cc:359] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.199651  1966 raft_consensus.cc:385] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.199918  1966 raft_consensus.cc:740] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.200577  1966 consensus_queue.cc:260] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.202652  1966 ts_tablet_manager.cc:1434] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:31.204078  1961 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.204382  1966 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.204555  1961 ts_tablet_manager.cc:1403] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 13:13:31.207664  1965 tablet_bootstrap.cc:654] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.210701  1966 tablet_bootstrap.cc:654] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.219493  1965 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.220048  1965 ts_tablet_manager.cc:1403] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:13:31.207620  1961 raft_consensus.cc:359] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.221079  1961 raft_consensus.cc:385] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.221372  1961 raft_consensus.cc:740] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.222172  1961 consensus_queue.cc:260] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.223158  1965 raft_consensus.cc:359] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.223950  1965 raft_consensus.cc:385] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.225554  1961 ts_tablet_manager.cc:1434] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:31.225641  1965 raft_consensus.cc:740] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.226552  1965 consensus_queue.cc:260] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.228911  1965 ts_tablet_manager.cc:1434] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:13:31.229872  1965 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.230890  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.231505  1846 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.231838  1961 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.232335  2059 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.232465  1962 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:31.236182  1962 ts_tablet_manager.cc:1403] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.221s	user 0.050s	sys 0.006s
I20260709 13:13:31.235931  2059 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.236675  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.237260  1771 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.238001  2059 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.238931  1962 raft_consensus.cc:359] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.239614  1962 raft_consensus.cc:385] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.239929  1962 raft_consensus.cc:740] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.240581  1962 consensus_queue.cc:260] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.241160  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.242511  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.243251  1769 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.242525  2166 raft_consensus.cc:493] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.244969  2166 raft_consensus.cc:515] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.241914  1839 raft_consensus.cc:2468] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:31.241230  2128 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.247114  2128 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.249089  2169 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.249712  2169 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.267863  1961 tablet_bootstrap.cc:654] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.269784  1962 ts_tablet_manager.cc:1434] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 13:13:31.270457  1965 tablet_bootstrap.cc:654] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.270871  1966 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.273291  1966 ts_tablet_manager.cc:1403] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.010s
I20260709 13:13:31.273371  2128 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.273578  1962 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:31.274585  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.275238  1770 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:31.276270  1809 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:31.276130  1966 raft_consensus.cc:359] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.279101  1962 tablet_bootstrap.cc:654] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.279166  1966 raft_consensus.cc:385] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.279630  1966 raft_consensus.cc:740] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.280270  1966 consensus_queue.cc:260] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.281401  2131 raft_consensus.cc:2804] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:31.281750  2131 raft_consensus.cc:493] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.278738  2166 leader_election.cc:290] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.282104  2131 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.282541  1966 ts_tablet_manager.cc:1434] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:31.282799  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.286257  1966 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.289992  2123 raft_consensus.cc:493] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.290532  2123 raft_consensus.cc:515] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.280297  2169 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.292670  2123 leader_election.cc:290] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.293416  2128 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.296018  1883 leader_election.cc:343] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.297013  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92e2274307749e7b3c88af5cc18eeec" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.299746  1919 raft_consensus.cc:2468] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:31.300871  1736 leader_election.cc:304] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.301690  2123 raft_consensus.cc:2804] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.302042  2123 raft_consensus.cc:493] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.302413  2123 raft_consensus.cc:3060] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.302776  2131 raft_consensus.cc:515] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.306169  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.306948  1770 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.308692  1771 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.298611  2128 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.321898  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.322594  1696 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:31.323457  2059 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.323532  2128 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.311411  1966 tablet_bootstrap.cc:654] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.324030  2059 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.326077  2059 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.326550  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92e2274307749e7b3c88af5cc18eeec" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.327458  2128 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.327971  2128 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.328539  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:31.329746  1810 leader_election.cc:343] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.330037  2128 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.330607  2131 leader_election.cc:290] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.330847  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.331405  1961 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.331909  1961 ts_tablet_manager.cc:1403] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.008s
I20260709 13:13:31.331751  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:31.333222  1810 leader_election.cc:343] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.334671  1961 raft_consensus.cc:359] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.335409  1961 raft_consensus.cc:385] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.335688  1961 raft_consensus.cc:740] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.313284  2123 raft_consensus.cc:515] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.336735  1961 consensus_queue.cc:260] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.271762  1769 raft_consensus.cc:2468] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.316718  1661 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:31.339154  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92e2274307749e7b3c88af5cc18eeec" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:31.338850  1594 catalog_manager.cc:5697] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.318269  1770 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:31.318476  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:31.317214  2166 consensus_queue.cc:1048] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.340920  1695 raft_consensus.cc:3060] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.315815  1846 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.319751  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.320727  1842 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.342731  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.321341  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.339792  1918 raft_consensus.cc:3060] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.318722  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.345017  1839 raft_consensus.cc:2468] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:31.345137  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.345820  1771 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:31.350628  1809 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:31.351578  1809 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.352560  2040 raft_consensus.cc:2804] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.352964  2040 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.353288  2040 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:31.344074  1661 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.356599  1695 raft_consensus.cc:2468] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:31.357810  2128 raft_consensus.cc:2804] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.319176  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03e9a428544fe4bd57cb92c09bc12e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.338851  1961 ts_tablet_manager.cc:1434] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:13:31.358806  1697 raft_consensus.cc:2376] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2. Re-sending same reply.
I20260709 13:13:31.359342  1961 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.362700  1845 raft_consensus.cc:2393] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:31.363674  2131 raft_consensus.cc:2804] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.366577  2123 leader_election.cc:290] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.365139  2131 raft_consensus.cc:697] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:31.367588  1918 raft_consensus.cc:2468] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:31.368361  2040 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.369236  2131 consensus_queue.cc:237] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.358237  2128 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.373076  1961 tablet_bootstrap.cc:654] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.374222  1736 leader_election.cc:304] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.376137  2128 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:31.374647  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:13:31.379971  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 51330.7us
I20260709 13:13:31.386502  1965 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.387023  1965 ts_tablet_manager.cc:1403] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.003s
I20260709 13:13:31.390200  1661 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:31.391165  2031 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.391637  2031 raft_consensus.cc:697] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:31.392422  2031 consensus_queue.cc:237] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.394325  1884 leader_election.cc:304] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:31.395412  2166 raft_consensus.cc:2804] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.395773  2166 raft_consensus.cc:493] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.396092  2166 raft_consensus.cc:3060] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.383270  2169 raft_consensus.cc:2804] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.397627  2169 raft_consensus.cc:697] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:31.398656  2169 consensus_queue.cc:237] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.405179  1965 raft_consensus.cc:359] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.405957  1965 raft_consensus.cc:385] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.406247  1965 raft_consensus.cc:740] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.370623  2040 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.406996  1965 consensus_queue.cc:260] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.409168  1965 ts_tablet_manager.cc:1434] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:13:31.413260  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.413937  1839 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
W20260709 13:13:31.414740  1660 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.415994  1660 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.418118  2028 raft_consensus.cc:2804] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.418720  2028 raft_consensus.cc:697] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
W20260709 13:13:31.420081  1811 leader_election.cc:343] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.419740  2028 consensus_queue.cc:237] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.429991  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.420974  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.414810  1965 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.414788  2128 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.426489  2167 consensus_queue.cc:1048] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:31.427827  1737 leader_election.cc:304] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
W20260709 13:13:31.445611  1737 leader_election.cc:343] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.429092  2166 raft_consensus.cc:515] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.442040  2128 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.430123  1811 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.444069  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:31.460640  1966 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.462203  1966 ts_tablet_manager.cc:1403] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.041s
I20260709 13:13:31.463073  1965 tablet_bootstrap.cc:654] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.447649  1839 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.446671  2123 raft_consensus.cc:2764] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:31.469981  2128 raft_consensus.cc:2749] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:31.478615  1810 leader_election.cc:343] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:31.474241  1811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 54209.3us
I20260709 13:13:31.461548  2164 consensus_queue.cc:1048] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:13:31.489427  1961 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.489343  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.490036  1961 ts_tablet_manager.cc:1403] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.021s
I20260709 13:13:31.490149  1845 raft_consensus.cc:3060] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.480407  2166 leader_election.cc:290] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.482824  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
W20260709 13:13:31.483664  1660 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.491564  1771 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.484803  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f92e2274307749e7b3c88af5cc18eeec" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
W20260709 13:13:31.493391  1737 leader_election.cc:343] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.495182  1961 raft_consensus.cc:359] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.495724  1961 raft_consensus.cc:385] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.495959  1961 raft_consensus.cc:740] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.496549  1961 consensus_queue.cc:260] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.499486  1961 ts_tablet_manager.cc:1434] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:31.500257  1961 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.498981  1661 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.521519  2036 raft_consensus.cc:2804] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.533834  2036 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.534248  2036 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.537411  1845 raft_consensus.cc:2468] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:31.538403  2164 consensus_queue.cc:1048] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.546662  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.545092  1771 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
W20260709 13:13:31.549064  2193 log.cc:927] Time spent T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: Append to log took a long time: real 0.089s	user 0.003s	sys 0.000s
I20260709 13:13:31.551513  1961 tablet_bootstrap.cc:654] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.553290  1809 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.563560  2131 raft_consensus.cc:2804] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:31.574611  1883 leader_election.cc:343] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.575133  2131 raft_consensus.cc:697] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:31.576203  1962 tablet_bootstrap.cc:492] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:31.557708  1594 catalog_manager.cc:5697] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.576733  1962 ts_tablet_manager.cc:1403] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.303s	user 0.031s	sys 0.041s
I20260709 13:13:31.541396  2169 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.584376  1966 raft_consensus.cc:359] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.585104  1966 raft_consensus.cc:385] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.576128  2131 consensus_queue.cc:237] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.585413  1966 raft_consensus.cc:740] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.589481  1966 consensus_queue.cc:260] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.580600  2059 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.593004  2059 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.594301  1965 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.594789  1965 ts_tablet_manager.cc:1403] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.004s
I20260709 13:13:31.595104  2059 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.596989  2036 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.601873  1962 raft_consensus.cc:359] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.581547  2169 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.542429  2028 consensus_queue.cc:1048] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:13:31.604291  2169 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.605320  1962 raft_consensus.cc:385] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.605790  1839 raft_consensus.cc:2468] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.597527  1965 raft_consensus.cc:359] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.606034  1884 leader_election.cc:304] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:31.606084  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.611291  1918 raft_consensus.cc:2393] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:31.611238  2166 raft_consensus.cc:2804] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:31.611677  1884 consensus_peers.cc:597] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.611974  2166 raft_consensus.cc:697] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:31.612773  2036 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.612937  2166 consensus_queue.cc:237] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.617100  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.617725  1918 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:31.605830  1962 raft_consensus.cc:740] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.621956  1962 consensus_queue.cc:260] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.609133  1966 ts_tablet_manager.cc:1434] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.001s
I20260709 13:13:31.624185  1966 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.624996  1592 catalog_manager.cc:5697] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 2, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.632138  1591 catalog_manager.cc:5697] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.608126  1965 raft_consensus.cc:385] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.645078  1965 raft_consensus.cc:740] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.634291  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.634471  2164 consensus_queue.cc:1048] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.637275  1770 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.645794  1965 consensus_queue.cc:260] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.608026  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.639196  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.650461  1846 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.651083  1737 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.656973  1965 ts_tablet_manager.cc:1434] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:13:31.657945  1965 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.664929  2132 raft_consensus.cc:2749] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.666308  1961 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.667016  1961 ts_tablet_manager.cc:1403] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.167s	user 0.026s	sys 0.015s
I20260709 13:13:31.668129  2059 consensus_queue.cc:1048] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.671037  1961 raft_consensus.cc:359] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.671829  1961 raft_consensus.cc:385] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.639004  1990 consensus_queue.cc:1048] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:31.640105  2169 raft_consensus.cc:493] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.673427  2169 raft_consensus.cc:515] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.639457  1962 ts_tablet_manager.cc:1434] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:13:31.640764  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:31.643416  1591 catalog_manager.cc:5697] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.671913  1966 tablet_bootstrap.cc:654] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.640671  2188 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.676538  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.677318  1697 raft_consensus.cc:2468] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:31.677011  2188 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.678552  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:31.680794  1736 leader_election.cc:343] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.680996  2188 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.675858  2169 leader_election.cc:290] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.681252  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.682569  1737 leader_election.cc:304] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
W20260709 13:13:31.685506  1811 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.686712  2169 raft_consensus.cc:2804] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.686115  1961 raft_consensus.cc:740] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.687278  2169 raft_consensus.cc:493] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.687765  2169 raft_consensus.cc:3060] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.688362  1961 consensus_queue.cc:260] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.693941  1961 ts_tablet_manager.cc:1434] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:13:31.695830  1961 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.699988  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:31.701395  1809 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.701843  1809 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:31.703116  2188 raft_consensus.cc:2749] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.708117  1661 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.708491  1966 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.675082  1962 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:31.708979  1966 ts_tablet_manager.cc:1403] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.003s
I20260709 13:13:31.713038  1966 raft_consensus.cc:359] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.713660  1966 raft_consensus.cc:385] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.713915  1966 raft_consensus.cc:740] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.714582  1966 consensus_queue.cc:260] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.716835  1966 ts_tablet_manager.cc:1434] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:31.717782  1966 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.717658  1593 catalog_manager.cc:5697] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.730293  1961 tablet_bootstrap.cc:654] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.732424  1966 tablet_bootstrap.cc:654] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.738791  2059 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.739310  2059 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.739681  2059 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.757747  1966 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.758303  1966 ts_tablet_manager.cc:1403] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.002s
W20260709 13:13:31.749620  1661 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.760829  2059 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.765869  1965 tablet_bootstrap.cc:654] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.766000  1966 raft_consensus.cc:359] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.766834  1966 raft_consensus.cc:385] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.767375  1966 raft_consensus.cc:740] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.767803  2059 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.768141  1966 consensus_queue.cc:260] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.768931  1961 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.777309  1961 ts_tablet_manager.cc:1403] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.015s
I20260709 13:13:31.769119  1846 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.778043  1966 ts_tablet_manager.cc:1434] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:13:31.778359  1965 tablet_bootstrap.cc:492] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.778977  1965 ts_tablet_manager.cc:1403] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.003s
I20260709 13:13:31.779070  1966 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.780725  1961 raft_consensus.cc:359] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.781458  1961 raft_consensus.cc:385] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.781728  1961 raft_consensus.cc:740] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.782508  1961 consensus_queue.cc:260] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.785470  1966 tablet_bootstrap.cc:654] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.786362  2131 raft_consensus.cc:493] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.781800  1965 raft_consensus.cc:359] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.787111  1965 raft_consensus.cc:385] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.786902  2131 raft_consensus.cc:515] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.787441  1965 raft_consensus.cc:740] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.788203  1965 consensus_queue.cc:260] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.789433  2131 leader_election.cc:290] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.791872  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.792671  1695 raft_consensus.cc:2468] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:31.774600  1962 tablet_bootstrap.cc:654] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.794972  1965 ts_tablet_manager.cc:1434] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:13:31.795360  1811 leader_election.cc:304] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:31.796123  1965 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.796837  2131 raft_consensus.cc:2804] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:31.791963  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.799171  2131 raft_consensus.cc:493] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:31.799672  2131 raft_consensus.cc:3060] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:31.800462  1809 leader_election.cc:343] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.797638  1697 raft_consensus.cc:3060] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.803491  1961 ts_tablet_manager.cc:1434] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:13:31.805650  1961 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.775628  2169 raft_consensus.cc:515] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.771032  1661 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:31.813175  1965 tablet_bootstrap.cc:654] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.815623  2059 raft_consensus.cc:2804] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.817153  1769 raft_consensus.cc:1275] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:31.819278  2059 raft_consensus.cc:697] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:31.819172  2188 consensus_queue.cc:1048] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.820574  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:31.821267  1695 raft_consensus.cc:3060] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.821221  2059 consensus_queue.cc:237] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.822427  1961 tablet_bootstrap.cc:654] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:31.825017  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 54057.7us
I20260709 13:13:31.814996  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
W20260709 13:13:31.830921  1736 leader_election.cc:343] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:31.833559  1661 leader_election.cc:343] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.835352  1661 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.834030  2169 leader_election.cc:290] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.836197  2132 consensus_queue.cc:1048] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.838163  1695 raft_consensus.cc:2468] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:31.838703  2036 raft_consensus.cc:2804] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.839224  2036 raft_consensus.cc:697] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:31.839340  1737 leader_election.cc:304] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:31.840551  2132 raft_consensus.cc:2804] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.840287  2036 consensus_queue.cc:237] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.841094  2132 raft_consensus.cc:697] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:31.841441  1966 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:31.841969  1966 ts_tablet_manager.cc:1403] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.004s
I20260709 13:13:31.841909  2132 consensus_queue.cc:237] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.846894  1962 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:31.847440  1962 ts_tablet_manager.cc:1403] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.003s
I20260709 13:13:31.852303  1965 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:31.852860  1965 ts_tablet_manager.cc:1403] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.006s
I20260709 13:13:31.837221  2131 raft_consensus.cc:515] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.856930  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:31.857623  1697 raft_consensus.cc:3060] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.858852  1962 raft_consensus.cc:359] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.859766  1962 raft_consensus.cc:385] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.860049  1962 raft_consensus.cc:740] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.852303  1961 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.861145  1961 ts_tablet_manager.cc:1403] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.002s
I20260709 13:13:31.860805  1965 raft_consensus.cc:359] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.861528  1965 raft_consensus.cc:385] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.864691  1961 raft_consensus.cc:359] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.865662  1961 raft_consensus.cc:385] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.853199  1966 raft_consensus.cc:359] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.861867  1965 raft_consensus.cc:740] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.867153  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:31.867745  2131 leader_election.cc:290] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:31.871899  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:31.872476  1918 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.872797  1694 raft_consensus.cc:1275] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:31.874423  2188 consensus_queue.cc:1048] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.868152  1962 consensus_queue.cc:260] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.867632  1966 raft_consensus.cc:385] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:31.868793  1809 leader_election.cc:343] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.880323  1966 raft_consensus.cc:740] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.880674  1918 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.866046  1961 raft_consensus.cc:740] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.869315  1965 consensus_queue.cc:260] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.869832  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:31.881405  1966 consensus_queue.cc:260] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.883533  1966 ts_tablet_manager.cc:1434] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:13:31.884052  1965 ts_tablet_manager.cc:1434] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:13:31.884543  1966 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:31.885015  1965 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:31.882186  1842 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.889526  2169 raft_consensus.cc:493] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.890161  2169 raft_consensus.cc:515] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.891196  2123 consensus_queue.cc:1048] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:31.896363  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.898326  2028 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.898890  2028 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.893347  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63426b4990cb4e66baddcc699073609b" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.900964  1846 raft_consensus.cc:2393] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:31.901108  2028 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:31.901844  1736 leader_election.cc:304] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:31.883555  1961 consensus_queue.cc:260] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:31.902844  2128 raft_consensus.cc:493] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.903152  2123 raft_consensus.cc:3060] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.903358  2128 raft_consensus.cc:515] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:31.905378  2128 leader_election.cc:290] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:31.905635  1962 ts_tablet_manager.cc:1434] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:13:31.906675  1962 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:31.907023  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:31.908469  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:31.909377  2028 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:31.909922  1660 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:31.913656  1962 tablet_bootstrap.cc:654] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.916417  1961 ts_tablet_manager.cc:1434] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:13:31.916512  1770 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.917505  1961 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:31.893860  1842 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:31.916548  1594 catalog_manager.cc:5697] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.922849  2123 raft_consensus.cc:2749] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.923144  1966 tablet_bootstrap.cc:654] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.930703  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:31.932411  1811 leader_election.cc:304] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:31.933820  2128 raft_consensus.cc:2749] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:31.929942  1961 tablet_bootstrap.cc:654] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.947629  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:31.948393  1842 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:31.903376  2169 leader_election.cc:290] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:31.953303  1661 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:31.956961  1697 raft_consensus.cc:2468] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:31.958163  1811 leader_election.cc:304] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:31.958703  1591 catalog_manager.cc:5697] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.959432  2128 raft_consensus.cc:2804] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.960157  2128 raft_consensus.cc:697] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:31.961900  1962 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:31.962510  1962 ts_tablet_manager.cc:1403] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.007s
I20260709 13:13:31.961755  2128 consensus_queue.cc:237] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.967093  1842 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.967519  1962 raft_consensus.cc:359] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.968536  1962 raft_consensus.cc:385] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.968842  1962 raft_consensus.cc:740] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.970788  1962 consensus_queue.cc:260] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:31.973244  1962 ts_tablet_manager.cc:1434] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:31.974247  1962 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:31.978353  2123 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.990125  1961 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:31.990784  1961 ts_tablet_manager.cc:1403] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.000s
I20260709 13:13:31.990557  2123 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:31.998394  2059 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.004127  1961 raft_consensus.cc:359] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.004868  1961 raft_consensus.cc:385] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.005193  1961 raft_consensus.cc:740] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.005790  1961 consensus_queue.cc:260] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.007583  1918 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.010740  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.011706  1846 raft_consensus.cc:2393] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:32.013288  2059 raft_consensus.cc:697] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:32.014497  1965 tablet_bootstrap.cc:654] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.016986  2059 consensus_queue.cc:237] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:31.997872  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 44705.3us
I20260709 13:13:32.022514  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:32.023228  1593 catalog_manager.cc:5697] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.025665  2123 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.043358  1962 tablet_bootstrap.cc:654] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.043149  2036 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.045008  1661 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:32.047210  1961 ts_tablet_manager.cc:1434] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:13:32.052428  1961 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:32.054183  1594 catalog_manager.cc:5697] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.061342  2202 raft_consensus.cc:2804] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.061806  2202 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.062168  2202 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.066649  2036 raft_consensus.cc:493] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.067181  2036 raft_consensus.cc:515] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.069250  2036 leader_election.cc:290] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:32.071139  1737 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:32.072237  2228 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:32.074263  1661 consensus_peers.cc:597] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c -> Peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Couldn't send request to peer d7fc1f76c2214405a104ba2cc2d4c865. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.075496  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.077178  2202 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.080104  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.080433  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.081074  1839 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:32.083320  1660 leader_election.cc:343] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.085126  2031 consensus_queue.cc:1048] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.088008  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:32.091660  1839 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:32.093205  1990 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.093700  1990 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.094437  2235 consensus_queue.cc:1048] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.098727  1990 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.121435  1961 tablet_bootstrap.cc:654] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:32.093717  1660 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.110695  1591 catalog_manager.cc:5697] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.103578  2202 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.127903  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.136817  1661 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
W20260709 13:13:32.138211  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 44476.9us
W20260709 13:13:32.143206  1661 leader_election.cc:343] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.143723  1661 leader_election.cc:304] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.131036  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.149493  2040 raft_consensus.cc:2749] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.149367  2036 raft_consensus.cc:493] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.162200  2036 raft_consensus.cc:515] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.164736  2036 leader_election.cc:290] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:32.145357  2059 raft_consensus.cc:2804] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.149461  2228 raft_consensus.cc:2749] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.184515  1966 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:32.184844  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.185218  1966 ts_tablet_manager.cc:1403] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.301s	user 0.049s	sys 0.065s
I20260709 13:13:32.177485  2059 raft_consensus.cc:697] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:32.189308  2059 consensus_queue.cc:237] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.166766  1769 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
W20260709 13:13:32.210368  1661 leader_election.cc:343] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.211159  1962 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:32.211695  1962 ts_tablet_manager.cc:1403] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.238s	user 0.037s	sys 0.012s
I20260709 13:13:32.216228  1966 raft_consensus.cc:359] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.217136  1966 raft_consensus.cc:385] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.217481  1966 raft_consensus.cc:740] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.218901  1966 consensus_queue.cc:260] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.227232  2164 consensus_queue.cc:1048] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.227524  1962 raft_consensus.cc:359] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.228551  1962 raft_consensus.cc:385] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.228897  1962 raft_consensus.cc:740] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.229750  1962 consensus_queue.cc:260] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.234457  2188 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.235194  2188 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.237947  2188 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:32.241662  1966 ts_tablet_manager.cc:1434] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:13:32.247468  1962 ts_tablet_manager.cc:1434] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:13:32.248265  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:32.261629  1811 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.266952  1962 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:32.263701  1593 catalog_manager.cc:5697] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.270282  2164 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.270972  2164 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.271703  1961 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:32.272226  1961 ts_tablet_manager.cc:1403] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.220s	user 0.021s	sys 0.019s
I20260709 13:13:32.273694  2164 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.270326  2188 raft_consensus.cc:493] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.275580  2188 raft_consensus.cc:515] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.282703  1961 raft_consensus.cc:359] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.283481  1961 raft_consensus.cc:385] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.283753  1961 raft_consensus.cc:740] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.284554  1961 consensus_queue.cc:260] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.286612  1961 ts_tablet_manager.cc:1434] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:13:32.287779  1961 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:32.289652  2188 leader_election.cc:290] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.292009  2036 consensus_queue.cc:1048] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.306952  2235 consensus_queue.cc:1048] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.311771  1883 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:32.313035  2166 raft_consensus.cc:2804] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:32.313510  2166 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f8863ebea2ba4d47949f4b8b6a757d47)
I20260709 13:13:32.313885  2166 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.314908  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.329393  1966 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:32.333644  1965 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:32.334223  1965 ts_tablet_manager.cc:1403] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.449s	user 0.029s	sys 0.072s
I20260709 13:13:32.339679  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.340214  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.340833  1916 raft_consensus.cc:2468] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:32.348639  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.349330  1846 raft_consensus.cc:2468] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:32.314100  2036 consensus_queue.cc:1048] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:13:32.338357  1990 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.353742  1594 catalog_manager.cc:5697] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.355365  1990 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.357033  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:32.357244  1736 consensus_peers.cc:597] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.357437  1990 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:32.358539  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.358999  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:32.359709  2031 consensus_queue.cc:1048] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:32.361680  1660 leader_election.cc:343] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.362015  1990 consensus_queue.cc:1048] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.362160  1660 leader_election.cc:304] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.374022  1884 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:32.378383  2036 raft_consensus.cc:2749] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.382827  1961 tablet_bootstrap.cc:654] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.394129  1962 tablet_bootstrap.cc:654] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.402891  2166 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.405347  2166 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
W20260709 13:13:32.408120  1809 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.408701  1809 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:32.409981  1809 leader_election.cc:343] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.411469  2235 raft_consensus.cc:2749] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.386564  1918 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:32.421658  1883 leader_election.cc:343] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.422873  2167 raft_consensus.cc:2804] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.442687  2131 consensus_queue.cc:1048] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.443136  2167 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.445227  2167 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.436834  2202 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:32.422241  1884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 48358.5us
I20260709 13:13:32.462802  1965 raft_consensus.cc:359] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.463883  1965 raft_consensus.cc:385] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.464242  1965 raft_consensus.cc:740] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.471613  1965 consensus_queue.cc:260] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.476071  1810 leader_election.cc:304] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:32.477545  2235 raft_consensus.cc:2804] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:32.472872  1809 consensus_peers.cc:597] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.477906  2235 raft_consensus.cc:493] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.484941  2235 raft_consensus.cc:3060] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.488433  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:32.500646  1966 tablet_bootstrap.cc:654] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.509052  2235 raft_consensus.cc:515] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.509754  2228 consensus_queue.cc:1048] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.511029  2167 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.514302  1965 ts_tablet_manager.cc:1434] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.180s	user 0.008s	sys 0.000s
I20260709 13:13:32.520920  1965 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:32.526506  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.534613  1961 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:32.535153  1961 ts_tablet_manager.cc:1403] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.248s	user 0.012s	sys 0.005s
I20260709 13:13:32.536594  1916 raft_consensus.cc:1240] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Rejecting Update request from peer f8863ebea2ba4d47949f4b8b6a757d47 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:32.537739  1884 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:32.537828  1961 raft_consensus.cc:359] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.539462  1961 raft_consensus.cc:385] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.539736  1961 raft_consensus.cc:740] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.540407  1961 consensus_queue.cc:260] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.542517  1961 ts_tablet_manager.cc:1434] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:32.543409  1961 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:32.545986  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.547323  2167 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
W20260709 13:13:32.564697  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:32.548852  1965 tablet_bootstrap.cc:654] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.555917  2164 raft_consensus.cc:2749] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.557555  2235 leader_election.cc:290] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.560086  1884 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:32.569990  1961 tablet_bootstrap.cc:654] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.570245  1962 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:32.593816  1962 ts_tablet_manager.cc:1403] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.327s	user 0.020s	sys 0.011s
I20260709 13:13:32.571226  1966 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:32.594825  1966 ts_tablet_manager.cc:1403] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.266s	user 0.014s	sys 0.009s
I20260709 13:13:32.573593  2251 raft_consensus.cc:2749] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:32.595527  2028 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:32.595726  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.596474  1839 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.574589  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:32.574738  2131 consensus_queue.cc:1059] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.598867  2131 raft_consensus.cc:3055] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.576673  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:32.578531  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:32.588683  2059 consensus_queue.cc:1048] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.601105  1966 raft_consensus.cc:359] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.601811  1966 raft_consensus.cc:385] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:32.607075  1809 leader_election.cc:343] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.608611  1916 raft_consensus.cc:3060] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.602093  1966 raft_consensus.cc:740] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.613266  1966 consensus_queue.cc:260] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.615332  1966 ts_tablet_manager.cc:1434] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:13:32.616242  1966 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:32.616338  1962 raft_consensus.cc:359] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.617287  1962 raft_consensus.cc:385] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.617642  1962 raft_consensus.cc:740] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.599313  2131 raft_consensus.cc:740] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:32.622605  1966 tablet_bootstrap.cc:654] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.625861  2131 consensus_queue.cc:260] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.627558  2131 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.632923  1962 consensus_queue.cc:260] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.651371  2059 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.652050  2059 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.678133  1962 ts_tablet_manager.cc:1434] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 13:13:32.686125  1962 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:32.698946  1965 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:32.699726  1965 ts_tablet_manager.cc:1403] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.013s
W20260709 13:13:32.715245  1883 leader_election.cc:343] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.735347  1965 raft_consensus.cc:359] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.735932  1965 raft_consensus.cc:385] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.737069  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.737145  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.737839  1846 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:32.719147  2059 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.736152  1965 raft_consensus.cc:740] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.739715  1965 consensus_queue.cc:260] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.741302  1961 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:32.743791  1962 tablet_bootstrap.cc:654] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.741992  1961 ts_tablet_manager.cc:1403] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.199s	user 0.012s	sys 0.060s
I20260709 13:13:32.726671  1916 raft_consensus.cc:2468] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:32.738446  2167 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.771066  2167 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.767892  1966 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:32.772598  1966 ts_tablet_manager.cc:1403] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.157s	user 0.039s	sys 0.039s
W20260709 13:13:32.774328  1661 leader_election.cc:343] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.776221  1965 ts_tablet_manager.cc:1434] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:13:32.777380  1965 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:32.781041  2229 raft_consensus.cc:493] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.781730  1810 leader_election.cc:304] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:32.782917  2235 raft_consensus.cc:2804] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.783385  2235 raft_consensus.cc:697] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:32.784293  2235 consensus_queue.cc:237] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.781569  2229 raft_consensus.cc:515] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.787711  2167 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:32.788717  2229 leader_election.cc:290] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.783375  1961 raft_consensus.cc:359] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.794649  1961 raft_consensus.cc:385] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.796633  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:32.799222  1661 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.800614  1966 raft_consensus.cc:359] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.801311  1966 raft_consensus.cc:385] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.801606  1966 raft_consensus.cc:740] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.794922  1961 raft_consensus.cc:740] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.806280  2040 raft_consensus.cc:2804] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.806408  1966 consensus_queue.cc:260] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.806829  1961 consensus_queue.cc:260] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.806972  2040 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.810519  2040 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.815304  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.825493  2028 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.825598  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.826149  2028 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.828233  2028 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.808857  1966 ts_tablet_manager.cc:1434] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
I20260709 13:13:32.795197  1839 raft_consensus.cc:2468] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:32.832129  1966 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:32.832286  1965 tablet_bootstrap.cc:654] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.815344  1961 ts_tablet_manager.cc:1434] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:13:32.834153  1961 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:32.839039  1883 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:32.840353  2167 raft_consensus.cc:2749] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.852399  1962 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:32.852957  1962 ts_tablet_manager.cc:1403] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.174s	user 0.044s	sys 0.036s
W20260709 13:13:32.853942  2265 log.cc:927] Time spent T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:13:32.861418  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.862212  2036 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.862363  1839 raft_consensus.cc:2468] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:32.862757  2036 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.863529  2202 consensus_queue.cc:1048] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:32.864886  2036 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.865397  2040 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.866997  1884 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:32.867543  2040 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.868485  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:32.870290  1661 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:32.856321  1962 raft_consensus.cc:359] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.870615  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.870981  1962 raft_consensus.cc:385] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.871275  1962 raft_consensus.cc:740] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.871840  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:32.872215  2059 raft_consensus.cc:2804] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:32.856927  1660 consensus_peers.cc:597] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.857714  1966 tablet_bootstrap.cc:654] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.855698  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abff7eb16e2f4ed2a372f6fb6e6944e0" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:32.874429  2167 raft_consensus.cc:2804] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:32.876647  1660 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.874598  1962 consensus_queue.cc:260] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.878516  1737 leader_election.cc:304] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:32.879838  1962 ts_tablet_manager.cc:1434] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.005s
I20260709 13:13:32.880126  2228 raft_consensus.cc:2749] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.880779  1962 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:32.872714  2059 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.882247  2059 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.875473  1965 tablet_bootstrap.cc:492] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
W20260709 13:13:32.875424  1661 leader_election.cc:343] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.883179  1965 ts_tablet_manager.cc:1403] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.106s	user 0.020s	sys 0.018s
W20260709 13:13:32.884428  1661 leader_election.cc:343] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.876914  2167 raft_consensus.cc:697] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:32.891302  2167 consensus_queue.cc:237] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.894670  1966 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:32.887955  2229 raft_consensus.cc:493] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.895190  2229 raft_consensus.cc:515] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.885917  1965 raft_consensus.cc:359] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.896694  1965 raft_consensus.cc:385] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.899010  1965 raft_consensus.cc:740] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.899904  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.899783  1965 consensus_queue.cc:260] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.900440  1846 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.901901  1965 ts_tablet_manager.cc:1434] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:13:32.903048  1965 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:32.894474  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:32.904096  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:32.904300  1842 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:32.904769  1695 raft_consensus.cc:2468] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:32.906106  1737 leader_election.cc:304] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:32.907200  2228 raft_consensus.cc:2804] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.907680  2228 raft_consensus.cc:493] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.908100  2228 raft_consensus.cc:3060] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.909184  1966 ts_tablet_manager.cc:1403] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.005s
I20260709 13:13:32.906471  1594 catalog_manager.cc:5697] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.913080  1966 raft_consensus.cc:359] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.913724  1966 raft_consensus.cc:385] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.914243  1965 tablet_bootstrap.cc:654] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.917451  1962 tablet_bootstrap.cc:654] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.920455  1661 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.897219  2229 leader_election.cc:290] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:32.921401  2028 raft_consensus.cc:2804] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.921764  2028 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.922133  2028 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.922600  2059 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.923588  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:32.931882  1736 leader_election.cc:343] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.931879  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.933449  1844 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.944271  1846 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:32.948277  1661 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.949136  2040 raft_consensus.cc:2804] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.925225  1961 tablet_bootstrap.cc:654] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.950090  2040 raft_consensus.cc:697] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:32.951032  2040 consensus_queue.cc:237] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.926462  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:32.901960  1593 catalog_manager.cc:5697] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.913970  1966 raft_consensus.cc:740] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.949529  2235 raft_consensus.cc:493] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.955660  1962 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:32.955487  2235 raft_consensus.cc:515] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:32.956161  1962 ts_tablet_manager.cc:1403] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.005s
W20260709 13:13:32.956681  1660 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.957751  2235 leader_election.cc:290] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.959558  1962 raft_consensus.cc:359] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.964558  1962 raft_consensus.cc:385] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.964866  1962 raft_consensus.cc:740] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.965174  2028 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.966627  1962 consensus_queue.cc:260] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:32.967621  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:32.968286  1962 ts_tablet_manager.cc:1434] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:32.968679  1966 consensus_queue.cc:260] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:32.969177  1810 leader_election.cc:343] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.969168  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:32.971756  1809 leader_election.cc:343] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.969250  1962 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:32.972368  1809 leader_election.cc:304] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:32.973730  2235 raft_consensus.cc:2749] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.976332  1844 raft_consensus.cc:2468] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:32.962934  2228 raft_consensus.cc:515] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:32.977267  1661 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:32.978139  2031 raft_consensus.cc:2804] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.978600  2031 raft_consensus.cc:697] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:32.979417  2031 consensus_queue.cc:237] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:32.980513  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:32.981077  1846 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.982774  2228 leader_election.cc:290] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:32.983083  1591 catalog_manager.cc:5697] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.984387  1962 tablet_bootstrap.cc:654] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.986320  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:32.986896  1695 raft_consensus.cc:3060] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.986974  1966 ts_tablet_manager.cc:1434] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:13:32.988235  1966 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:32.924734  2059 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:32.995666  2028 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:32.996884  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:32.997069  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
W20260709 13:13:32.998433  1661 leader_election.cc:343] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.998602  1846 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:32.999471  1695 raft_consensus.cc:2468] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
W20260709 13:13:33.002924  1736 leader_election.cc:343] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.003983  1737 leader_election.cc:304] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:33.005410  2228 raft_consensus.cc:2804] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.006078  2228 raft_consensus.cc:697] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:33.006286  1966 tablet_bootstrap.cc:654] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.006464  1962 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:33.006927  1962 ts_tablet_manager.cc:1403] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.005s
I20260709 13:13:33.007212  2228 consensus_queue.cc:237] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.009848  1962 raft_consensus.cc:359] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.010558  1962 raft_consensus.cc:385] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.010809  1962 raft_consensus.cc:740] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.011632  1962 consensus_queue.cc:260] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.012075  1768 raft_consensus.cc:3060] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.013968  1962 ts_tablet_manager.cc:1434] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:33.014962  1962 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:33.017297  1661 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:33.020511  1962 tablet_bootstrap.cc:654] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.021781  2059 raft_consensus.cc:2804] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.022409  2059 raft_consensus.cc:697] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:33.023172  1961 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:33.023833  1961 ts_tablet_manager.cc:1403] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.000s
I20260709 13:13:33.023377  2059 consensus_queue.cc:237] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.031744  1965 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.032223  1965 ts_tablet_manager.cc:1403] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.006s
I20260709 13:13:33.032788  1962 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:33.033238  1962 ts_tablet_manager.cc:1403] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:13:33.034982  1965 raft_consensus.cc:359] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.036646  1965 raft_consensus.cc:385] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.036959  1965 raft_consensus.cc:740] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.037567  1965 consensus_queue.cc:260] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.035792  1962 raft_consensus.cc:359] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.038264  1962 raft_consensus.cc:385] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.038545  1962 raft_consensus.cc:740] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.039162  1962 consensus_queue.cc:260] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.040742  1965 ts_tablet_manager.cc:1434] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:33.041080  1962 ts_tablet_manager.cc:1434] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:33.041694  1965 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.041972  1962 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:33.042315  2167 raft_consensus.cc:493] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.045732  2167 raft_consensus.cc:515] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.048231  1965 tablet_bootstrap.cc:654] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.043911  1966 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:33.050557  1966 ts_tablet_manager.cc:1403] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.003s
I20260709 13:13:33.058200  1966 raft_consensus.cc:359] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.059119  1966 raft_consensus.cc:385] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.059414  1966 raft_consensus.cc:740] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.060138  1966 consensus_queue.cc:260] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.060427  1961 raft_consensus.cc:359] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.060930  1962 tablet_bootstrap.cc:654] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.061167  1961 raft_consensus.cc:385] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.061509  1961 raft_consensus.cc:740] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.062248  1961 consensus_queue.cc:260] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.076503  2167 leader_election.cc:290] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.082924  1966 ts_tablet_manager.cc:1434] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:13:33.086024  1966 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:33.088064  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.098869  1961 ts_tablet_manager.cc:1434] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.075s	user 0.019s	sys 0.011s
W20260709 13:13:33.104768  1885 leader_election.cc:343] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.111948  2164 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.113034  1965 tablet_bootstrap.cc:492] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.112578  2164 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.113539  1965 ts_tablet_manager.cc:1403] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.008s
I20260709 13:13:33.119067  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.122462  1961 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:33.126971  1966 tablet_bootstrap.cc:654] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.126339  2164 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.136511  1920 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.137382  1965 raft_consensus.cc:359] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.134766  2235 raft_consensus.cc:493] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.144472  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.145403  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.152582  1965 raft_consensus.cc:385] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.154014  1965 raft_consensus.cc:740] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.163472  1965 consensus_queue.cc:260] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.158807  2235 raft_consensus.cc:515] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.167742  2235 leader_election.cc:290] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:33.167958  1884 leader_election.cc:343] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.168485  1884 leader_election.cc:304] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.169113  1842 raft_consensus.cc:2393] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:33.169209  2164 raft_consensus.cc:2749] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.170390  1884 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.170709  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.171149  2164 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.171761  1965 ts_tablet_manager.cc:1434] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 13:13:33.172695  1965 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.172497  1591 catalog_manager.cc:5697] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.176514  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5895ed0fa1543c7b85a1646e8f8d99d" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.178411  1811 leader_election.cc:304] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:33.179054  2164 raft_consensus.cc:2749] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.179859  2235 raft_consensus.cc:2749] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.188527  1962 tablet_bootstrap.cc:492] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:33.189183  1962 ts_tablet_manager.cc:1403] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.147s	user 0.030s	sys 0.022s
I20260709 13:13:33.183645  2164 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.201500  1965 tablet_bootstrap.cc:654] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.213070  1961 tablet_bootstrap.cc:654] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.206427  2164 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.228261  1594 catalog_manager.cc:5697] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.231233  1594 catalog_manager.cc:5697] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.230326  2235 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.240535  2235 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.242623  2235 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:33.244643  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.245607  1962 raft_consensus.cc:359] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.246367  1962 raft_consensus.cc:385] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.246687  1962 raft_consensus.cc:740] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
W20260709 13:13:33.247591  1809 leader_election.cc:343] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.247915  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.249719  1962 consensus_queue.cc:260] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.252907  1842 raft_consensus.cc:3060] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.257817  2228 raft_consensus.cc:493] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.258342  2228 raft_consensus.cc:515] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.259030  1962 ts_tablet_manager.cc:1434] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.001s
I20260709 13:13:33.259959  2228 leader_election.cc:290] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.260092  1962 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:33.261652  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.262454  1918 raft_consensus.cc:2393] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:33.262521  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175c1595f94b42a2a3a55a81907d9ca9" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:33.264931  1811 leader_election.cc:343] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.265334  1811 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:33.269719  1736 leader_election.cc:304] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.270376  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.267383  2235 raft_consensus.cc:2749] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:33.271754  1885 leader_election.cc:343] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.272396  2228 raft_consensus.cc:3060] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.273551  1962 tablet_bootstrap.cc:654] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.274765  2164 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:33.275245  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:33.276615  1883 leader_election.cc:343] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.277056  1883 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:33.275259  1966 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:33.278609  1966 ts_tablet_manager.cc:1403] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.194s	user 0.019s	sys 0.017s
I20260709 13:13:33.281610  2166 raft_consensus.cc:2749] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.283560  1966 raft_consensus.cc:359] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.284243  1966 raft_consensus.cc:385] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.284508  1966 raft_consensus.cc:740] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.277268  1961 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:33.285188  1961 ts_tablet_manager.cc:1403] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.163s	user 0.020s	sys 0.022s
I20260709 13:13:33.286957  2131 consensus_queue.cc:1048] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:33.292917  1966 consensus_queue.cc:260] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.293665  2131 raft_consensus.cc:493] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.294111  2131 raft_consensus.cc:515] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.298902  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.299510  1918 raft_consensus.cc:2468] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:33.301117  1810 leader_election.cc:304] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:33.302142  2235 raft_consensus.cc:2804] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.305513  2235 raft_consensus.cc:493] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.306088  2235 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.304658  1961 raft_consensus.cc:359] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.307112  1961 raft_consensus.cc:385] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.307406  1961 raft_consensus.cc:740] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.304869  2131 leader_election.cc:290] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.308382  1961 consensus_queue.cc:260] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.311141  1961 ts_tablet_manager.cc:1434] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:13:33.312803  1961 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:33.315367  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.318559  1961 tablet_bootstrap.cc:654] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.322191  2123 raft_consensus.cc:493] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.322887  2123 raft_consensus.cc:515] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.326894  2123 leader_election.cc:290] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.330442  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.331256  1846 raft_consensus.cc:2468] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
W20260709 13:13:33.332319  1811 leader_election.cc:343] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.339663  1965 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.340261  1965 ts_tablet_manager.cc:1403] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.168s	user 0.040s	sys 0.017s
I20260709 13:13:33.340673  2235 raft_consensus.cc:515] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.344691  1965 raft_consensus.cc:359] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.345423  1965 raft_consensus.cc:385] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.345732  1965 raft_consensus.cc:740] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.347612  1966 ts_tablet_manager.cc:1434] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.003s
I20260709 13:13:33.348342  1966 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:33.353870  1768 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.354586  1966 tablet_bootstrap.cc:654] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.359846  2228 raft_consensus.cc:2749] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.361745  1736 leader_election.cc:304] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:33.362576  2228 raft_consensus.cc:2804] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.362944  2228 raft_consensus.cc:493] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.362895  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.364192  1920 raft_consensus.cc:2468] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:33.363447  2228 raft_consensus.cc:3060] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.369084  2131 consensus_queue.cc:1048] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.371527  2166 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.371555  1965 consensus_queue.cc:260] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.372117  2166 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.374169  1965 ts_tablet_manager.cc:1434] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:13:33.375319  1965 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.381078  1965 tablet_bootstrap.cc:654] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.381685  2166 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.382753  1918 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.386185  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.387012  2235 leader_election.cc:290] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.391022  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:33.392298  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:33.388590  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.397183  1920 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.397588  1844 raft_consensus.cc:2393] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:33.389431  2164 consensus_queue.cc:1048] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:13:33.401808  2228 raft_consensus.cc:515] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.404423  2228 leader_election.cc:290] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.405051  1884 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.406445  1920 raft_consensus.cc:2468] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:33.407971  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:33.408643  1916 raft_consensus.cc:3060] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.409305  1810 leader_election.cc:304] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:33.410511  2131 raft_consensus.cc:2804] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.410972  2131 raft_consensus.cc:697] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:33.411859  2131 consensus_queue.cc:237] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.415939  2059 consensus_queue.cc:1048] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:33.422564  1811 leader_election.cc:343] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.427557  1846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0001ab95b0df41219d8182675cadcadd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:33.428102  1846 raft_consensus.cc:3060] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.431337  2229 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.431996  2229 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.434938  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.435223  2229 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:33.435753  1965 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.436410  1965 ts_tablet_manager.cc:1403] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.012s
I20260709 13:13:33.439740  1965 raft_consensus.cc:359] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.440557  1965 raft_consensus.cc:385] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.440860  1965 raft_consensus.cc:740] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.441745  1916 raft_consensus.cc:2468] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:33.441629  1965 consensus_queue.cc:260] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.461750  1846 raft_consensus.cc:2468] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:33.468372  1965 ts_tablet_manager.cc:1434] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:13:33.456197  2228 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.470734  1961 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:33.475229  1961 ts_tablet_manager.cc:1403] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.163s	user 0.007s	sys 0.005s
I20260709 13:13:33.474013  2290 consensus_queue.cc:1048] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:33.477581  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.471014  1962 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:33.478767  1962 ts_tablet_manager.cc:1403] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.010s
I20260709 13:13:33.472276  1990 consensus_queue.cc:1048] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.482203  2228 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.473075  1965 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.473381  1736 leader_election.cc:304] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:33.462489  2251 raft_consensus.cc:2749] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.487202  2229 raft_consensus.cc:2804] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.487730  2229 raft_consensus.cc:697] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:33.487823  1961 raft_consensus.cc:359] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.488737  1961 raft_consensus.cc:385] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.489209  1961 raft_consensus.cc:740] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.488796  2229 consensus_queue.cc:237] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
W20260709 13:13:33.491550  1736 consensus_peers.cc:597] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Couldn't send request to peer d7fc1f76c2214405a104ba2cc2d4c865. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.494357  1961 consensus_queue.cc:260] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.497298  2228 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.499305  1962 raft_consensus.cc:359] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.503614  2290 consensus_queue.cc:1048] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.504717  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.505107  2028 raft_consensus.cc:493] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.512722  1962 raft_consensus.cc:385] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.517011  2028 raft_consensus.cc:515] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.519402  2028 leader_election.cc:290] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:33.523154  1592 catalog_manager.cc:5697] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.524147  1965 tablet_bootstrap.cc:654] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.526757  1966 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:33.515317  1962 raft_consensus.cc:740] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.526221  1961 ts_tablet_manager.cc:1434] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:13:33.527509  1966 ts_tablet_manager.cc:1403] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.014s
I20260709 13:13:33.543035  2059 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:33.538656  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.552614  1966 raft_consensus.cc:359] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.557384  1966 raft_consensus.cc:385] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.557827  1966 raft_consensus.cc:740] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.558753  1966 consensus_queue.cc:260] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.531054  1961 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
W20260709 13:13:33.560308  1660 leader_election.cc:343] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.530763  2290 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.569274  1966 ts_tablet_manager.cc:1434] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:13:33.567778  2290 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.571623  2290 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:33.530649  1962 consensus_queue.cc:260] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.574040  1961 tablet_bootstrap.cc:654] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.585486  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.578392  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.586964  1918 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:33.587621  1962 ts_tablet_manager.cc:1434] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.001s
I20260709 13:13:33.588763  1962 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:33.585094  1965 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.596822  1965 ts_tablet_manager.cc:1403] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.002s
I20260709 13:13:33.597432  2307 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.597998  2307 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.581892  1966 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:33.601317  2307 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:33.601486  1965 raft_consensus.cc:359] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.603464  1965 raft_consensus.cc:385] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.578881  1736 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.604769  1592 catalog_manager.cc:5697] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.603832  1965 raft_consensus.cc:740] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.608752  1965 consensus_queue.cc:260] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.616791  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:33.619004  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.610651  1918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.611322  2307 raft_consensus.cc:2749] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.622807  1661 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:33.626335  1771 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
W20260709 13:13:33.630350  1736 leader_election.cc:343] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.629966  1965 ts_tablet_manager.cc:1434] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:13:33.631978  1965 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.641414  1965 tablet_bootstrap.cc:654] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.641714  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.642524  1842 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:33.643747  2202 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.644223  2202 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.644639  2202 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.664692  1966 tablet_bootstrap.cc:654] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.665841  2307 consensus_queue.cc:1048] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:33.668485  2202 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.669445  1961 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:33.685696  1961 ts_tablet_manager.cc:1403] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.009s
W20260709 13:13:33.669797  1737 leader_election.cc:343] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:33.689924  1737 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:33.688794  1961 raft_consensus.cc:359] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.694547  1961 raft_consensus.cc:385] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.696910  1961 raft_consensus.cc:740] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
W20260709 13:13:33.674125  1660 consensus_peers.cc:597] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:33.697719  1961 consensus_queue.cc:260] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.697126  2202 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:33.714273  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:33.715031  1771 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.716348  2288 raft_consensus.cc:493] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.694517  2307 raft_consensus.cc:2749] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.716846  2288 raft_consensus.cc:515] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:33.718932  2288 leader_election.cc:290] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.720592  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.739777  1916 raft_consensus.cc:2393] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:33.740784  1965 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.741467  1965 ts_tablet_manager.cc:1403] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.010s
I20260709 13:13:33.698025  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:33.744374  1961 ts_tablet_manager.cc:1434] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:13:33.746150  1961 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:33.756942  1965 raft_consensus.cc:359] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.757764  1965 raft_consensus.cc:385] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.758083  1965 raft_consensus.cc:740] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.758810  1965 consensus_queue.cc:260] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.747268  1920 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.765268  1965 ts_tablet_manager.cc:1434] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:13:33.766378  1965 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.772989  1768 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.777695  1920 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:33.790164  1661 leader_election.cc:304] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:33.787477  1962 tablet_bootstrap.cc:654] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.788178  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.788599  2059 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:33.782632  2166 raft_consensus.cc:493] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.798139  1736 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.798609  2288 raft_consensus.cc:2804] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:33.811117  2288 raft_consensus.cc:493] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.811381  2228 raft_consensus.cc:2749] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:33.811607  2288 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.813699  1771 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:33.801740  2166 raft_consensus.cc:515] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.819583  2166 leader_election.cc:290] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:33.834721  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:33.843668  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:33.847571  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a73eb01dda4e8c9b2d0f84b2974e65" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.849004  1961 tablet_bootstrap.cc:654] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.849350  1883 leader_election.cc:304] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:33.851989  2164 raft_consensus.cc:2749] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.854666  1965 tablet_bootstrap.cc:654] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.862259  1966 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:33.862725  1966 ts_tablet_manager.cc:1403] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.292s	user 0.027s	sys 0.017s
I20260709 13:13:33.858019  2301 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:33.864235  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 70749.9us
I20260709 13:13:33.866237  2301 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.877206  1966 raft_consensus.cc:359] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.880069  1697 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.882139  2301 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.883190  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:33.886615  1661 leader_election.cc:304] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:33.888301  2036 raft_consensus.cc:2749] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.877926  1966 raft_consensus.cc:385] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.890482  1661 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:33.890847  1966 raft_consensus.cc:740] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.891479  2059 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.891933  2059 raft_consensus.cc:697] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:33.891692  1966 consensus_queue.cc:260] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.892808  2059 consensus_queue.cc:237] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.900421  1966 ts_tablet_manager.cc:1434] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:13:33.881484  2288 raft_consensus.cc:515] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:33.907963  1962 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:33.908211  2288 leader_election.cc:290] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:33.908547  1962 ts_tablet_manager.cc:1403] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.024s
I20260709 13:13:33.909946  1965 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:33.910467  1965 ts_tablet_manager.cc:1403] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.015s
I20260709 13:13:33.913139  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:33.913779  1842 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.918407  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.919080  1916 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:33.924868  1966 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:33.924768  2131 consensus_queue.cc:1048] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.928428  1810 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:33.930338  2188 raft_consensus.cc:2804] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:33.930790  2188 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.931123  2188 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.913295  1965 raft_consensus.cc:359] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.932626  1965 raft_consensus.cc:385] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.932915  1965 raft_consensus.cc:740] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.933585  1965 consensus_queue.cc:260] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.937271  1962 raft_consensus.cc:359] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.938043  1962 raft_consensus.cc:385] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.938341  1962 raft_consensus.cc:740] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.939039  1962 consensus_queue.cc:260] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
W20260709 13:13:33.942356  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 44482us
I20260709 13:13:33.956964  1962 ts_tablet_manager.cc:1434] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:13:33.958161  1962 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:33.965797  1961 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:33.966399  1961 ts_tablet_manager.cc:1403] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.220s	user 0.009s	sys 0.016s
I20260709 13:13:33.966462  2228 consensus_queue.cc:1048] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.967895  2228 raft_consensus.cc:493] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8863ebea2ba4d47949f4b8b6a757d47)
I20260709 13:13:33.968168  1965 ts_tablet_manager.cc:1434] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:13:33.969219  2228 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:33.970539  1961 raft_consensus.cc:359] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.971271  1961 raft_consensus.cc:385] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.971557  1961 raft_consensus.cc:740] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.972828  1961 consensus_queue.cc:260] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:33.974692  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:33.975570  1916 raft_consensus.cc:2393] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:33.978368  1965 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:33.980611  1966 tablet_bootstrap.cc:654] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.990365  1961 ts_tablet_manager.cc:1434] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:13:33.996083  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:33.989544  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:33.997493  1842 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:33.980608  2228 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:33.998667  1661 leader_election.cc:304] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:34.004690  2059 raft_consensus.cc:2804] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.004312  2188 raft_consensus.cc:515] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.005226  2059 raft_consensus.cc:697] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
W20260709 13:13:34.005260  1660 leader_election.cc:343] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.006225  2059 consensus_queue.cc:237] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:33.980682  1810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 51127.5us
I20260709 13:13:34.018198  2301 raft_consensus.cc:493] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.018877  2301 raft_consensus.cc:515] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.022228  1961 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:34.026747  2326 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.027398  2326 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.028299  2131 consensus_queue.cc:1048] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.023296  1845 raft_consensus.cc:2368] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 for earlier term 2. Current term is 3.
I20260709 13:13:34.037731  1736 leader_election.cc:400] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969) with higher term. Message: Invalid argument: T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 for earlier term 2. Current term is 3.
I20260709 13:13:34.038137  1736 leader_election.cc:403] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.037817  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.038837  1839 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:34.039474  2228 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.040436  1661 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:34.030336  2326 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.044986  2323 raft_consensus.cc:2804] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.046077  2323 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.046473  2323 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.046934  2123 consensus_queue.cc:1048] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.031528  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.052091  1965 tablet_bootstrap.cc:654] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.053083  2301 leader_election.cc:290] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.063973  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:34.076009  1810 leader_election.cc:343] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:34.081102  1660 leader_election.cc:343] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.082017  2228 raft_consensus.cc:2749] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969) with higher term. Message: Invalid argument: T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 for earlier term 2. Current term is 3.
I20260709 13:13:34.095467  1768 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.077535  2323 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.093581  1592 catalog_manager.cc:5697] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.107779  2188 leader_election.cc:290] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 3 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.119268  1966 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:34.119844  1966 ts_tablet_manager.cc:1403] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.195s	user 0.035s	sys 0.047s
I20260709 13:13:34.121088  1962 tablet_bootstrap.cc:654] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.111706  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.134967  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:34.135703  1919 raft_consensus.cc:3060] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.139441  1917 raft_consensus.cc:3060] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.140838  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebae9483f2ce49e68f23279ac74cfbf4" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:34.150267  1961 tablet_bootstrap.cc:654] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:34.158238  1809 leader_election.cc:343] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.158820  1809 leader_election.cc:304] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.159816  2331 raft_consensus.cc:2749] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.168890  1965 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:34.170142  1965 ts_tablet_manager.cc:1403] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.012s
I20260709 13:13:34.174784  1919 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 3.
I20260709 13:13:34.176183  1810 leader_election.cc:304] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:34.177150  2188 raft_consensus.cc:2804] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.177706  2188 raft_consensus.cc:697] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:34.178637  2188 consensus_queue.cc:237] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.183360  1769 raft_consensus.cc:2468] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 3.
I20260709 13:13:34.188381  2323 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.190884  1966 raft_consensus.cc:359] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.193367  1966 raft_consensus.cc:385] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.193682  1966 raft_consensus.cc:740] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.194577  1966 consensus_queue.cc:260] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.200933  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
W20260709 13:13:34.202323  1660 leader_election.cc:343] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.202541  1966 ts_tablet_manager.cc:1434] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.002s
I20260709 13:13:34.204097  1990 raft_consensus.cc:493] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.204211  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:34.204794  1990 raft_consensus.cc:515] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.205293  1840 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.208971  1990 leader_election.cc:290] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:34.209157  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.199342  1965 raft_consensus.cc:359] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.209851  1697 raft_consensus.cc:2468] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:34.209924  1965 raft_consensus.cc:385] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.210196  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.210932  1965 raft_consensus.cc:740] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.211190  1885 leader_election.cc:304] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:34.211236  1770 raft_consensus.cc:2468] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:34.212384  1990 raft_consensus.cc:2804] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.211838  1965 consensus_queue.cc:260] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.212841  1990 raft_consensus.cc:493] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.216243  1990 raft_consensus.cc:3060] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.217124  1965 ts_tablet_manager.cc:1434] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:13:34.218515  1965 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:34.219345  1966 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:34.245968  1961 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:34.246587  1961 ts_tablet_manager.cc:1403] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.255s	user 0.012s	sys 0.011s
I20260709 13:13:34.254361  1962 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:34.254874  1962 ts_tablet_manager.cc:1403] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.297s	user 0.017s	sys 0.006s
I20260709 13:13:34.263515  1962 raft_consensus.cc:359] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.264559  1962 raft_consensus.cc:385] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.265360  1962 raft_consensus.cc:740] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.272940  1965 tablet_bootstrap.cc:654] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.273686  1962 consensus_queue.cc:260] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.275894  1962 ts_tablet_manager.cc:1434] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:34.276796  1962 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:34.278096  2288 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.278573  2288 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.283269  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:34.283679  2123 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:34.284513  2123 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:34.285425  1661 leader_election.cc:343] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.286255  2288 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:34.287055  1962 tablet_bootstrap.cc:654] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.288071  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.288730  1769 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:34.289960  1660 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.291083  2288 raft_consensus.cc:2804] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.291431  2288 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.291744  2288 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.292045  1961 raft_consensus.cc:359] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.297134  1961 raft_consensus.cc:385] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.297487  1961 raft_consensus.cc:740] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.280063  1966 tablet_bootstrap.cc:654] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.303213  2251 raft_consensus.cc:493] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.303457  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.303833  2123 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.304014  2251 raft_consensus.cc:515] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.298146  1961 consensus_queue.cc:260] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.306623  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.307823  1961 ts_tablet_manager.cc:1434] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:13:34.308827  1961 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:34.310621  2229 raft_consensus.cc:493] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.311129  2229 raft_consensus.cc:515] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.311482  1736 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:34.313506  2229 leader_election.cc:290] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.315500  2251 leader_election.cc:290] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:34.316293  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.316331  1961 tablet_bootstrap.cc:654] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.272663  1840 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:34.317252  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.318769  2301 raft_consensus.cc:493] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.319099  2229 raft_consensus.cc:2749] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:34.326718  1885 leader_election.cc:343] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.328603  2301 raft_consensus.cc:515] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.330238  1965 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:34.330744  1965 ts_tablet_manager.cc:1403] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.010s
I20260709 13:13:34.330907  2301 leader_election.cc:290] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:34.332576  1917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:34.333447  1965 raft_consensus.cc:359] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.335003  1965 raft_consensus.cc:385] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.333647  1990 raft_consensus.cc:515] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.334396  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:34.335256  1810 leader_election.cc:343] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:34.336375  1736 leader_election.cc:343] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.335300  1965 raft_consensus.cc:740] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.337210  2288 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.337656  1965 consensus_queue.cc:260] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.341708  1990 leader_election.cc:290] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:34.341892  1884 leader_election.cc:343] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.342345  1884 leader_election.cc:304] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:34.343498  1661 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:34.343427  2164 raft_consensus.cc:2749] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.346654  1965 ts_tablet_manager.cc:1434] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:13:34.347517  1965 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:34.345813  2326 raft_consensus.cc:2804] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.353269  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.361738  1965 tablet_bootstrap.cc:654] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.362449  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:34.363070  1770 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.378798  1770 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:34.380916  2059 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.396827  1660 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:34.399123  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:34.355332  2326 raft_consensus.cc:697] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:34.399876  1768 raft_consensus.cc:3060] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.400490  2326 consensus_queue.cc:237] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.403390  2324 raft_consensus.cc:2804] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.403903  2324 raft_consensus.cc:697] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:34.407311  1962 tablet_bootstrap.cc:492] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:34.407896  1962 ts_tablet_manager.cc:1403] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.131s	user 0.022s	sys 0.010s
I20260709 13:13:34.380216  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.388983  2202 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.414789  1811 leader_election.cc:343] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.415314  1811 leader_election.cc:304] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.406499  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:34.381099  2288 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:34.416942  1845 raft_consensus.cc:2468] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:34.438925  1966 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:34.439522  1966 ts_tablet_manager.cc:1403] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.022s
I20260709 13:13:34.440776  1961 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:34.441768  1961 ts_tablet_manager.cc:1403] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.133s	user 0.042s	sys 0.027s
I20260709 13:13:34.442263  1966 raft_consensus.cc:359] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.416554  2324 consensus_queue.cc:237] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.443007  1966 raft_consensus.cc:385] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.419263  2188 raft_consensus.cc:2749] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.445680  1966 raft_consensus.cc:740] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.441510  1962 raft_consensus.cc:359] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.447629  1962 raft_consensus.cc:385] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.448047  1962 raft_consensus.cc:740] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.449394  1962 consensus_queue.cc:260] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.446609  1966 consensus_queue.cc:260] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.456638  1965 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:34.457365  1965 ts_tablet_manager.cc:1403] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.032s
I20260709 13:13:34.416718  2202 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.459187  1736 leader_election.cc:304] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.434693  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95515768424547f5a244a3c431e77af8" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:34.462879  1966 ts_tablet_manager.cc:1434] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 13:13:34.468135  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 73696.4us
I20260709 13:13:34.471539  1966 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:34.477085  1591 catalog_manager.cc:5697] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.473776  1694 raft_consensus.cc:3060] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.491040  1961 raft_consensus.cc:359] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.494742  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.494547  1961 raft_consensus.cc:385] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.496243  1961 raft_consensus.cc:740] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.470952  2229 raft_consensus.cc:2804] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.503285  2229 raft_consensus.cc:493] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.503625  2229 raft_consensus.cc:3060] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:34.506764  1660 leader_election.cc:343] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.472296  2036 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:13:34.512084  1661 leader_election.cc:343] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.499300  1961 consensus_queue.cc:260] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.540712  1961 ts_tablet_manager.cc:1434] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:13:34.543263  1962 ts_tablet_manager.cc:1434] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.135s	user 0.021s	sys 0.009s
I20260709 13:13:34.545357  1961 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:34.546231  1962 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:34.552785  1768 raft_consensus.cc:2468] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:34.554561  1965 raft_consensus.cc:359] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.554910  1883 leader_election.cc:304] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:34.555318  1965 raft_consensus.cc:385] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.544287  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.555739  1965 raft_consensus.cc:740] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.559592  2202 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.564972  1694 raft_consensus.cc:2468] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:34.566771  1966 tablet_bootstrap.cc:654] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.572952  2357 raft_consensus.cc:2804] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.573518  2357 raft_consensus.cc:697] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:34.574361  2357 consensus_queue.cc:237] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.556437  1965 consensus_queue.cc:260] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.572906  1961 tablet_bootstrap.cc:654] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:34.580104  1661 leader_election.cc:343] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.580739  1661 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:34.583343  1965 ts_tablet_manager.cc:1434] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.001s
I20260709 13:13:34.584235  1965 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:34.597872  1918 raft_consensus.cc:1275] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:34.581364  2123 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.599741  2188 consensus_queue.cc:1048] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.598788  2123 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
W20260709 13:13:34.601006  1660 consensus_peers.cc:597] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:34.643041  1966 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:34.643606  1966 ts_tablet_manager.cc:1403] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.016s
I20260709 13:13:34.647759  1966 raft_consensus.cc:359] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.648527  1966 raft_consensus.cc:385] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.648849  1966 raft_consensus.cc:740] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.649619  1966 consensus_queue.cc:260] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.651997  1966 ts_tablet_manager.cc:1434] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:34.617080  2324 raft_consensus.cc:2749] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.656133  2229 raft_consensus.cc:515] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.657142  2028 raft_consensus.cc:493] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.656837  1966 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:34.657737  2028 raft_consensus.cc:515] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.659866  2028 leader_election.cc:290] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:34.660837  1965 tablet_bootstrap.cc:654] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.662987  2123 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.663690  1962 tablet_bootstrap.cc:654] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.664371  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:34.665023  1916 raft_consensus.cc:3060] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.665329  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bfa49cabd9d408cad9a18a6f67ec10e" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:34.665913  1842 raft_consensus.cc:3060] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.664371  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.692812  1966 tablet_bootstrap.cc:654] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:34.698496  1737 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.694212  1593 catalog_manager.cc:5697] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.701496  1593 catalog_manager.cc:5697] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.666476  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.677230  2229 leader_election.cc:290] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.681212  2036 consensus_queue.cc:1048] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:13:34.692451  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
W20260709 13:13:34.713538  1736 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.714046  1736 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:34.714916  2229 raft_consensus.cc:2749] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:34.715597  1660 leader_election.cc:343] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.717409  1917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:34.722867  1661 leader_election.cc:343] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.723604  1661 leader_election.cc:304] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.726747  2352 raft_consensus.cc:2749] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.738699  1842 raft_consensus.cc:2468] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:34.739923  1593 catalog_manager.cc:5697] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.730847  1916 raft_consensus.cc:2468] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:34.754956  1736 leader_election.cc:304] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:34.761379  2123 raft_consensus.cc:2804] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.810803  1594 catalog_manager.cc:5697] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.803375  2123 raft_consensus.cc:697] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:34.816869  1961 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:34.817385  1961 ts_tablet_manager.cc:1403] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.275s	user 0.019s	sys 0.010s
I20260709 13:13:34.818612  1962 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:34.819398  1962 ts_tablet_manager.cc:1403] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.275s	user 0.017s	sys 0.010s
I20260709 13:13:34.808476  1769 raft_consensus.cc:1275] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:34.823151  1962 raft_consensus.cc:359] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.826519  1962 raft_consensus.cc:385] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.826810  1962 raft_consensus.cc:740] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.828528  2301 consensus_queue.cc:1048] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:34.836350  1961 raft_consensus.cc:359] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.837081  1961 raft_consensus.cc:385] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.837440  1961 raft_consensus.cc:740] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.838208  1962 consensus_queue.cc:260] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.830670  2123 consensus_queue.cc:237] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.841363  1962 ts_tablet_manager.cc:1434] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:34.842334  1962 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:34.829241  1769 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.848062  1961 consensus_queue.cc:260] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.856253  1961 ts_tablet_manager.cc:1434] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:13:34.856413  1962 tablet_bootstrap.cc:654] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.860260  2301 raft_consensus.cc:493] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.861086  2301 raft_consensus.cc:515] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.862341  1961 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:34.861732  1965 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:34.865149  1965 ts_tablet_manager.cc:1403] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.281s	user 0.014s	sys 0.016s
I20260709 13:13:34.867561  2301 leader_election.cc:290] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.868028  1965 raft_consensus.cc:359] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.868752  1965 raft_consensus.cc:385] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.869052  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
W20260709 13:13:34.870782  1810 leader_election.cc:343] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.870791  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.875061  2323 consensus_queue.cc:1048] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.877242  1966 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:34.877718  1966 ts_tablet_manager.cc:1403] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.011s
I20260709 13:13:34.880797  1966 raft_consensus.cc:359] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.881421  1966 raft_consensus.cc:385] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.881660  1966 raft_consensus.cc:740] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
W20260709 13:13:34.882527  1809 leader_election.cc:343] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.883196  1809 leader_election.cc:304] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:34.884549  2301 raft_consensus.cc:2749] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.889060  2323 consensus_queue.cc:1048] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.893349  1962 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:34.894025  1962 ts_tablet_manager.cc:1403] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260709 13:13:34.897354  1962 raft_consensus.cc:359] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.898188  2229 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.898715  2229 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:34.899240  2322 consensus_queue.cc:1048] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.899804  1966 consensus_queue.cc:260] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:34.902220  1966 ts_tablet_manager.cc:1434] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:13:34.902868  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:34.903163  1966 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:34.903882  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:34.906469  2229 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:34.906873  1737 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:34.898000  1962 raft_consensus.cc:385] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.907821  1962 raft_consensus.cc:740] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.908529  1962 consensus_queue.cc:260] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.909943  1591 catalog_manager.cc:5697] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.910977  1962 ts_tablet_manager.cc:1434] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:13:34.913098  1966 tablet_bootstrap.cc:654] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.916219  1962 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:34.922662  1962 tablet_bootstrap.cc:654] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.940415  1962 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:34.940945  1962 ts_tablet_manager.cc:1403] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 13:13:34.869042  1965 raft_consensus.cc:740] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.945693  1965 consensus_queue.cc:260] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.948607  2301 raft_consensus.cc:493] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.949126  2301 raft_consensus.cc:515] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:34.958684  2301 leader_election.cc:290] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:34.960687  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:34.961686  1920 raft_consensus.cc:2468] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:34.963181  1810 leader_election.cc:304] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:34.964061  2301 raft_consensus.cc:2804] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.964483  2301 raft_consensus.cc:493] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.966512  2301 raft_consensus.cc:3060] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.936811  1961 tablet_bootstrap.cc:654] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.967943  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:34.968911  1920 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.973394  1965 ts_tablet_manager.cc:1434] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:13:34.974453  1965 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:34.971218  1962 raft_consensus.cc:359] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:34.979799  1962 raft_consensus.cc:385] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.981572  1962 raft_consensus.cc:740] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.984282  1965 tablet_bootstrap.cc:654] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.986667  1962 consensus_queue.cc:260] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
W20260709 13:13:34.989707  1809 leader_election.cc:343] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.988062  2301 raft_consensus.cc:515] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.008415  2301 leader_election.cc:290] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:35.005344  1962 ts_tablet_manager.cc:1434] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:13:35.012135  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:35.012920  1916 raft_consensus.cc:3060] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.014273  1962 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:35.026819  1962 tablet_bootstrap.cc:654] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.030467  2229 raft_consensus.cc:2749] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:35.032191  1961 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:35.032933  1961 ts_tablet_manager.cc:1403] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.004s
I20260709 13:13:35.040844  1916 raft_consensus.cc:2468] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:35.042678  1810 leader_election.cc:304] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.043893  2301 raft_consensus.cc:2804] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.044530  2301 raft_consensus.cc:697] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:35.045657  2301 consensus_queue.cc:237] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.054790  2323 consensus_queue.cc:1048] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.061331  1961 raft_consensus.cc:359] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.070312  1961 raft_consensus.cc:385] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.071272  1961 raft_consensus.cc:740] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
W20260709 13:13:35.076421  2379 log.cc:927] Time spent T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:35.079052  1961 consensus_queue.cc:260] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.083439  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:35.085232  1961 ts_tablet_manager.cc:1434] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:13:35.086229  1961 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:35.089781  1595 catalog_manager.cc:5697] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.091321  1965 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:35.091806  1965 ts_tablet_manager.cc:1403] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.118s	user 0.006s	sys 0.006s
I20260709 13:13:35.095180  1965 raft_consensus.cc:359] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.100374  1965 raft_consensus.cc:385] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.100643  1965 raft_consensus.cc:740] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.101215  1965 consensus_queue.cc:260] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.104630  1962 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:35.105125  1962 ts_tablet_manager.cc:1403] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.040s
I20260709 13:13:35.106216  2164 consensus_queue.cc:1048] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.107729  1962 raft_consensus.cc:359] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.108408  1962 raft_consensus.cc:385] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.108662  1962 raft_consensus.cc:740] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.109555  1962 consensus_queue.cc:260] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.110870  1965 ts_tablet_manager.cc:1434] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:35.111954  1962 ts_tablet_manager.cc:1434] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:35.112862  1962 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:35.114358  1965 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:35.120446  1961 tablet_bootstrap.cc:654] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:35.121865  1809 leader_election.cc:343] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.122473  1962 tablet_bootstrap.cc:654] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.126754  2301 raft_consensus.cc:493] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.127451  2301 raft_consensus.cc:515] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.131949  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.132023  2301 leader_election.cc:290] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.132577  1916 raft_consensus.cc:2468] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:35.134128  1810 leader_election.cc:304] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.134383  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:35.135879  1811 leader_election.cc:343] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.136334  2188 raft_consensus.cc:2804] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.136744  2188 raft_consensus.cc:493] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.137072  2188 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.138338  2028 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.138837  2028 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.140681  1965 tablet_bootstrap.cc:654] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.141373  2028 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:35.145798  1961 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:35.146484  1961 ts_tablet_manager.cc:1403] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.003s
W20260709 13:13:35.151748  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:35.153126  1961 raft_consensus.cc:359] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.153898  1961 raft_consensus.cc:385] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.160113  1961 raft_consensus.cc:740] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.158681  1965 tablet_bootstrap.cc:492] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:35.161147  1965 ts_tablet_manager.cc:1403] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.002s
I20260709 13:13:35.161732  1962 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:35.162242  1962 ts_tablet_manager.cc:1403] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.016s
I20260709 13:13:35.164008  1965 raft_consensus.cc:359] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.165644  1965 raft_consensus.cc:385] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.164915  1961 consensus_queue.cc:260] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.166019  1965 raft_consensus.cc:740] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.165900  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.166965  1965 consensus_queue.cc:260] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
W20260709 13:13:35.168573  1661 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.169478  1961 ts_tablet_manager.cc:1434] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:35.170450  1961 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:35.170763  1962 raft_consensus.cc:359] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.171415  1962 raft_consensus.cc:385] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.171675  1962 raft_consensus.cc:740] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.173141  1965 ts_tablet_manager.cc:1434] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:35.172412  1962 consensus_queue.cc:260] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.179661  1965 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:35.180415  1962 ts_tablet_manager.cc:1434] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:13:35.181321  1962 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:35.178618  1961 tablet_bootstrap.cc:654] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.187580  1962 tablet_bootstrap.cc:654] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.188910  1965 tablet_bootstrap.cc:654] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.195514  1961 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:35.196098  1961 ts_tablet_manager.cc:1403] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:13:35.199273  1961 raft_consensus.cc:359] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.201267  1961 raft_consensus.cc:385] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.201586  1961 raft_consensus.cc:740] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.204449  1962 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:35.205196  1962 ts_tablet_manager.cc:1403] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 13:13:35.202361  1961 consensus_queue.cc:260] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.210317  1961 ts_tablet_manager.cc:1434] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:35.212724  1961 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:35.211388  1962 raft_consensus.cc:359] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.214928  1962 raft_consensus.cc:385] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.215215  1962 raft_consensus.cc:740] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.215610  2028 raft_consensus.cc:493] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.215979  1962 consensus_queue.cc:260] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.216111  2028 raft_consensus.cc:515] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.218289  1962 ts_tablet_manager.cc:1434] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:13:35.218402  2028 leader_election.cc:290] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:35.219949  1961 tablet_bootstrap.cc:654] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.220712  1965 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:35.221275  1965 ts_tablet_manager.cc:1403] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.005s
I20260709 13:13:35.228499  1965 raft_consensus.cc:359] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.229197  1965 raft_consensus.cc:385] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.229542  1965 raft_consensus.cc:740] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.228919  1962 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: Bootstrap starting.
I20260709 13:13:35.230329  1965 consensus_queue.cc:260] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.232385  1965 ts_tablet_manager.cc:1434] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:35.233274  1965 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:35.240831  1962 tablet_bootstrap.cc:654] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.247885  1965 tablet_bootstrap.cc:654] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.250877  2164 raft_consensus.cc:493] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.251251  1770 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.251675  2164 raft_consensus.cc:515] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.255066  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f3dde06d094fd381efb549e6f2ec75" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.255841  1697 raft_consensus.cc:2468] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.257313  1885 leader_election.cc:304] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.258757  2357 raft_consensus.cc:2804] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.259276  2357 raft_consensus.cc:493] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.260028  2357 raft_consensus.cc:3060] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.266753  2164 leader_election.cc:290] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:35.259753  2188 raft_consensus.cc:515] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.276645  2400 raft_consensus.cc:493] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.287369  2400 raft_consensus.cc:515] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.290388  2400 leader_election.cc:290] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.291635  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.271307  1966 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:35.301608  1966 ts_tablet_manager.cc:1403] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.399s	user 0.090s	sys 0.180s
I20260709 13:13:35.301591  1694 raft_consensus.cc:2468] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.303444  1885 leader_election.cc:304] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.304613  1966 raft_consensus.cc:359] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.305349  1966 raft_consensus.cc:385] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.305617  1966 raft_consensus.cc:740] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.306331  1966 consensus_queue.cc:260] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.307834  2400 raft_consensus.cc:2804] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.311445  1966 ts_tablet_manager.cc:1434] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:13:35.311462  2400 raft_consensus.cc:493] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:35.309542  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 59958.3us
I20260709 13:13:35.310461  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.313480  1694 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.312376  1962 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: No bootstrap required, opened a new log
I20260709 13:13:35.314381  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.314735  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.314725  1962 ts_tablet_manager.cc:1403] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.006s
I20260709 13:13:35.315073  1768 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:35.315537  1840 raft_consensus.cc:2468] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 0.
I20260709 13:13:35.317901  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.318627  1962 raft_consensus.cc:359] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.312399  1966 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:35.319322  1962 raft_consensus.cc:385] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.323894  1962 raft_consensus.cc:740] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.324563  1962 consensus_queue.cc:260] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.326740  1962 ts_tablet_manager.cc:1434] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:35.328226  2371 raft_consensus.cc:493] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.328935  2371 raft_consensus.cc:515] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.332816  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.333681  1695 raft_consensus.cc:2468] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:35.335124  2371 leader_election.cc:290] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.337090  1737 leader_election.cc:304] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:35.340919  2123 raft_consensus.cc:2804] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.341452  2123 raft_consensus.cc:493] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.341861  2123 raft_consensus.cc:3060] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.345472  1694 raft_consensus.cc:2468] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:35.348205  1811 leader_election.cc:304] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.348769  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:35.349432  1919 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.350090  1965 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:35.350551  1965 ts_tablet_manager.cc:1403] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.015s
I20260709 13:13:35.350967  1966 tablet_bootstrap.cc:654] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.353072  1965 raft_consensus.cc:359] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.353756  1965 raft_consensus.cc:385] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.356379  1919 raft_consensus.cc:2468] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:35.357370  2301 raft_consensus.cc:2804] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.357903  2301 raft_consensus.cc:697] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:35.353997  1965 raft_consensus.cc:740] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.309212  2188 leader_election.cc:290] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.358794  2301 consensus_queue.cc:237] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.359730  1965 consensus_queue.cc:260] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.361060  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.361613  1965 ts_tablet_manager.cc:1434] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:35.361056  2398 raft_consensus.cc:493] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.362716  1965 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: Bootstrap starting.
I20260709 13:13:35.362515  2398 raft_consensus.cc:515] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.366036  1916 raft_consensus.cc:2468] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:35.367652  1966 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:35.368114  1966 ts_tablet_manager.cc:1403] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.001s
I20260709 13:13:35.368903  1965 tablet_bootstrap.cc:654] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.372162  2188 raft_consensus.cc:493] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.372654  2188 raft_consensus.cc:515] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.375022  2188 leader_election.cc:290] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.376338  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:35.379484  1811 leader_election.cc:343] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:35.361510  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.380661  1840 raft_consensus.cc:2468] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.384120  1965 tablet_bootstrap.cc:492] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: No bootstrap required, opened a new log
I20260709 13:13:35.383522  1591 catalog_manager.cc:5697] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.384608  1965 ts_tablet_manager.cc:1403] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:13:35.385664  2123 raft_consensus.cc:515] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.388010  1966 raft_consensus.cc:359] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.392812  1966 raft_consensus.cc:385] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.393179  1966 raft_consensus.cc:740] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.394021  1966 consensus_queue.cc:260] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.396438  1966 ts_tablet_manager.cc:1434] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:13:35.397367  1966 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: Bootstrap starting.
I20260709 13:13:35.401291  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.402045  1919 raft_consensus.cc:2468] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:35.389196  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:35.402894  1916 raft_consensus.cc:3060] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.402931  1660 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:35.404284  2323 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.404650  2323 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.404974  2323 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.407686  2301 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.408155  2301 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.412568  2301 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:35.412667  2323 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.413838  1916 raft_consensus.cc:2468] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:35.415145  1966 tablet_bootstrap.cc:654] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:35.415469  1736 leader_election.cc:304] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.390736  1965 raft_consensus.cc:359] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.416440  2371 raft_consensus.cc:2804] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.418493  1810 leader_election.cc:304] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:35.418990  2371 raft_consensus.cc:697] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:35.420243  2301 raft_consensus.cc:2804] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.417562  1965 raft_consensus.cc:385] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.420874  2301 raft_consensus.cc:493] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.421700  2301 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.422253  1966 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: No bootstrap required, opened a new log
I20260709 13:13:35.422788  1966 ts_tablet_manager.cc:1403] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:13:35.418681  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.425806  1966 raft_consensus.cc:359] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.426709  1966 raft_consensus.cc:385] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.427009  1966 raft_consensus.cc:740] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.427121  1694 raft_consensus.cc:2393] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:35.427680  1966 consensus_queue.cc:260] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.433684  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.434652  1694 raft_consensus.cc:2468] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.417727  2400 raft_consensus.cc:3060] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.436424  1885 leader_election.cc:304] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.437426  2358 raft_consensus.cc:2764] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:35.442656  1966 ts_tablet_manager.cc:1434] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:35.442791  2398 leader_election.cc:290] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:35.447327  2123 leader_election.cc:290] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.448359  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.449098  1697 raft_consensus.cc:3060] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.449220  2229 consensus_queue.cc:1048] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.456719  1697 raft_consensus.cc:2468] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:35.462694  2229 consensus_queue.cc:1048] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.421222  1965 raft_consensus.cc:740] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.472332  1965 consensus_queue.cc:260] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.475819  1965 ts_tablet_manager.cc:1434] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:13:35.475976  2323 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:35.420034  2371 consensus_queue.cc:237] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.480486  1961 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: No bootstrap required, opened a new log
I20260709 13:13:35.481036  1961 ts_tablet_manager.cc:1403] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.269s	user 0.073s	sys 0.073s
I20260709 13:13:35.483053  1661 leader_election.cc:304] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.483266  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f3dde06d094fd381efb549e6f2ec75" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.484025  2028 raft_consensus.cc:2804] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.484403  2028 raft_consensus.cc:493] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.294983  2357 raft_consensus.cc:515] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.484700  2028 raft_consensus.cc:3060] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.485055  1961 raft_consensus.cc:359] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.485765  1961 raft_consensus.cc:385] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:35.485824  1770 raft_consensus.cc:2468] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.486105  1961 raft_consensus.cc:740] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:35.487047  1961 consensus_queue.cc:260] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.489531  1961 ts_tablet_manager.cc:1434] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:35.494419  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f3dde06d094fd381efb549e6f2ec75" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.495141  1694 raft_consensus.cc:3060] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.492951  2357 leader_election.cc:290] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:35.504215  2301 raft_consensus.cc:515] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.504782  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895498f388084e08825b03b57b266577" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.507228  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f3dde06d094fd381efb549e6f2ec75" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:35.507825  1769 raft_consensus.cc:3060] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.508462  2301 leader_election.cc:290] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.510363  1694 raft_consensus.cc:2468] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:35.512004  1885 leader_election.cc:304] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.513103  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.513698  1697 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.513499  2400 raft_consensus.cc:515] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.515379  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:35.515537  2400 leader_election.cc:290] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:35.515959  1916 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.516142  2400 raft_consensus.cc:2804] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.516660  2400 raft_consensus.cc:697] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:35.516953  1769 raft_consensus.cc:2468] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:35.517419  2400 consensus_queue.cc:237] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:35.519084  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:35.519665  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.522639  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.523228  1769 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:35.524772  1769 raft_consensus.cc:3060] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.524807  2164 consensus_queue.cc:1048] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.519671  1844 raft_consensus.cc:3060] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.529368  1920 raft_consensus.cc:2393] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:35.534562  2131 consensus_queue.cc:1048] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:35.537163  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:35.537765  1768 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.544224  2028 raft_consensus.cc:515] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.545325  1768 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 1.
I20260709 13:13:35.545605  1695 raft_consensus.cc:2393] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:35.547049  1809 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:35.548432  2131 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.548796  2131 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.549144  2131 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.561193  1844 raft_consensus.cc:2468] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:35.563001  1916 raft_consensus.cc:2468] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:35.566300  2028 leader_election.cc:290] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
W20260709 13:13:35.568421  1883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 46422.9us
I20260709 13:13:35.576689  2400 raft_consensus.cc:493] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.577273  2400 raft_consensus.cc:515] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.579042  2131 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.581395  2400 leader_election.cc:290] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:35.552662  1697 raft_consensus.cc:2468] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
W20260709 13:13:35.626736  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 116564us
I20260709 13:13:35.636272  2188 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.648641  2188 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.638626  1810 leader_election.cc:304] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
W20260709 13:13:35.655184  1810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 81861.8us
I20260709 13:13:35.660372  2235 raft_consensus.cc:2804] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.674499  2123 raft_consensus.cc:493] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.675823  2123 raft_consensus.cc:515] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.695351  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.696623  1916 raft_consensus.cc:2468] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:35.697557  2123 leader_election.cc:290] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:35.699064  2131 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:35.659402  2188 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:35.717326  1811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 78623.7us
I20260709 13:13:35.723356  2235 raft_consensus.cc:697] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:35.725356  2123 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.735184  2235 consensus_queue.cc:237] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.771857  2371 raft_consensus.cc:493] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.772562  2371 raft_consensus.cc:515] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.772969  2123 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.776693  2123 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:35.777869  2371 leader_election.cc:290] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:35.772526  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:35.781126  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.782589  1771 raft_consensus.cc:2468] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
I20260709 13:13:35.761637  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:35.784245  1919 raft_consensus.cc:2393] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:35.760224  1736 leader_election.cc:304] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:35.786616  1840 raft_consensus.cc:2393] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:35.792666  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83bd1fbb8394658b54b12ae731dc56a" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:35.793995  1841 raft_consensus.cc:2393] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7709ff2ce6f24859b1ca96d2af6bd84c in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:35.796213  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.797068  1695 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:35.799114  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:35.787024  2371 raft_consensus.cc:2804] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.803402  1695 raft_consensus.cc:2393] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:35.754993  1884 leader_election.cc:304] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:35.811285  1884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 56706.2us
I20260709 13:13:35.809147  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:35.812204  2412 raft_consensus.cc:2804] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.808440  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaacc9a4b49abbc8a573403e1d836" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.802315  2371 raft_consensus.cc:493] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.822930  2371 raft_consensus.cc:3060] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.817340  2412 raft_consensus.cc:697] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:35.832922  1811 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.838142  2416 raft_consensus.cc:2804] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.827725  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.840255  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:35.841780  1695 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:35.839418  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:35.844313  1772 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 0.
I20260709 13:13:35.839339  2416 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.846865  2416 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.831663  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.854600  1841 raft_consensus.cc:2468] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 0.
I20260709 13:13:35.860476  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:35.861253  1841 raft_consensus.cc:2468] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 0.
W20260709 13:13:35.868374  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 118337us
I20260709 13:13:35.889611  1736 leader_election.cc:304] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:35.894924  1884 leader_election.cc:304] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:35.896095  2164 raft_consensus.cc:2804] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.896508  2164 raft_consensus.cc:493] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.896885  2164 raft_consensus.cc:3060] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.898186  1660 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:35.899309  2323 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:35.899845  2323 raft_consensus.cc:697] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:35.901006  2323 consensus_queue.cc:237] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:35.927676  2412 consensus_queue.cc:237] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:35.930171  2229 raft_consensus.cc:2749] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:35.932559  1592 catalog_manager.cc:5697] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.953395  1737 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:35.922447  2131 consensus_queue.cc:1048] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:13:35.957191  2422 raft_consensus.cc:2804] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:35.957855  2422 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.958371  2422 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:35.941223  2371 raft_consensus.cc:515] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:35.983157  2371 leader_election.cc:290] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:35.996203  2418 consensus_queue.cc:1048] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.998273  1594 catalog_manager.cc:5697] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.008320  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:36.014947  1770 raft_consensus.cc:2393] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in this term.
I20260709 13:13:36.018363  2131 consensus_queue.cc:1048] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:13:36.041630  2416 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:36.045535  2416 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:36.053706  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:36.054473  1694 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.057160  1840 raft_consensus.cc:2393] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
W20260709 13:13:36.058262  2419 log.cc:927] Time spent T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:13:36.059111  2164 raft_consensus.cc:515] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:36.062645  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:36.063302  1842 raft_consensus.cc:3060] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.080070  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:36.083653  1809 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:36.084599  2418 raft_consensus.cc:2749] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:36.038620  1810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 49504.1us
I20260709 13:13:36.074946  2164 leader_election.cc:290] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:36.102633  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:36.103850  1772 raft_consensus.cc:2393] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 1: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:36.096393  2412 consensus_queue.cc:1048] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:36.110265  1661 leader_election.cc:304] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:36.111979  2059 raft_consensus.cc:2749] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.078400  1694 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:36.122707  2424 consensus_queue.cc:1048] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.124508  1811 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:36.125857  2418 raft_consensus.cc:2804] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.126459  2418 raft_consensus.cc:697] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:36.129588  2418 consensus_queue.cc:237] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:36.137192  1842 raft_consensus.cc:2468] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:36.142422  1884 leader_election.cc:304] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:36.150626  2164 raft_consensus.cc:2804] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.151252  2164 raft_consensus.cc:697] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:36.154968  2164 consensus_queue.cc:237] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:36.205505  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:36.196524  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c63166b5cb40ff87aacce96cd3f111" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:36.210207  2307 consensus_queue.cc:1048] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:36.210700  1840 raft_consensus.cc:2393] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:36.214687  2422 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:36.229372  1771 raft_consensus.cc:2393] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 1: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:36.231962  2422 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:36.232218  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:36.233407  1693 raft_consensus.cc:2393] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 1: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
W20260709 13:13:36.251199  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 61539.9us
I20260709 13:13:36.239921  2416 consensus_queue.cc:1048] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:13:36.306704  1591 catalog_manager.cc:5697] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.314028  2229 consensus_queue.cc:1048] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.319242  2301 consensus_queue.cc:1048] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.346239  1736 leader_election.cc:304] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:36.352720  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:36.365921  2307 raft_consensus.cc:2749] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.367275  1595 catalog_manager.cc:5697] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.413656  1736 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:36.420262  2422 raft_consensus.cc:2749] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:36.424383  1595 catalog_manager.cc:5697] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.426328  1595 catalog_manager.cc:5697] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 1 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:36.482221  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:36.490207  2412 consensus_queue.cc:1048] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.500537  1591 catalog_manager.cc:5697] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 1 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.546334  2424 consensus_queue.cc:1048] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.556699  2411 consensus_queue.cc:1048] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.603032  2409 consensus_queue.cc:1048] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.609308  2164 consensus_queue.cc:1048] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.641665  2399 consensus_queue.cc:1048] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:36.669689  2131 consensus_queue.cc:1048] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.695955  2416 consensus_queue.cc:1048] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:36.980257 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
W20260709 13:13:36.993795  1885 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 49 similar messages]
W20260709 13:13:36.998121  1885 consensus_peers.cc:597] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.019047  1737 consensus_peers.cc:597] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.030839 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.032979 26038 tablet_replica.cc:333] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.034041 26038 raft_consensus.cc:2243] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.034567 26038 raft_consensus.cc:2272] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.037173 26038 tablet_replica.cc:333] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.038025 26038 raft_consensus.cc:2243] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.038546 26038 raft_consensus.cc:2272] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.041968 26038 tablet_replica.cc:333] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.046012 26038 raft_consensus.cc:2243] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.046972 26038 raft_consensus.cc:2272] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.050199 26038 tablet_replica.cc:333] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.051085 26038 raft_consensus.cc:2243] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.051641 26038 raft_consensus.cc:2272] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.054378 26038 tablet_replica.cc:333] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.055017 26038 raft_consensus.cc:2243] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.055879 26038 raft_consensus.cc:2272] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.058495 26038 tablet_replica.cc:333] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.059180 26038 raft_consensus.cc:2243] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.059924 26038 raft_consensus.cc:2272] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.061810 26038 tablet_replica.cc:333] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.062408 26038 raft_consensus.cc:2243] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.063159 26038 raft_consensus.cc:2272] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.065306 26038 tablet_replica.cc:333] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.065853 26038 raft_consensus.cc:2243] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.066650 26038 raft_consensus.cc:2272] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.068696 26038 tablet_replica.cc:333] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.069265 26038 raft_consensus.cc:2243] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.069712 26038 raft_consensus.cc:2272] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.072316 26038 tablet_replica.cc:333] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.073117 26038 raft_consensus.cc:2243] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.074170 26038 raft_consensus.cc:2272] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.077292 26038 tablet_replica.cc:333] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.078147 26038 raft_consensus.cc:2243] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.078701 26038 raft_consensus.cc:2272] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.081493 26038 tablet_replica.cc:333] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.082149 26038 raft_consensus.cc:2243] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.082705 26038 raft_consensus.cc:2272] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.084844  1885 consensus_peers.cc:597] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.085632 26038 tablet_replica.cc:333] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.086624 26038 raft_consensus.cc:2243] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.087121 26038 raft_consensus.cc:2272] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.089632 26038 tablet_replica.cc:333] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.090487 26038 raft_consensus.cc:2243] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.090992 26038 raft_consensus.cc:2272] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.093640 26038 tablet_replica.cc:333] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.094372 26038 raft_consensus.cc:2243] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.095410 26038 raft_consensus.cc:2272] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.098187 26038 tablet_replica.cc:333] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.098879 26038 raft_consensus.cc:2243] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.100064 26038 raft_consensus.cc:2272] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.102622 26038 tablet_replica.cc:333] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.103099 26038 raft_consensus.cc:2243] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.103879 26038 raft_consensus.cc:2272] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.105742 26038 tablet_replica.cc:333] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.106336 26038 raft_consensus.cc:2243] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.106743 26038 raft_consensus.cc:2272] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.108789 26038 tablet_replica.cc:333] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.109261 26038 raft_consensus.cc:2243] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.109632 26038 raft_consensus.cc:2272] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.111546 26038 tablet_replica.cc:333] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.112025 26038 raft_consensus.cc:2243] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.112471 26038 raft_consensus.cc:2272] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.114703 26038 tablet_replica.cc:333] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.115381 26038 raft_consensus.cc:2243] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.115976 26038 raft_consensus.cc:2272] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.118618 26038 tablet_replica.cc:333] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.119498 26038 raft_consensus.cc:2243] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.119990 26038 raft_consensus.cc:2272] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.121345  1737 consensus_peers.cc:597] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.122615 26038 tablet_replica.cc:333] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.123288 26038 raft_consensus.cc:2243] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.123776 26038 raft_consensus.cc:2272] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.126603 26038 tablet_replica.cc:333] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.127501 26038 raft_consensus.cc:2243] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.128278 26038 raft_consensus.cc:2272] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.130849 26038 tablet_replica.cc:333] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
W20260709 13:13:37.130755  1811 consensus_peers.cc:597] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.131686 26038 raft_consensus.cc:2243] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.132412 26038 raft_consensus.cc:2272] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.134562 26038 tablet_replica.cc:333] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.135058 26038 raft_consensus.cc:2243] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.135936 26038 raft_consensus.cc:2272] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.138698 26038 tablet_replica.cc:333] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.139235 26038 raft_consensus.cc:2243] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.140317 26038 raft_consensus.cc:2272] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.143157 26038 tablet_replica.cc:333] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.143962 26038 raft_consensus.cc:2243] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.145066 26038 raft_consensus.cc:2272] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.147945 26038 tablet_replica.cc:333] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.148747 26038 raft_consensus.cc:2243] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.149639 26038 raft_consensus.cc:2272] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.150740  1885 consensus_peers.cc:597] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.152226 26038 tablet_replica.cc:333] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.152910 26038 raft_consensus.cc:2243] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.153959 26038 raft_consensus.cc:2272] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.154039  1811 consensus_peers.cc:597] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.156100 26038 tablet_replica.cc:333] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.156599 26038 raft_consensus.cc:2243] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.157271 26038 raft_consensus.cc:2272] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.159248 26038 tablet_replica.cc:333] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.159713 26038 raft_consensus.cc:2243] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.160482 26038 raft_consensus.cc:2272] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.162632 26038 tablet_replica.cc:333] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.163168 26038 raft_consensus.cc:2243] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.164000 26038 raft_consensus.cc:2272] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.166357 26038 tablet_replica.cc:333] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.166934 26038 raft_consensus.cc:2243] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.167826 26038 raft_consensus.cc:2272] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.169811 26038 tablet_replica.cc:333] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.170356 26038 raft_consensus.cc:2243] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.171046 26038 raft_consensus.cc:2272] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.173158 26038 tablet_replica.cc:333] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.173893 26038 raft_consensus.cc:2243] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.174435 26038 raft_consensus.cc:2272] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.176349 26038 tablet_replica.cc:333] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.176788 26038 raft_consensus.cc:2243] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.177127 26038 raft_consensus.cc:2272] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.179114 26038 tablet_replica.cc:333] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.179563 26038 raft_consensus.cc:2243] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.180261 26038 raft_consensus.cc:2272] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.182248 26038 tablet_replica.cc:333] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.182786 26038 raft_consensus.cc:2243] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.183272 26038 raft_consensus.cc:2272] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.186316 26038 tablet_replica.cc:333] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.187052 26038 raft_consensus.cc:2243] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.188081 26038 raft_consensus.cc:2272] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.190104  1811 consensus_peers.cc:597] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.190953 26038 tablet_replica.cc:333] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.191702 26038 raft_consensus.cc:2243] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.192066 26038 raft_consensus.cc:2272] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.193954 26038 tablet_replica.cc:333] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.194676 26038 raft_consensus.cc:2243] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.195201 26038 raft_consensus.cc:2272] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.197624 26038 tablet_replica.cc:333] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.198278 26038 raft_consensus.cc:2243] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.199241 26038 raft_consensus.cc:2272] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.201864 26038 tablet_replica.cc:333] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.202469 26038 raft_consensus.cc:2243] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.203003 26038 raft_consensus.cc:2272] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.205715 26038 tablet_replica.cc:333] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: stopping tablet replica
I20260709 13:13:37.206257 26038 raft_consensus.cc:2243] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.207029 26038 raft_consensus.cc:2272] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.230014  1811 consensus_peers.cc:597] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.237448  1885 consensus_peers.cc:597] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.258160  1811 consensus_peers.cc:597] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.265820  1885 consensus_peers.cc:597] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.277444  1737 consensus_peers.cc:597] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.284369  1885 consensus_peers.cc:597] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.289459 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
W20260709 13:13:37.357707  1885 consensus_peers.cc:597] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.369335 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.376616  2463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.376894  2464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.378793  2466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.378962 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:37.383690 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.383945 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.384145 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602817384105 us; error 0 us; skew 500 ppm
I20260709 13:13:37.384716 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.392288 26038 webserver.cc:533] Webserver started at http://127.25.109.129:45189/ using document root <none> and password file <none>
I20260709 13:13:37.392954 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.393183 26038 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:37.399398 26038 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:13:37.406886  2471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.407729 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:37.408161 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-zhdc"
I20260709 13:13:37.408533 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:37.420351  1811 consensus_peers.cc:597] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.425365 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.426795 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.428134 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.434369  2479 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:13:37.435918  1737 consensus_peers.cc:597] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.439738  1885 consensus_peers.cc:597] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.510759  1811 consensus_peers.cc:597] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.536207  1737 consensus_peers.cc:597] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.554689  1885 consensus_peers.cc:597] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.679482 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:13:37.679961 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.247s	user 0.011s	sys 0.000s
I20260709 13:13:37.680315 26038 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:13:37.698220  2479 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.725373  2479 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.726444  2479 tablet_bootstrap.cc:492] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.726989  2479 ts_tablet_manager.cc:1403] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 13:13:37.728886  2479 raft_consensus.cc:359] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.729393  2479 raft_consensus.cc:740] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.730029  2479 consensus_queue.cc:260] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.732213  2479 ts_tablet_manager.cc:1434] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:13:37.732893  2479 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.744522  2479 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.745241  2479 tablet_bootstrap.cc:492] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.745764  2479 ts_tablet_manager.cc:1403] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:13:37.748124  2479 raft_consensus.cc:359] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.748775  2479 raft_consensus.cc:740] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.749514  2479 consensus_queue.cc:260] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.751264  2479 ts_tablet_manager.cc:1434] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:37.751925  2479 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.767277  2479 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.768038  2479 tablet_bootstrap.cc:492] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.768563  2479 ts_tablet_manager.cc:1403] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:13:37.770511  2479 raft_consensus.cc:359] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.771165  2479 raft_consensus.cc:740] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.771770  2479 consensus_queue.cc:260] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.773568  2479 ts_tablet_manager.cc:1434] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:37.774343  2479 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.800273  2479 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.801101  2479 tablet_bootstrap.cc:492] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.801632  2479 ts_tablet_manager.cc:1403] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260709 13:13:37.803610  2479 raft_consensus.cc:359] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.804144  2479 raft_consensus.cc:740] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.804764  2479 consensus_queue.cc:260] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.806341  2479 ts_tablet_manager.cc:1434] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:13:37.807160  2479 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.835506  2479 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.836457  2479 tablet_bootstrap.cc:492] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.837056  2479 ts_tablet_manager.cc:1403] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 13:13:37.839514  2479 raft_consensus.cc:359] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.840181  2479 raft_consensus.cc:740] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.840812  2479 consensus_queue.cc:260] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.842701  2479 ts_tablet_manager.cc:1434] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:37.843432  2479 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.855888  2479 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.856613  2479 tablet_bootstrap.cc:492] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.857115  2479 ts_tablet_manager.cc:1403] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:13:37.858927  2479 raft_consensus.cc:359] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.859404  2479 raft_consensus.cc:740] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.860025  2479 consensus_queue.cc:260] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.861413  2479 ts_tablet_manager.cc:1434] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:37.862027  2479 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.873250  2479 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.873925  2479 tablet_bootstrap.cc:492] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.874430  2479 ts_tablet_manager.cc:1403] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:13:37.876523  2479 raft_consensus.cc:359] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.877146  2479 raft_consensus.cc:740] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.877720  2479 consensus_queue.cc:260] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.879539  2479 ts_tablet_manager.cc:1434] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:37.880255  2479 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.892722  2479 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.893435  2479 tablet_bootstrap.cc:492] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.893909  2479 ts_tablet_manager.cc:1403] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:13:37.895753  2479 raft_consensus.cc:359] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:37.896224  2479 raft_consensus.cc:740] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.896843  2479 consensus_queue.cc:260] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:37.898214  2479 ts_tablet_manager.cc:1434] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:37.898895  2479 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.910475  2479 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.911316  2479 tablet_bootstrap.cc:492] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.911906  2479 ts_tablet_manager.cc:1403] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:13:37.913970  2479 raft_consensus.cc:359] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.914525  2479 raft_consensus.cc:740] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.915098  2479 consensus_queue.cc:260] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:37.916638  2479 ts_tablet_manager.cc:1434] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:13:37.917379  2479 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.918715 26038 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:13:37.919070 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.239s	user 0.190s	sys 0.008s
I20260709 13:13:37.930295  2479 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.931113  2479 tablet_bootstrap.cc:492] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.931684  2479 ts_tablet_manager.cc:1403] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:13:37.934378  2479 raft_consensus.cc:359] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.935035  2479 raft_consensus.cc:740] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.935796  2479 consensus_queue.cc:260] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.937515  2479 ts_tablet_manager.cc:1434] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:37.938274  2479 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.952584  2479 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.953490  2479 tablet_bootstrap.cc:492] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.954105  2479 ts_tablet_manager.cc:1403] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:13:37.956241  2479 raft_consensus.cc:359] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:37.956880  2479 raft_consensus.cc:740] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.957651  2479 consensus_queue.cc:260] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:37.959383  2479 ts_tablet_manager.cc:1434] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:37.960147  2479 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.972424  2479 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.973199  2479 tablet_bootstrap.cc:492] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.973740  2479 ts_tablet_manager.cc:1403] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:13:37.976130  2479 raft_consensus.cc:359] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.976838  2479 raft_consensus.cc:740] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.977551  2479 consensus_queue.cc:260] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.979720  2479 ts_tablet_manager.cc:1434] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:37.980557  2479 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:37.993598  2479 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:37.994493  2479 tablet_bootstrap.cc:492] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:37.995162  2479 ts_tablet_manager.cc:1403] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:13:37.997507  2479 raft_consensus.cc:359] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:37.998199  2479 raft_consensus.cc:740] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.998957  2479 consensus_queue.cc:260] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.001166  2479 ts_tablet_manager.cc:1434] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:38.001889  2479 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.016213  2479 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.017069  2479 tablet_bootstrap.cc:492] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.017655  2479 ts_tablet_manager.cc:1403] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:13:38.019869  2479 raft_consensus.cc:359] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.020534  2479 raft_consensus.cc:740] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.021289  2479 consensus_queue.cc:260] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.023398  2479 ts_tablet_manager.cc:1434] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:13:38.024144  2479 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.026585 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:38637
I20260709 13:13:38.026782  2553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:38637 every 8 connection(s)
I20260709 13:13:38.041378  2479 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.042321  2479 tablet_bootstrap.cc:492] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.042948  2479 ts_tablet_manager.cc:1403] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:13:38.045389  2479 raft_consensus.cc:359] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.046067  2479 raft_consensus.cc:740] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.046752  2479 consensus_queue.cc:260] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.048681  2479 ts_tablet_manager.cc:1434] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:38.049474  2479 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.097404  2479 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.098366  2479 tablet_bootstrap.cc:492] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.099021  2479 ts_tablet_manager.cc:1403] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.050s	user 0.027s	sys 0.000s
I20260709 13:13:38.101202  2555 heartbeater.cc:344] Connected to a master server at 127.25.109.190:37007
I20260709 13:13:38.101701  2555 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.102780  2555 heartbeater.cc:507] Master 127.25.109.190:37007 requested a full tablet report, sending...
I20260709 13:13:38.107817  2479 raft_consensus.cc:359] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.108587  2479 raft_consensus.cc:740] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.109270  2479 consensus_queue.cc:260] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.111488  2479 ts_tablet_manager.cc:1434] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:13:38.112273  2479 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.115123  2422 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.115715  2422 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.117843  2422 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.118472  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.119300  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
W20260709 13:13:38.120136  1737 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.120935  1736 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.121228  1595 ts_manager.cc:194] Re-registered known tserver with Master: 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.122033  2422 raft_consensus.cc:2749] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.126595  2479 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.127171  2427 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.127501  2479 tablet_bootstrap.cc:492] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.127710  2427 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.128228  2479 ts_tablet_manager.cc:1403] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:13:38.131116  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.131223  2479 raft_consensus.cc:359] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.131707  1768 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.131955  2479 raft_consensus.cc:740] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.133168  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.133716  1809 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.135941  2416 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.132757  2479 consensus_queue.cc:260] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.136291  2416 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.136680  2416 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.137950  2479 ts_tablet_manager.cc:1434] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:38.138819  2479 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.139706  2427 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:38.144156  1811 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.149875  2416 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.152962  2416 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.154078  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.154632  1768 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.155853  2479 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.156780  2479 tablet_bootstrap.cc:492] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.157405  2479 ts_tablet_manager.cc:1403] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:13:38.158437  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.159870  2479 raft_consensus.cc:359] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.160559  2479 raft_consensus.cc:740] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
W20260709 13:13:38.160837  1811 leader_election.cc:343] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.161571  1768 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.161319  2479 consensus_queue.cc:260] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.162652  1809 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.163275  2416 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.163643  2479 ts_tablet_manager.cc:1434] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:38.163760  2416 raft_consensus.cc:697] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.164448  2479 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.164673  2416 consensus_queue.cc:237] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.165194  1595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57386
I20260709 13:13:38.170433  2555 heartbeater.cc:499] Master 127.25.109.190:37007 was elected leader, sending a full tablet report...
I20260709 13:13:38.177892  1595 catalog_manager.cc:5697] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.179817  2479 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.180743  2479 tablet_bootstrap.cc:492] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.181403  2479 ts_tablet_manager.cc:1403] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:13:38.183661  2479 raft_consensus.cc:359] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.184317  2479 raft_consensus.cc:740] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.185070  2479 consensus_queue.cc:260] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.193809  2481 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.194411  2481 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.196828  2481 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.197525  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.199036  2479 ts_tablet_manager.cc:1434] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.004s
W20260709 13:13:38.199649  1737 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.199910  2479 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.198342  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.201350  1736 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.202095  2481 raft_consensus.cc:2749] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.217061  2479 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.217823  2479 tablet_bootstrap.cc:492] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.218413  2479 ts_tablet_manager.cc:1403] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 13:13:38.220189  2479 raft_consensus.cc:359] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.220691  2479 raft_consensus.cc:740] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.221240  2479 consensus_queue.cc:260] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.222767  2479 ts_tablet_manager.cc:1434] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:38.223358  2479 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.227111  2460 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.227682  2460 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.231047  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.232167  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.232636  2460 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.232827  2526 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.234046  1885 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:38.235374  2460 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.235834  2460 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.236199  2460 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.237720  2479 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.238034  2481 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.238662  2479 tablet_bootstrap.cc:492] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.238561  2481 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.239329  2479 ts_tablet_manager.cc:1403] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:38.241354  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.241801  2416 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.242334  2479 raft_consensus.cc:359] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.242411  2416 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.243201  2479 raft_consensus.cc:740] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.243925  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.244680  2526 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.245747  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.245991  1737 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:38.246246  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.246898  2422 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:38.247140  1811 leader_election.cc:343] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.247296  2422 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.243945  2479 consensus_queue.cc:260] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.247666  2422 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.247963  1810 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.249274  2479 ts_tablet_manager.cc:1434] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:38.249424  2418 raft_consensus.cc:2749] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.250537  2479 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.250785  2460 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.251668  2481 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.251904  1920 raft_consensus.cc:2393] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:38.244714  2416 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.256990  2482 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.257051  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.257383  2460 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.257824  2527 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.259090  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.257705  2482 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.261504  2427 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.262189  2482 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.262005  2427 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.263702  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.264092  2427 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.264823  2480 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.265362  2480 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.265923  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.266582  2526 raft_consensus.cc:2468] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.267052  2527 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.267457  2480 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:38.268939  1885 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:38.269033  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.270123  1885 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.270349  2460 raft_consensus.cc:2804] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.270794  2460 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.271137  2460 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.271687  2424 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.272187  2424 raft_consensus.cc:697] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:38.272965  2424 consensus_queue.cc:237] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.275432  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.276057  1771 raft_consensus.cc:2468] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.277479  1809 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.277874  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:38.279102  1811 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.280057  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.280519  2427 raft_consensus.cc:2804] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.280691  2526 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.280933  2427 raft_consensus.cc:493] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.281322  2427 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.282080  1737 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.282835  2460 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.284298  2480 raft_consensus.cc:2804] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.284710  2480 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.284969  2460 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.285090  2480 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.286216  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.288232  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.288770  2526 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.290037  2422 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.292212  2422 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.292707  1768 raft_consensus.cc:2393] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.293841  2424 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.297174  2424 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.298202  2481 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.298806  2481 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.299687  2427 raft_consensus.cc:515] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.300494  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.300688  2424 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.293797  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.301846  2527 raft_consensus.cc:2393] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:38.302585  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.303324  2427 leader_election.cc:290] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:38.304049  1811 leader_election.cc:343] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.304301  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d7ce33e05c432bae9a05f6c1235ffd" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.304889  1768 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.305423  2481 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.306023  2526 raft_consensus.cc:2468] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.311532  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.307466  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.315367  1885 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
W20260709 13:13:38.316484  1737 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.317231  2424 raft_consensus.cc:2804] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.312878  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.317821  2424 raft_consensus.cc:697] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
W20260709 13:13:38.319090  1885 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.319002  1736 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.319623  1885 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.312160  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.320643  2460 raft_consensus.cc:2749] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.321573  2427 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.322218  2422 raft_consensus.cc:2749] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.308497  1594 catalog_manager.cc:5697] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.322146  2427 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.313031  1768 raft_consensus.cc:2468] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.326556  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.327402  1736 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.318840  2424 consensus_queue.cc:237] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.328461  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.329173  2526 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.329521  2422 raft_consensus.cc:2749] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.310097  2481 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.330307  1811 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.313789  2480 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.330210  2481 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.331413  2416 raft_consensus.cc:2804] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.331807  2416 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.332195  2416 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.366003  2427 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.379874  2427 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.368407  2573 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.380566  2427 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.366791  2481 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.380605  2573 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.385286  2573 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.387120  2481 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.387660  2481 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.373461  2416 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.388126  2479 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.391074  2479 tablet_bootstrap.cc:492] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.329733  2460 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.391657  2460 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.391817  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.391876  2479 ts_tablet_manager.cc:1403] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.142s	user 0.007s	sys 0.012s
I20260709 13:13:38.388165  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.392208  2482 raft_consensus.cc:493] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.393878  2460 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.394368  2482 raft_consensus.cc:515] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.394945  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:38.396522  1885 leader_election.cc:343] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.396709  2482 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.396514  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.397977  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.398389  2526 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.398602  2527 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
W20260709 13:13:38.399870  1737 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.399907  1885 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.402204  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.402894  1912 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.400105  2479 raft_consensus.cc:359] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.404829  2479 raft_consensus.cc:740] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.411429  1809 leader_election.cc:304] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.414244  2418 raft_consensus.cc:2804] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.414302  2416 leader_election.cc:290] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.414829  2418 raft_consensus.cc:697] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.415771  2418 consensus_queue.cc:237] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.416874  2481 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.417316  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.416167  2427 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.420418  2479 consensus_queue.cc:260] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.426797  2479 ts_tablet_manager.cc:1434] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:13:38.428637  1737 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.429715  2481 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.430540  2481 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.431221  2573 raft_consensus.cc:2804] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.431903  2573 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.432284  2573 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.433080  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.433758  2527 raft_consensus.cc:2468] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.433979  2481 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.435062  2479 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.436312  2422 raft_consensus.cc:493] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.437005  2422 raft_consensus.cc:515] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.438246  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.440052  2422 leader_election.cc:290] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.440608  2482 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.441159  2482 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.442988  2480 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:38.444897  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.445331  2422 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.446494  2422 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.448716  2422 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.450243  2422 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.450749  2422 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.450860  2573 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.454195  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.457818  2577 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.458824  2577 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.459286  1912 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.459853  2460 raft_consensus.cc:2764] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:38.461220  2577 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.463227  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.464218  2418 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.464718  2418 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.465377  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.465924  1810 leader_election.cc:304] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.466439  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.466741  2418 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.465952  2525 raft_consensus.cc:3060] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.467361  2418 raft_consensus.cc:2804] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.467828  2418 raft_consensus.cc:697] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.468657  2418 consensus_queue.cc:237] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:38.469101  1885 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.469504  2427 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.470019  2427 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.470839  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.472163  2427 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.472357  2460 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.472687  2427 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.472930  2460 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.473217  2427 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.473842  2416 raft_consensus.cc:493] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.474349  2416 raft_consensus.cc:515] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.475178  2460 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.475303  2427 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.477048  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.477799  2526 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.478149  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.478458  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.478830  1919 raft_consensus.cc:2468] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.480459  1885 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.476279  2416 leader_election.cc:290] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.476987  1594 catalog_manager.cc:5697] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.483982  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.480428  1810 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.486946  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.462312  2422 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.488752  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.490643  1765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.491755  1768 raft_consensus.cc:2468] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.491755  1765 raft_consensus.cc:2393] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.488586  2460 raft_consensus.cc:2804] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.492727  2460 raft_consensus.cc:493] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.493193  2460 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.494242  2416 raft_consensus.cc:2804] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.497573  2416 raft_consensus.cc:493] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.498167  2416 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.494341  2576 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.499715  2576 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.497879  1595 catalog_manager.cc:5697] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.501103  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.501791  2527 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.501906  2576 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.503167  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.506378  2418 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.509689  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.510377  2526 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.511722  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.512326  2524 raft_consensus.cc:3060] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.514909  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.506858  2418 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.520205  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.524412  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.525640  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.528928  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.529433  2418 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.530457  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.531083  1841 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.532289  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.532861  1841 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.532994  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.533604  1767 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.534590  1809 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.535669  2418 raft_consensus.cc:2804] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.536044  2418 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.536407  2418 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.539142  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be2c8382c1d946388b362b876a2f85f6" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.521178  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.540481  1737 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:38.540800  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.541456  2526 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.541904  1765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.541826  2580 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.542649  1765 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.542727  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.544348  2399 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.545073  2399 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.546276  2481 raft_consensus.cc:2804] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.546332  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.546835  2481 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.548344  1809 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.547238  2481 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.516497  2422 raft_consensus.cc:493] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.551561  1736 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.521240  2573 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.547247  2399 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.521024  2482 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.555979  2480 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.551831  2577 raft_consensus.cc:2804] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.558543  2524 raft_consensus.cc:2468] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:38.558597  2424 raft_consensus.cc:493] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.560437  2527 raft_consensus.cc:2468] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:38.560536  1595 catalog_manager.cc:5697] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.523218  2525 raft_consensus.cc:2468] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.542695  2580 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.565629  2480 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.565893  2577 raft_consensus.cc:493] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
W20260709 13:13:38.570997  1737 leader_election.cc:343] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.572896  2573 raft_consensus.cc:2749] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.570225  2418 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.583926  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.584311  2480 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.584571  2525 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.577508  2424 raft_consensus.cc:515] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.585052  2418 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.585690  2418 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.586148  2418 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.586622  2424 leader_election.cc:290] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.588110  2418 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.588620  2418 raft_consensus.cc:493] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.589136  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.589102  2418 raft_consensus.cc:515] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.592739  2418 leader_election.cc:290] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.574437  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.566912  2422 raft_consensus.cc:515] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.579300  2577 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:38.600896  1811 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.611513  1771 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
W20260709 13:13:38.612807  1811 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.613371  1811 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.617815  2580 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.622426  2580 raft_consensus.cc:2749] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.624039  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.624396  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.623567  1811 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.605312  2526 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.628400  2576 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.630576  2576 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.630757  2584 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.631006  2576 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.596434  2460 raft_consensus.cc:515] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.631304  2584 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.633047  2460 leader_election.cc:290] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.633455  2584 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.596971  1737 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.631333  2527 raft_consensus.cc:2393] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.638545  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.639577  2524 raft_consensus.cc:2393] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.642319  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.643086  2422 leader_election.cc:290] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.643749  1883 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:38.644230  1885 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.644511  2399 raft_consensus.cc:2804] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:38.644657  1883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 46363us
I20260709 13:13:38.648591  2460 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.649293  2584 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.649497  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.644959  2399 raft_consensus.cc:493] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.649771  2424 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.650108  2399 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.650384  2424 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.651888  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2961890859c44bf99c4531325d5d5dda" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.652487  2424 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.653040  2424 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.653507  2424 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.649107  2460 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.654945  2427 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.655545  2460 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.655444  2427 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.657377  2427 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.658315  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c06e30d8c0f4a09a24ebb8e781f18dd" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.658706  2525 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.659068  1767 raft_consensus.cc:2393] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.652622  1771 raft_consensus.cc:2393] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.649847  2584 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.666412  2574 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.666929  2574 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.667793  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.668125  2584 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.668494  2525 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.668781  2574 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.669332  2574 raft_consensus.cc:2749] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:38.670425  1737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 100047us
I20260709 13:13:38.670481  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
W20260709 13:13:38.671254  1737 leader_election.cc:343] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.669744  1885 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.671903  1737 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
W20260709 13:13:38.673043  1737 leader_election.cc:343] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.673723  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.673972  1885 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.674557  2527 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
W20260709 13:13:38.674885  1885 leader_election.cc:343] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.675172  2424 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.675736  2424 raft_consensus.cc:2804] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.675925  1885 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.676760  2460 raft_consensus.cc:2804] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.676792  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.677214  2460 raft_consensus.cc:493] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.677733  2460 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.678676  2574 raft_consensus.cc:2804] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.679176  2574 raft_consensus.cc:493] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.679651  2574 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.676054  2424 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
W20260709 13:13:38.682811  1885 leader_election.cc:343] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.682338  2584 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.659577  2399 raft_consensus.cc:515] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.688581  2584 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.687943  2580 raft_consensus.cc:493] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.690111  2580 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.692111  2580 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.692832  2460 raft_consensus.cc:515] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.689949  2584 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:38.629196  1811 leader_election.cc:343] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.695518  2576 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:38.695431  1811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 66261.8us
I20260709 13:13:38.697731  2576 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.682963  2424 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.699272  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.700133  2527 raft_consensus.cc:3060] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.700970  2460 leader_election.cc:290] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.703444  2399 leader_election.cc:290] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.704209  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
W20260709 13:13:38.705639  1885 leader_election.cc:343] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.707384  2481 raft_consensus.cc:515] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.707756  2584 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.709429  2481 leader_election.cc:290] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.682374  2577 raft_consensus.cc:515] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.711026  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
W20260709 13:13:38.711424  1884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 106259us
I20260709 13:13:38.711637  2526 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.711783  2577 leader_election.cc:290] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.715317  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.716220  1768 raft_consensus.cc:2468] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.629362  2479 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:38.717429  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.718183  1768 raft_consensus.cc:2393] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.714354  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
W20260709 13:13:38.713127  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 150287us
I20260709 13:13:38.720510  1809 leader_election.cc:304] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.683233  2416 raft_consensus.cc:515] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.723150  1809 leader_election.cc:304] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.712414  2584 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.714686  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.729387  1767 raft_consensus.cc:2468] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.673703  1737 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
W20260709 13:13:38.730676  1737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 57055.1us
I20260709 13:13:38.730957  2587 raft_consensus.cc:2804] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.731482  2587 raft_consensus.cc:697] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:38.731544  1737 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.733690  2422 raft_consensus.cc:2804] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.727919  1770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.725905  1772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.728753  1765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.741246  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.741665  1765 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.742489  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.725740  1736 leader_election.cc:304] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.738037  2479 tablet_bootstrap.cc:492] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:38.736665  1770 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.740947  1772 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.739282  2422 raft_consensus.cc:697] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:38.744995  2422 consensus_queue.cc:237] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.750360  2588 raft_consensus.cc:2804] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.751428  2479 ts_tablet_manager.cc:1403] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.317s	user 0.028s	sys 0.011s
I20260709 13:13:38.723482  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.758260  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c54b72c5fca48d3aebdcb078b3259e2" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.758912  2427 raft_consensus.cc:2804] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.763370  2520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.768603  2427 raft_consensus.cc:493] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.769042  2427 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.766068  2517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.769851  2517 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.732367  2587 consensus_queue.cc:237] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.770750  2525 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.770911  1772 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.755393  1841 raft_consensus.cc:2393] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:38.739104  2480 raft_consensus.cc:493] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.760088  2416 leader_election.cc:290] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.750859  2588 raft_consensus.cc:493] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.773269  2480 raft_consensus.cc:515] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.774320  1769 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.774353  2479 raft_consensus.cc:359] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.775197  2479 raft_consensus.cc:740] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.775344  2480 leader_election.cc:290] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.773613  2588 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.743739  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.776206  1767 raft_consensus.cc:3060] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.776046  2479 consensus_queue.cc:260] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.778168  2479 ts_tablet_manager.cc:1434] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:38.762388  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:38.784255  1769 raft_consensus.cc:2468] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.809604  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.810424  1842 raft_consensus.cc:2393] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
W20260709 13:13:38.796563  1809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 73474.2us
I20260709 13:13:38.812038  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:38.790855  2585 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.765002  2519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.804452  1767 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.790855  2573 raft_consensus.cc:2749] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.805277  2427 raft_consensus.cc:515] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.827550  2427 leader_election.cc:290] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:38.828121  1811 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.828004  2424 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.828614  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.828801  1811 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.829419  1919 raft_consensus.cc:2393] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:38.829686  2427 raft_consensus.cc:2749] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.831671  1811 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:38.832309  1913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:38.832533  2427 raft_consensus.cc:2749] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.833002  1913 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:38.835636  1811 leader_election.cc:343] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.726660  2527 raft_consensus.cc:2468] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.821028  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.815026  2479 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:38.817909  1842 raft_consensus.cc:2393] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d7fc1f76c2214405a104ba2cc2d4c865 in current term 2: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:38.812264  1809 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.820633  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.820650  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.839527  1839 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.765534  2518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.839774  2517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.840260  2518 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:38.841118  2593 raft_consensus.cc:2804] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.841558  2593 raft_consensus.cc:493] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.841909  2593 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.842129  2520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.821002  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:38.843186  1840 raft_consensus.cc:2468] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.824529  2519 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.810669  2574 raft_consensus.cc:515] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.847957  2574 leader_election.cc:290] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.848706  1771 raft_consensus.cc:2393] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 2: Already voted for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in this term.
I20260709 13:13:38.849490  2593 raft_consensus.cc:515] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.850338  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.850574  2526 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.851017  1912 raft_consensus.cc:2468] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 1.
I20260709 13:13:38.851547  2593 leader_election.cc:290] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.845120  1595 catalog_manager.cc:5697] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.852375  1809 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
W20260709 13:13:38.853000  1811 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.855214  1883 leader_election.cc:304] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.825382  2525 raft_consensus.cc:2468] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:38.855695  1810 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.856662  1885 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.857914  1809 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.857263  1883 leader_election.cc:304] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.864871  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.865455  1769 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.866183  1771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.867327  1771 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.856827  2590 raft_consensus.cc:2749] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.869486  1884 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:38.868217  1883 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:38.866950  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 141277us
I20260709 13:13:38.870312  1885 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:38.870875  1736 leader_election.cc:304] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.839864  1841 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 1.
I20260709 13:13:38.871228  1883 leader_election.cc:304] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:38.865856  2593 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.860296  2584 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.861665  2594 raft_consensus.cc:2804] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.828090  2585 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.860085  2399 raft_consensus.cc:3060] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.884354  1769 raft_consensus.cc:2468] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.862574  2416 raft_consensus.cc:2804] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.894373  1767 raft_consensus.cc:1275] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.872720  2588 raft_consensus.cc:515] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.904409  1771 raft_consensus.cc:2468] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.903633  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4266e947d76f4ade89d52bf8b7488b8d" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.905709  1809 leader_election.cc:304] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.872859  2424 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:38.879366  2482 raft_consensus.cc:2804] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.879591  2587 raft_consensus.cc:2764] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:38.910394  1809 leader_election.cc:304] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.891904  2593 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.898128  2416 raft_consensus.cc:493] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.907084  2460 raft_consensus.cc:2804] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.907159  2584 raft_consensus.cc:697] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:38.913218  2593 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.909276  2577 raft_consensus.cc:2804] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.906924  2594 raft_consensus.cc:697] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.914136  2482 raft_consensus.cc:697] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:38.918416  2416 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.919251  2418 raft_consensus.cc:2804] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.940436  2517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb5217ef91e14dcdac796f4a5a1626f7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.941079  2588 leader_election.cc:290] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:38.941752  2599 consensus_queue.cc:1048] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:38.927456  2583 raft_consensus.cc:2804] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:38.942553  2583 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:38.942677  2418 raft_consensus.cc:697] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.942982  2583 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.925426  2460 raft_consensus.cc:697] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:38.943784  2418 consensus_queue.cc:237] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.944268  2460 consensus_queue.cc:237] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.927825  2584 consensus_queue.cc:237] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:38.913823  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:38.928761  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8060ba9d7934ce88c1dc9d768e1bfce" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:38.929250  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e3bee67221424696e7ac634661ab94" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.930816  2518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.954118  2526 raft_consensus.cc:3060] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.954522  2518 raft_consensus.cc:2393] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate f8863ebea2ba4d47949f4b8b6a757d47 in this term.
I20260709 13:13:38.923153  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.955497  2525 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.956120  2399 raft_consensus.cc:2749] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:38.958402  2524 raft_consensus.cc:2393] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386cc1a635be43ebb1e3c43b793fb7d7 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:38.935950  2585 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:38.938100  2520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64617ce40ab24976ab92cd93d4a43fc2" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.958467  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:38.938817  2527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea6b19867dd34bddba378c80d0f7f88b" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.960583  1767 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.940152  2519 raft_consensus.cc:2468] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:38.919209  2522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:38.941977  2577 raft_consensus.cc:697] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:38.962682  2577 consensus_queue.cc:237] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.928042  2482 consensus_queue.cc:237] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:38.951960  1913 raft_consensus.cc:2468] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.942863  2594 consensus_queue.cc:237] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:38.977746  1595 catalog_manager.cc:5697] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:38.978785  1737 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:38.979559  1737 leader_election.cc:304] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:38.980405  1737 leader_election.cc:304] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:38.962015  2522 raft_consensus.cc:2393] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8863ebea2ba4d47949f4b8b6a757d47 in current term 2: Already voted for candidate d7fc1f76c2214405a104ba2cc2d4c865 in this term.
I20260709 13:13:38.990798  2593 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.002600  2593 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:39.003722  1767 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:38.941250  2416 raft_consensus.cc:515] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.010934  1809 leader_election.cc:304] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:38.994189  2480 raft_consensus.cc:2764] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:39.017410  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:39.019840  1737 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:39.021730  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.022343  1841 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.023806  2589 raft_consensus.cc:2749] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:39.026147  1811 consensus_peers.cc:597] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.026794  1811 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:39.028875  1811 leader_election.cc:304] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:39.029933  1811 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.030777  1811 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:39.040930  1811 leader_election.cc:343] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.016040  2576 raft_consensus.cc:2804] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.011968  2603 raft_consensus.cc:2764] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:13:39.043942  1811 leader_election.cc:343] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.044008  1737 leader_election.cc:304] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
W20260709 13:13:39.047993  1884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 122964us
W20260709 13:13:39.048142  1811 leader_election.cc:343] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.028997  1767 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.054217  2480 raft_consensus.cc:3060] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.058787  1841 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:39.061213  1767 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:39.053184  1811 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:39.051941  1884 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:39.062811  2518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:39.063159  1884 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:39.064002  2601 raft_consensus.cc:2804] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:39.064414  2601 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:39.065158  2601 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:39.066027  1737 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.066982  2416 leader_election.cc:290] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:39.068459  1809 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:39.064345  2526 raft_consensus.cc:2468] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:39.070621  2584 raft_consensus.cc:2804] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:39.071024  2584 raft_consensus.cc:493] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:39.071380  2584 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.074906  2480 raft_consensus.cc:2749] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.075867  2580 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.076730  2580 raft_consensus.cc:697] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:39.077024  2576 raft_consensus.cc:697] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:39.037711  2427 raft_consensus.cc:3060] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.082038  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e539b2d67f744f882c34f0039a390b7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.082028  1810 leader_election.cc:304] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:39.088449  1884 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:39.042936  2523 raft_consensus.cc:1275] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.081466  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10013cf9834c48139cae7a7418d8cfc5" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.091682  2526 raft_consensus.cc:1275] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.091988  1916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:39.078011  2580 consensus_queue.cc:237] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.096635  1595 catalog_manager.cc:5697] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.093662  2525 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:39.037726  2599 raft_consensus.cc:2804] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.078286  2594 raft_consensus.cc:2749] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.079592  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:39.082505  1840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:39.108860  1595 catalog_manager.cc:5697] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.051294  2481 raft_consensus.cc:2804] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.111416  2599 raft_consensus.cc:697] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:39.195233  2599 consensus_queue.cc:237] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.196331  2481 raft_consensus.cc:697] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:39.197279  2481 consensus_queue.cc:237] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.080571  2601 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:39.198562  1883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 327382us
I20260709 13:13:39.158164  2609 raft_consensus.cc:2804] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.199769  2609 raft_consensus.cc:697] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:39.199929  2601 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:39.078078  2576 consensus_queue.cc:237] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.102463  2416 raft_consensus.cc:2804] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.200950  2609 consensus_queue.cc:237] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.158730  1843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:39.201831  2416 raft_consensus.cc:697] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:39.202445  1843 raft_consensus.cc:2468] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 1.
I20260709 13:13:39.195694  1736 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:39.108359  1916 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.204007  2603 raft_consensus.cc:2749] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.204025  2416 consensus_queue.cc:237] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.190733  1595 catalog_manager.cc:5697] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.212134  2479 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:39.215080  1736 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:39.220037  2479 tablet_bootstrap.cc:492] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:39.221020  2479 ts_tablet_manager.cc:1403] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.406s	user 0.037s	sys 0.006s
I20260709 13:13:39.221207  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.221920  1914 raft_consensus.cc:1275] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.084458  2583 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:39.089159  2584 raft_consensus.cc:515] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
W20260709 13:13:39.233788  1885 leader_election.cc:343] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.236797  2479 raft_consensus.cc:359] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.237412  2479 raft_consensus.cc:740] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.238009  2479 consensus_queue.cc:260] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.241392  2592 consensus_queue.cc:1048] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:13:39.242779  2591 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:13:39.222375  2585 raft_consensus.cc:2804] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:39.245033  2585 raft_consensus.cc:493] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:39.245422  2585 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.257951  2585 raft_consensus.cc:515] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.274721  2525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1fd895a5da448497336f82b5d7c68f" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.275671  2525 raft_consensus.cc:3060] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.274668  2479 ts_tablet_manager.cc:1434] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:13:39.279090  2523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.247529  1916 raft_consensus.cc:2468] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:39.312489  1810 leader_election.cc:304] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
W20260709 13:13:39.317281  1737 leader_election.cc:343] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.316675  2594 raft_consensus.cc:2804] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.313426  2585 leader_election.cc:290] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:39.327545  1771 raft_consensus.cc:1275] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.322067  2427 raft_consensus.cc:2749] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.317456  2526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.352433  2519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd57330f2d548d086f9d7a41e682ee5" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.353426  2584 leader_election.cc:290] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637)
I20260709 13:13:39.325291  1841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "826a8ad6d33b46ecb299a4c360f2eabf" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.356268  1841 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.360343  2522 raft_consensus.cc:1275] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:39.361793  1811 leader_election.cc:343] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.368623  1843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.369274  1843 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.338716  2594 raft_consensus.cc:697] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Leader. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:39.371292  2594 consensus_queue.cc:237] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.378254  1767 raft_consensus.cc:1275] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.381141  2479 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:39.376518  2480 consensus_queue.cc:1048] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 13:13:39.383680  1811 consensus_peers.cc:597] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.386313  1811 leader_election.cc:343] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.409078  2606 consensus_queue.cc:1048] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:13:39.411306  2427 consensus_queue.cc:1048] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.400214  2522 raft_consensus.cc:1275] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:39.411747  2616 log.cc:927] Time spent T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:13:39.434962  2527 raft_consensus.cc:1275] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.435854  1768 raft_consensus.cc:1275] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.438436  1768 raft_consensus.cc:1275] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.437790  1736 leader_election.cc:304] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47
I20260709 13:13:39.443053  2599 consensus_queue.cc:1048] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.430716  2480 consensus_queue.cc:1048] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:39.445457  1914 raft_consensus.cc:1275] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.430922  2590 consensus_queue.cc:1048] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:13:39.470860  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:39.471740  1844 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.449330  2585 raft_consensus.cc:2749] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.482250  2591 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:13:39.511567  2525 raft_consensus.cc:2468] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8863ebea2ba4d47949f4b8b6a757d47 in term 2.
I20260709 13:13:39.531016  1844 raft_consensus.cc:2468] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:39.532359  2524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.533840  2524 raft_consensus.cc:1275] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.466465  2603 consensus_queue.cc:1048] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:13:39.534927  2625 log.cc:927] Time spent T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:13:39.516290  2583 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:39.537518  1841 raft_consensus.cc:2468] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:39.538735  1914 raft_consensus.cc:1275] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.539294  1843 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
W20260709 13:13:39.539825  1811 consensus_peers.cc:597] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:39.541158  1811 consensus_peers.cc:597] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.541203  1839 raft_consensus.cc:2468] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:39.550347  1736 leader_election.cc:304] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
W20260709 13:13:39.571229  1885 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 128667us
W20260709 13:13:39.577363  1885 consensus_peers.cc:597] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.584030  2585 consensus_queue.cc:1048] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.584945  2597 raft_consensus.cc:2804] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.585500  2597 raft_consensus.cc:697] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
W20260709 13:13:39.588588  1885 leader_election.cc:343] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.546717  2606 consensus_queue.cc:1048] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:13:39.636782  2580 consensus_queue.cc:1048] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:39.652005  2527 raft_consensus.cc:1275] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.634546  2597 consensus_queue.cc:237] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.664989  1884 leader_election.cc:304] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:39.664444  2603 consensus_queue.cc:1048] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:39.682919  2592 raft_consensus.cc:2804] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.683563  2592 raft_consensus.cc:697] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:39.683753  2526 raft_consensus.cc:1275] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.684973  1884 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:39.690821  2399 raft_consensus.cc:2804] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:13:39.691059  1811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 55748.1us
I20260709 13:13:39.711330  1769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:39.712131  1769 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.727105  1913 raft_consensus.cc:1275] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.729089  1839 raft_consensus.cc:1275] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.738600  1770 raft_consensus.cc:1275] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.737658  1769 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
I20260709 13:13:39.745276  1769 raft_consensus.cc:1275] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.750355  1770 raft_consensus.cc:1275] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.720935  2399 raft_consensus.cc:697] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:39.738668  2520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799285a16a0448ffa4198dd63be9c7b1" candidate_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:39.717517  2609 consensus_queue.cc:1048] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:13:39.748253  2577 consensus_queue.cc:1048] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:39.779161  2479 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:39.771955  2520 raft_consensus.cc:3060] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.759450  2418 consensus_queue.cc:1048] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:13:39.785095  2479 tablet_bootstrap.cc:492] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:39.785943  2479 ts_tablet_manager.cc:1403] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.405s	user 0.026s	sys 0.034s
I20260709 13:13:39.725570  2592 consensus_queue.cc:237] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.778465  1765 raft_consensus.cc:1275] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.801296  1595 catalog_manager.cc:5697] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:39.955439  1809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 200385us
I20260709 13:13:39.796564  2399 consensus_queue.cc:237] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:39.970731  2577 consensus_queue.cc:1048] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.972132  2479 raft_consensus.cc:359] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.972874  2479 raft_consensus.cc:740] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.973531  2479 consensus_queue.cc:260] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:39.984727  2479 ts_tablet_manager.cc:1434] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.198s	user 0.006s	sys 0.000s
I20260709 13:13:39.985983  2479 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:39.979785  2523 raft_consensus.cc:1275] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.004681  2646 consensus_queue.cc:1048] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:13:40.034301  1767 raft_consensus.cc:1275] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.041903  1737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 246354us
W20260709 13:13:40.051469  1810 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 111176us
I20260709 13:13:40.073171  1772 raft_consensus.cc:1275] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.125978  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 54201.1us
I20260709 13:13:40.125428  2418 consensus_queue.cc:1048] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:13:40.143548  1842 raft_consensus.cc:1275] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.144685  2662 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 13:13:40.146893  2663 log.cc:927] Time spent T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:40.151131  2520 raft_consensus.cc:2468] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fc1f76c2214405a104ba2cc2d4c865 in term 2.
W20260709 13:13:40.165481  1737 consensus_peers.cc:597] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:40.168959  1883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 204044us
I20260709 13:13:40.171896  1843 raft_consensus.cc:1275] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.180970  1883 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:40.181922  2460 consensus_queue.cc:1048] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.182531  2671 raft_consensus.cc:2804] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.183065  2671 raft_consensus.cc:697] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Leader. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:40.183835  2662 consensus_queue.cc:1048] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.183923  2671 consensus_queue.cc:237] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:40.186852  2527 raft_consensus.cc:1275] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.208477  2643 log.cc:927] Time spent T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c: Append to log took a long time: real 0.216s	user 0.009s	sys 0.000s
I20260709 13:13:40.205945  2460 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:13:40.231918  1737 consensus_peers.cc:597] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.221392  1914 raft_consensus.cc:1275] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.262419  1885 consensus_peers.cc:597] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.235797  2580 consensus_queue.cc:1048] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:13:40.308218  1844 raft_consensus.cc:1275] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.318637  2644 log.cc:927] Time spent T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: Append to log took a long time: real 0.576s	user 0.005s	sys 0.000s
W20260709 13:13:40.347095  1885 consensus_peers.cc:597] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.361014  2479 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:40.362353  2479 tablet_bootstrap.cc:492] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:40.363209  2479 ts_tablet_manager.cc:1403] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.377s	user 0.020s	sys 0.012s
I20260709 13:13:40.349083  1839 raft_consensus.cc:1275] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.318186  2649 consensus_queue.cc:1048] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.326267  2676 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:13:40.366750  2525 raft_consensus.cc:1275] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.368587  2675 log.cc:927] Time spent T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:13:40.372282  2525 raft_consensus.cc:1275] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.373486  2479 raft_consensus.cc:359] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:40.374403  2479 raft_consensus.cc:740] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.375197  2479 consensus_queue.cc:260] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:40.378451  2479 ts_tablet_manager.cc:1434] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
W20260709 13:13:40.383155  1737 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 120651us
I20260709 13:13:40.383905  2589 consensus_queue.cc:1048] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:40.384943  1737 consensus_peers.cc:597] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.386209  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 131734us
W20260709 13:13:40.389752  1811 consensus_peers.cc:597] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.390412  2655 consensus_queue.cc:1048] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.398082  2587 consensus_queue.cc:1048] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:40.409149  2683 log.cc:927] Time spent T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: Append to log took a long time: real 0.161s	user 0.004s	sys 0.000s
I20260709 13:13:40.401384  2597 consensus_queue.cc:1048] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:13:40.412786  1811 consensus_peers.cc:597] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.436771  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 49400.6us
I20260709 13:13:40.429529  2576 consensus_queue.cc:1048] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:13:40.492587  2659 log.cc:927] Time spent T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: Append to log took a long time: real 0.544s	user 0.003s	sys 0.000s
W20260709 13:13:40.500227  1809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:37637, user_credentials={real_user=slave}} blocked reactor thread for 45356.6us
I20260709 13:13:40.521453  1768 raft_consensus.cc:1275] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.527097  1885 consensus_peers.cc:597] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.576930  2517 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:40.594274  1885 consensus_peers.cc:597] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.607633  2517 raft_consensus.cc:1275] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer f8863ebea2ba4d47949f4b8b6a757d47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:40.610006  1885 consensus_peers.cc:597] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.612239  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 102607us
W20260709 13:13:40.636381  1885 consensus_peers.cc:597] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.647385  2519 raft_consensus.cc:1275] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.654449  2609 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.724924  2479 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
W20260709 13:13:40.741460  1885 consensus_peers.cc:597] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:40.743872  2479 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:40.744994  2479 tablet_bootstrap.cc:492] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:40.747308  2479 ts_tablet_manager.cc:1403] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:13:40.750712  2479 raft_consensus.cc:359] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:40.751396  2479 raft_consensus.cc:740] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.752080  2479 consensus_queue.cc:260] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:40.754390  2479 ts_tablet_manager.cc:1434] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:40.755219  2479 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:40.773453  2479 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:40.774406  2479 tablet_bootstrap.cc:492] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:40.775027  2479 ts_tablet_manager.cc:1403] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:13:40.776713  1770 raft_consensus.cc:1275] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.777456  2479 raft_consensus.cc:359] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:40.778250  2479 raft_consensus.cc:740] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.778975  2479 consensus_queue.cc:260] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:40.781083  2479 ts_tablet_manager.cc:1434] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:13:40.781821  2479 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:40.789948  2661 consensus_queue.cc:1048] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.792150  2603 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.792693  2603 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:40.795900  1595 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37544 (request call id 90) took 1351 ms. Trace:
I20260709 13:13:40.799095  2603 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:40.818984  2522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" is_pre_election: true
I20260709 13:13:40.820118  2522 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
W20260709 13:13:40.841856  1766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.039s	sys 0.036s
I20260709 13:13:40.799309  1595 rpcz_store.cc:276] 0709 13:13:39.443284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.450295 (+  7011us) service_pool.cc:224] Handling call
0709 13:13:40.794325 (+1344030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:39.970822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:39.971449 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:39.971485 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:13:39.971506 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:39.971862 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:39.971921 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:39.971964 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:39.972151 (+   187us) tablet.cc:701] Row locks acquired
0709 13:13:39.972173 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:13:39.972312 (+   139us) write_op.cc:270] Start()
0709 13:13:39.972421 (+   109us) write_op.cc:276] Timestamp: P: 1783602819972271 usec, L: 0
0709 13:13:39.972444 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:39.973157 (+   713us) log.cc:844] Serialized 543 byte log entry
0709 13:13:40.048866 (+ 75709us) op_driver.cc:464] REPLICATION: finished
0709 13:13:40.282550 (+233684us) write_op.cc:301] APPLY: starting
0709 13:13:40.282654 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:40.282794 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:40.283037 (+   243us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:40.283345 (+   308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:40.283569 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:40.283632 (+    63us) write_op.cc:312] APPLY: finished
0709 13:13:40.283857 (+   225us) log.cc:844] Serialized 22 byte log entry
0709 13:13:40.285008 (+  1151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:40.285124 (+   116us) write_op.cc:454] Released schema lock
0709 13:13:40.285177 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:40.287174 (+  1997us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:40.287217 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":233337,"apply.run_cpu_time_us":2174,"apply.run_wall_time_us":4618,"num_ops":1,"prepare.queue_time_us":166825,"prepare.run_cpu_time_us":2637,"prepare.run_wall_time_us":2637,"replication_time_us":76235,"thread_start_us":309458,"threads_started":2}]]}
W20260709 13:13:40.842303  1766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.040s	sys 0.036s
I20260709 13:13:40.941774  1737 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:40.942884  2698 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:40.943315  2698 raft_consensus.cc:493] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.943662  2698 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:40.949955  2698 raft_consensus.cc:515] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:40.952641  2698 leader_election.cc:290] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 3 election: Requested vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:40.974251  1844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" is_pre_election: true
I20260709 13:13:40.978991  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:40.984881  2517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa4b01ab9a44167bda5a2e595a210c7" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
I20260709 13:13:40.985642  2517 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.002596  1591 catalog_manager.cc:5697] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.004359  1591 catalog_manager.cc:5697] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.006062  1591 catalog_manager.cc:5697] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.007592  1591 catalog_manager.cc:5697] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.009382  1591 catalog_manager.cc:5697] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.010737  2527 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.013643  2517 raft_consensus.cc:2468] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 3.
I20260709 13:13:41.015033  1737 leader_election.cc:304] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:41.016196  2698 raft_consensus.cc:2804] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.019685  2698 raft_consensus.cc:697] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:41.021363  2698 consensus_queue.cc:237] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.053162  1592 catalog_manager.cc:5697] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.060433  2479 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.065052  2479 tablet_bootstrap.cc:492] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.065730  2479 ts_tablet_manager.cc:1403] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.284s	user 0.036s	sys 0.037s
I20260709 13:13:41.068425  2479 raft_consensus.cc:359] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.069144  2479 raft_consensus.cc:740] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.066859  1592 catalog_manager.cc:5697] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.069912  2479 consensus_queue.cc:260] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.087767  1592 catalog_manager.cc:5697] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.088726  2479 ts_tablet_manager.cc:1434] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:13:41.089736  2479 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.090029  1592 catalog_manager.cc:5697] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:41.100507  1811 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:38637, user_credentials={real_user=slave}} blocked reactor thread for 119961us
W20260709 13:13:41.101261  1811 consensus_peers.cc:597] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:41.107232  2599 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.113032  2654 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7fc1f76c2214405a104ba2cc2d4c865)
I20260709 13:13:41.118326  1839 raft_consensus.cc:1275] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer d7fc1f76c2214405a104ba2cc2d4c865: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.124827  2416 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.136840  1591 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37556 (request call id 104) took 1594 ms. Trace:
I20260709 13:13:41.137741  1591 rpcz_store.cc:276] 0709 13:13:39.542691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.542887 (+   196us) service_pool.cc:224] Handling call
0709 13:13:41.136781 (+1593894us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:41.078578 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:41.079125 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:41.079161 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:13:41.079178 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:41.086467 (+  7289us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:41.086552 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:41.086578 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:13:41.103749 (+ 17171us) tablet.cc:701] Row locks acquired
0709 13:13:41.103765 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:13:41.103898 (+   133us) write_op.cc:270] Start()
0709 13:13:41.104011 (+   113us) write_op.cc:276] Timestamp: P: 1783602821103857 usec, L: 0
0709 13:13:41.104030 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:13:41.104631 (+   601us) log.cc:844] Serialized 2108 byte log entry
0709 13:13:41.107041 (+  2410us) op_driver.cc:464] REPLICATION: finished
0709 13:13:41.119753 (+ 12712us) write_op.cc:301] APPLY: starting
0709 13:13:41.119857 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:41.120013 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:41.120132 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:41.120724 (+   592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:41.120910 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:13:41.120973 (+    63us) write_op.cc:312] APPLY: finished
0709 13:13:41.121241 (+   268us) log.cc:844] Serialized 46 byte log entry
0709 13:13:41.122013 (+   772us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:41.122152 (+   139us) write_op.cc:454] Released schema lock
0709 13:13:41.122192 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:41.123690 (+  1498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:41.123717 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":641383,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":11746,"apply.run_cpu_time_us":2155,"apply.run_wall_time_us":4630,"num_ops":5,"prepare.queue_time_us":63713,"prepare.run_cpu_time_us":3158,"prepare.run_wall_time_us":28323,"replication_time_us":2881,"thread_start_us":97969,"threads_started":2}]]}
I20260709 13:13:41.113559  2654 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:41.153255  2654 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:41.154778  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" is_pre_election: true
I20260709 13:13:41.160100  2592 consensus_queue.cc:1048] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.166357  1763 raft_consensus.cc:1240] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 LEADER]: Rejecting Update request from peer f8863ebea2ba4d47949f4b8b6a757d47 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:41.167425  2525 raft_consensus.cc:1240] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Rejecting Update request from peer f8863ebea2ba4d47949f4b8b6a757d47 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:13:41.168999  1768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" is_pre_election: true
I20260709 13:13:41.183478  2654 consensus_queue.cc:1059] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.184481  2711 raft_consensus.cc:3055] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:41.184849  2711 raft_consensus.cc:740] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:41.185602  2711 consensus_queue.cc:260] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.186569  2711 raft_consensus.cc:3060] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.196331  1594 catalog_manager.cc:5697] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } }
I20260709 13:13:41.203361  1594 catalog_manager.cc:5697] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.197846  1592 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37562 (request call id 98) took 1504 ms. Trace:
I20260709 13:13:41.204697  1592 rpcz_store.cc:276] 0709 13:13:39.693505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.694489 (+   984us) service_pool.cc:224] Handling call
0709 13:13:41.197791 (+1503302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:41.107041 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:41.107550 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:41.107582 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:13:41.107600 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:41.108151 (+   551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:41.108194 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:41.108220 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:13:41.108578 (+   358us) tablet.cc:701] Row locks acquired
0709 13:13:41.108595 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:13:41.108722 (+   127us) write_op.cc:270] Start()
0709 13:13:41.108816 (+    94us) write_op.cc:276] Timestamp: P: 1783602821108679 usec, L: 0
0709 13:13:41.108839 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:41.170667 (+ 61828us) log.cc:844] Serialized 1717 byte log entry
0709 13:13:41.172777 (+  2110us) op_driver.cc:464] REPLICATION: finished
0709 13:13:41.173246 (+   469us) write_op.cc:301] APPLY: starting
0709 13:13:41.173344 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:41.173536 (+   192us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:41.173656 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:41.174262 (+   606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:41.174478 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:13:41.174519 (+    41us) write_op.cc:312] APPLY: finished
0709 13:13:41.174709 (+   190us) log.cc:844] Serialized 40 byte log entry
0709 13:13:41.175371 (+   662us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:41.175459 (+    88us) write_op.cc:454] Released schema lock
0709 13:13:41.175497 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":267,"apply.run_cpu_time_us":2041,"apply.run_wall_time_us":13574,"num_ops":4,"prepare.queue_time_us":11060,"replication_time_us":63798}]]}
I20260709 13:13:41.212986  1809 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8863ebea2ba4d47949f4b8b6a757d47; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865
I20260709 13:13:41.214268  2586 raft_consensus.cc:2749] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:41.224363  2479 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.225517  2479 tablet_bootstrap.cc:492] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.226238  2479 ts_tablet_manager.cc:1403] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.000s
I20260709 13:13:41.229120  2479 raft_consensus.cc:359] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.229765  2479 raft_consensus.cc:740] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.230875  2479 consensus_queue.cc:260] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.237920  2479 ts_tablet_manager.cc:1434] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:41.238945  2479 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.250664  1592 catalog_manager.cc:5697] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } }
I20260709 13:13:41.272092  2479 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.272970  2479 tablet_bootstrap.cc:492] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.273566  2479 ts_tablet_manager.cc:1403] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.003s
I20260709 13:13:41.275925  2479 raft_consensus.cc:359] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.276566  2479 raft_consensus.cc:740] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.277215  2479 consensus_queue.cc:260] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.279160  2479 ts_tablet_manager.cc:1434] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:13:41.279776  2479 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.281973  1595 catalog_manager.cc:5697] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 reported cstate change: term changed from 1 to 2, leader changed from 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129) to d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132). New cstate: current_term: 2 leader_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.294246  2479 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.295172  2479 tablet_bootstrap.cc:492] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.295812  2479 ts_tablet_manager.cc:1403] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:13:41.298203  2479 raft_consensus.cc:359] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.298892  2479 raft_consensus.cc:740] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.299696  2479 consensus_queue.cc:260] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.301723  2479 ts_tablet_manager.cc:1434] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:41.302510  2479 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.317063  2479 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.317898  2479 tablet_bootstrap.cc:492] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.318550  2479 ts_tablet_manager.cc:1403] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 13:13:41.321076  2479 raft_consensus.cc:359] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.321771  2479 raft_consensus.cc:740] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.322453  2479 consensus_queue.cc:260] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.322861  1594 catalog_manager.cc:5697] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 2 to 3, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.324512  2479 ts_tablet_manager.cc:1434] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:41.325263  2479 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.340282  2479 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.341192  2479 tablet_bootstrap.cc:492] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.341845  2479 ts_tablet_manager.cc:1403] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:13:41.343768  2479 raft_consensus.cc:359] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.344224  2479 raft_consensus.cc:740] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.344653  2479 consensus_queue.cc:260] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.346112  2479 ts_tablet_manager.cc:1434] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:41.347383  2479 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.355401  2525 raft_consensus.cc:3060] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.367863  2479 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.368906  2479 tablet_bootstrap.cc:492] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.369587  2479 ts_tablet_manager.cc:1403] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:13:41.372129  2479 raft_consensus.cc:359] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.372640  2479 raft_consensus.cc:740] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.373275  2479 consensus_queue.cc:260] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.374887  2479 ts_tablet_manager.cc:1434] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:13:41.375530  2479 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.387981  2479 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.388705  2479 tablet_bootstrap.cc:492] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.389293  2479 ts_tablet_manager.cc:1403] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:13:41.391172  2479 raft_consensus.cc:359] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.391721  2479 raft_consensus.cc:740] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.392241  2479 consensus_queue.cc:260] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.393900  2479 ts_tablet_manager.cc:1434] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:41.395170  2479 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.413053  2479 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.413966  2479 tablet_bootstrap.cc:492] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.415098  2479 ts_tablet_manager.cc:1403] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:13:41.417075  2479 raft_consensus.cc:359] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.417586  2479 raft_consensus.cc:740] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.418179  2479 consensus_queue.cc:260] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.420295  2479 ts_tablet_manager.cc:1434] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:41.421063  2479 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.436838  2479 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.437712  2479 tablet_bootstrap.cc:492] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.438366  2479 ts_tablet_manager.cc:1403] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:13:41.440876  2479 raft_consensus.cc:359] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.441520  2479 raft_consensus.cc:740] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.442284  2479 consensus_queue.cc:260] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:41.444093  2479 ts_tablet_manager.cc:1434] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:41.444717  2479 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
W20260709 13:13:41.452872  1811 consensus_peers.cc:597] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:41.458392  2479 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.459075  2479 tablet_bootstrap.cc:492] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.459528  2479 ts_tablet_manager.cc:1403] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:13:41.461701  2479 raft_consensus.cc:359] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.462229  2479 raft_consensus.cc:740] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.462502  1843 raft_consensus.cc:1275] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:13:41.462993  1843 pending_rounds.cc:85] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Aborting all ops after (but not including) 1
I20260709 13:13:41.462751  2479 consensus_queue.cc:260] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.463230  1843 pending_rounds.cc:107] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:13:41.463588  1843 raft_consensus.cc:2889] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:41.464772  2479 ts_tablet_manager.cc:1434] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:41.465176  2642 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.465852  2479 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.486920  2525 raft_consensus.cc:1275] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:41.492100  2587 consensus_queue.cc:1048] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:41.523105  2479 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.526127  2479 tablet_bootstrap.cc:492] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.526722  2479 ts_tablet_manager.cc:1403] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.004s
I20260709 13:13:41.546348  2479 raft_consensus.cc:359] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.547052  2479 raft_consensus.cc:740] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.548980  2479 consensus_queue.cc:260] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.551606  2479 ts_tablet_manager.cc:1434] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:13:41.551638  2524 raft_consensus.cc:3060] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.552448  2479 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.555683  2522 raft_consensus.cc:3060] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.574360  2525 raft_consensus.cc:3060] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.586367  2527 raft_consensus.cc:3060] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.587816  2520 raft_consensus.cc:3060] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.618892  2479 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.619911  2479 tablet_bootstrap.cc:492] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.620574  2479 ts_tablet_manager.cc:1403] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.008s
I20260709 13:13:41.627086  2479 raft_consensus.cc:359] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.629045  2479 raft_consensus.cc:740] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.633292  2479 consensus_queue.cc:260] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.635879  2479 ts_tablet_manager.cc:1434] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:41.636677  2479 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.654160  2479 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.655017  2479 tablet_bootstrap.cc:492] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.655670  2479 ts_tablet_manager.cc:1403] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:13:41.657961  2479 raft_consensus.cc:359] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.658601  2479 raft_consensus.cc:740] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.659250  2479 consensus_queue.cc:260] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.661232  2479 ts_tablet_manager.cc:1434] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:41.662031  2479 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.676337  2479 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.677048  2479 tablet_bootstrap.cc:492] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.677582  2479 ts_tablet_manager.cc:1403] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 13:13:41.679888  2479 raft_consensus.cc:359] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.680557  2479 raft_consensus.cc:740] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.681180  2479 consensus_queue.cc:260] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.683175  2479 ts_tablet_manager.cc:1434] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:41.683904  2479 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.697803  2479 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.698619  2479 tablet_bootstrap.cc:492] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.699250  2479 ts_tablet_manager.cc:1403] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:13:41.701122  2479 raft_consensus.cc:359] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.701689  2479 raft_consensus.cc:740] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.702340  2479 consensus_queue.cc:260] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:41.704121  2479 ts_tablet_manager.cc:1434] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:41.704818  2479 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap starting.
I20260709 13:13:41.717693  2479 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:41.718618  2479 tablet_bootstrap.cc:492] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Bootstrap complete.
I20260709 13:13:41.719262  2479 ts_tablet_manager.cc:1403] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:13:41.721426  2479 raft_consensus.cc:359] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.721961  2479 raft_consensus.cc:740] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.722636  2479 consensus_queue.cc:260] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:41.724565  2479 ts_tablet_manager.cc:1434] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:41.760599  2525 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:41.887498  1867 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca520 after lost signal to thread 26041
W20260709 13:13:41.888495  1867 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca680 after lost signal to thread 1629
W20260709 13:13:41.889660  1867 debug-util.cc:398] Leaking SignalData structure 0x7b0800419660 after lost signal to thread 1796
W20260709 13:13:41.890745  1867 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2ce0 after lost signal to thread 1870
W20260709 13:13:41.891737  1867 debug-util.cc:398] Leaking SignalData structure 0x7b08002dac40 after lost signal to thread 1944
W20260709 13:13:41.892803  1867 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9fc0 after lost signal to thread 2553
I20260709 13:13:41.910694  2525 raft_consensus.cc:3060] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.046814  2525 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.169000 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:48.225083  1919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:48.225958  1919 raft_consensus.cc:606] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.229043  1919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:48.229570  1919 raft_consensus.cc:606] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.232211  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:48.232654  1920 raft_consensus.cc:606] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.245857  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:48.246387  1842 raft_consensus.cc:606] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.248785  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:48.249349  1920 raft_consensus.cc:606] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.251629  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:48.252174  1920 raft_consensus.cc:606] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:48.254544 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:48.255910 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:48.290779  2758 raft_consensus.cc:993] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.291391  2758 raft_consensus.cc:1081] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.293149  2524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:48.293812  2524 raft_consensus.cc:493] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.294302  2524 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.306195  2756 raft_consensus.cc:993] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.306929  2776 raft_consensus.cc:1081] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.307883  2524 raft_consensus.cc:515] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:48.308866  2527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:48.309515  2527 raft_consensus.cc:493] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.309953  2527 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.313874  2758 raft_consensus.cc:993] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.314467  2758 raft_consensus.cc:1081] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.317329  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:48.317845  2522 raft_consensus.cc:493] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.318176  2522 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.325162  2522 raft_consensus.cc:515] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.335364  2524 leader_election.cc:290] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:48.337947  2522 leader_election.cc:290] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:48.374941  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.375890  1919 raft_consensus.cc:3055] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.376188  1919 raft_consensus.cc:740] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:48.377180  1919 consensus_queue.cc:260] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:48.378710  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.379055  1919 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.379427  1912 raft_consensus.cc:3055] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:48.379822  1912 raft_consensus.cc:740] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:48.380789  1912 consensus_queue.cc:260] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.388548  1919 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.393214  1912 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.399813  2473 leader_election.cc:304] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:48.353390  2527 raft_consensus.cc:515] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.402652  2758 raft_consensus.cc:993] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.403211  2758 raft_consensus.cc:1081] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.406905  2524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:48.407444  2524 raft_consensus.cc:493] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.407799  2524 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.413712  1767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbae727a35c2401ba95837189c5fb36c" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:48.414389  1767 raft_consensus.cc:3060] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.414731  2780 raft_consensus.cc:2804] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.419812  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ac1c31917741069cdbad88e94789ff" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:48.420563  1839 raft_consensus.cc:3060] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.421155  2524 raft_consensus.cc:515] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.419936  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:48.422394  1842 raft_consensus.cc:3055] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:48.422709  1842 raft_consensus.cc:740] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:48.423489  1842 consensus_queue.cc:260] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.424660  1842 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.426025  1767 raft_consensus.cc:2468] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.427587  2524 leader_election.cc:290] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:48.430663  1912 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.431870  2780 raft_consensus.cc:697] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.432895  2780 consensus_queue.cc:237] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:48.439643  1839 raft_consensus.cc:2468] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.441538  2527 leader_election.cc:290] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:48.443867  1842 raft_consensus.cc:2468] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.451118  2765 raft_consensus.cc:993] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.451864  2765 raft_consensus.cc:1081] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.454346  2524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:48.455539  2524 raft_consensus.cc:493] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.456045  2524 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.459192  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.459841  1912 raft_consensus.cc:3055] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.460150  1912 raft_consensus.cc:740] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:48.460479  1919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ec621eac4f4ceaa9cc2b261a096071" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.461022  1919 raft_consensus.cc:3060] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.461082  1912 consensus_queue.cc:260] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.462795  1912 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.463932  1839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edd4d5916bd457ebee0a8735672f478" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:48.465698  1839 raft_consensus.cc:3060] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.468009  1919 raft_consensus.cc:2468] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.460131  2473 leader_election.cc:304] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:48.480082  1912 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.493482  2782 raft_consensus.cc:2804] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.498345  2782 raft_consensus.cc:697] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.499475  2782 consensus_queue.cc:237] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.502986  2771 raft_consensus.cc:993] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.503885  2781 raft_consensus.cc:1081] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:48.503238  2473 leader_election.cc:304] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:48.505934  2784 raft_consensus.cc:2804] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.506510  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:48.507102  2522 raft_consensus.cc:493] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.510040  2522 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.511094  2524 raft_consensus.cc:515] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.513414  2524 leader_election.cc:290] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:48.510313  2473 leader_election.cc:304] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:48.516372  2787 raft_consensus.cc:2804] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.517297  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.519428  1912 raft_consensus.cc:3055] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:48.519812  1912 raft_consensus.cc:740] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:48.520697  1912 consensus_queue.cc:260] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.522017  1912 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.529004  1912 raft_consensus.cc:2468] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.533870  2784 raft_consensus.cc:697] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.529740  2787 raft_consensus.cc:697] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.517464  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f45f5c68e96e495fb422b6f5d1734b44" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:48.535166  2784 consensus_queue.cc:237] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.534969  2473 leader_election.cc:304] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:48.536321  2787 consensus_queue.cc:237] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.536984  2786 raft_consensus.cc:2804] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.537942  2786 raft_consensus.cc:697] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.539121  2786 consensus_queue.cc:237] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.525928  2522 raft_consensus.cc:515] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.541378  2522 leader_election.cc:290] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:48.535863  1842 raft_consensus.cc:3060] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.542900  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:48.543692  1912 raft_consensus.cc:3055] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.544003  1912 raft_consensus.cc:740] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:48.544813  1912 consensus_queue.cc:260] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.545746  1839 raft_consensus.cc:2468] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.546592  1912 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.542997  1843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7e5823ed724e64809a4092d83dbdec" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:48.553820  1843 raft_consensus.cc:3060] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.555758  1842 raft_consensus.cc:2468] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:48.559439  1912 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.560592  2473 leader_election.cc:304] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:48.562039  2780 raft_consensus.cc:2804] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.562517  2780 raft_consensus.cc:697] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:48.563359  2780 consensus_queue.cc:237] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:48.573921  1843 raft_consensus.cc:2468] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:48.578282  1591 catalog_manager.cc:5697] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.615520  1591 catalog_manager.cc:5697] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.616864  1591 catalog_manager.cc:5697] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.618397  1591 catalog_manager.cc:5697] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.619894  1591 catalog_manager.cc:5697] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.621357  1591 catalog_manager.cc:5697] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.877496  1912 raft_consensus.cc:1275] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.878759  2780 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.901381  1766 raft_consensus.cc:1275] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.907251  2784 consensus_queue.cc:1048] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.961714  1912 raft_consensus.cc:1275] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.963133  2784 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.980072  1843 raft_consensus.cc:1275] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.983193  2786 consensus_queue.cc:1048] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.984997  1843 raft_consensus.cc:1275] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.990222  2786 consensus_queue.cc:1048] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.994071  1919 raft_consensus.cc:1275] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:48.997174  2782 consensus_queue.cc:1048] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.030282  1842 raft_consensus.cc:1275] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.034458  2786 consensus_queue.cc:1048] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.034461  1912 raft_consensus.cc:1275] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.046011  2782 consensus_queue.cc:1048] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:49.069710  1912 raft_consensus.cc:1275] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:49.071377  2782 consensus_queue.cc:1048] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:49.094466  1915 raft_consensus.cc:1275] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.096628  2787 consensus_queue.cc:1048] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.110201  1843 raft_consensus.cc:1275] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.111521  2782 consensus_queue.cc:1048] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.141340  1843 raft_consensus.cc:1275] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.157624  2780 consensus_queue.cc:1048] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.256908 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:49.311937 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:49.367966  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:49.368610  1920 raft_consensus.cc:606] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:49.372481  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:49.373039  1842 raft_consensus.cc:606] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:49.376504  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:49.377092  1920 raft_consensus.cc:606] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:49.377679  2771 raft_consensus.cc:993] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.378209  2758 raft_consensus.cc:1081] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.380349  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:49.380061  2524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:49.380996  1920 raft_consensus.cc:606] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Received request to transfer leadership to TS 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:49.382122  2524 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.382500  2524 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.383919  1920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:49.384531  1920 raft_consensus.cc:606] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Received request to transfer leadership to TS 386cc1a635be43ebb1e3c43b793fb7d7
I20260709 13:13:49.387235  1915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21"
dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:55942
I20260709 13:13:49.387822  1915 raft_consensus.cc:606] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:49.389403 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:49.392355 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:49.400622  2524 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.402769  2524 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:49.404744  1766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:49.405289  1766 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.407109  1915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024e65939c3e424ba2affe47d09b8ff1" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.407824  1915 raft_consensus.cc:3055] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:49.408151  1915 raft_consensus.cc:740] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:49.409129  1915 consensus_queue.cc:260] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.410614  1915 raft_consensus.cc:3060] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.413858  1766 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:49.415248  2472 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:49.416258  2780 raft_consensus.cc:2804] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:49.416693  2780 raft_consensus.cc:697] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:49.417477  2780 consensus_queue.cc:237] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.418599  1915 raft_consensus.cc:2468] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:49.428862  1591 catalog_manager.cc:5697] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.477063  2771 raft_consensus.cc:993] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 386cc1a635be43ebb1e3c43b793fb7d7 to start an election
I20260709 13:13:49.477583  2771 raft_consensus.cc:1081] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Signalling peer 386cc1a635be43ebb1e3c43b793fb7d7 to start an election
I20260709 13:13:49.479172  1766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052"
dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
 from {username='slave'} at 127.0.0.1:53208
I20260709 13:13:49.479628  1766 raft_consensus.cc:493] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.479882  1766 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.485267  1766 raft_consensus.cc:515] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.487690  1766 leader_election.cc:290] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:49.488695  1915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.489619  1915 raft_consensus.cc:3055] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:49.489997  1915 raft_consensus.cc:740] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:49.488701  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87e09536d0847e4b4f25725f653c052" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:49.490698  1842 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.490895  1915 consensus_queue.cc:260] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.492650  1915 raft_consensus.cc:3060] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.496034  1842 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:49.497503  1736 leader_election.cc:304] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:49.501049  2698 raft_consensus.cc:2804] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:49.502502  2698 raft_consensus.cc:697] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:49.503458  2698 consensus_queue.cc:237] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.508644  2776 raft_consensus.cc:993] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.509668  2756 raft_consensus.cc:1081] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.510722  1915 raft_consensus.cc:2468] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:49.513438  2525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:49.513928  2525 raft_consensus.cc:493] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.514323  2525 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.524605  1591 catalog_manager.cc:5697] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.530917  2525 raft_consensus.cc:515] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.533380  2525 leader_election.cc:290] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:49.534878  1915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.535555  1915 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.534848  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ad89189227840cfa6fd1096b4ca2ed6" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:49.542485  1842 raft_consensus.cc:3055] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:49.542786  1842 raft_consensus.cc:740] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:49.543197  1915 raft_consensus.cc:2468] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:49.543682  1842 consensus_queue.cc:260] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.544902  2473 leader_election.cc:304] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:49.545101  1842 raft_consensus.cc:3060] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.545744  2780 raft_consensus.cc:2804] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:49.546290  2780 raft_consensus.cc:697] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:49.547099  2780 consensus_queue.cc:237] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.552477  1842 raft_consensus.cc:2468] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:49.562703  1591 catalog_manager.cc:5697] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.568081  2771 raft_consensus.cc:993] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.568580  2771 raft_consensus.cc:1081] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.572106  2524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:49.572623  2524 raft_consensus.cc:493] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.572928  2524 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.579259  2771 raft_consensus.cc:993] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.579798  2765 raft_consensus.cc:1081] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:49.581357  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54774
I20260709 13:13:49.581878  2522 raft_consensus.cc:493] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.582247  2522 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.583007  2524 raft_consensus.cc:515] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.584955  2524 leader_election.cc:290] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:49.586366  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:49.586903  1842 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.592211  1842 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:49.593374  2473 leader_election.cc:304] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:49.593647  1915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633e916bc3f7458f9700a7de1ffe30de" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.594404  1915 raft_consensus.cc:3055] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:49.594400  2780 raft_consensus.cc:2804] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:49.596355  2780 raft_consensus.cc:697] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:49.599324  2522 raft_consensus.cc:515] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.598598  2780 consensus_queue.cc:237] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.595058  1915 raft_consensus.cc:740] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:49.605083  1915 consensus_queue.cc:260] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:49.606678  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.607283  1920 raft_consensus.cc:3055] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:49.607570  1920 raft_consensus.cc:740] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:49.607681  1915 raft_consensus.cc:3060] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:49.608407  2765 raft_consensus.cc:993] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: : Instructing follower 386cc1a635be43ebb1e3c43b793fb7d7 to start an election
I20260709 13:13:49.608462  1920 consensus_queue.cc:260] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.610101  1920 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.611035  2522 leader_election.cc:290] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
I20260709 13:13:49.613502  1766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23ddfe5abd743ceb5a11392adbf8f21" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:49.614071  1766 raft_consensus.cc:3060] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.615823  2771 raft_consensus.cc:1081] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Signalling peer 386cc1a635be43ebb1e3c43b793fb7d7 to start an election
I20260709 13:13:49.617379  1767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8"
dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
 from {username='slave'} at 127.0.0.1:53208
I20260709 13:13:49.617920  1767 raft_consensus.cc:493] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:49.618283  1767 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.625587  1767 raft_consensus.cc:515] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.629782  1767 leader_election.cc:290] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:49.630905  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:49.631189  1912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d27c1df32e4d62bdcd7c81e3dcddc8" candidate_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:49.631543  1842 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.631817  1912 raft_consensus.cc:3055] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:49.632236  1912 raft_consensus.cc:740] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fc1f76c2214405a104ba2cc2d4c865, State: Running, Role: LEADER
I20260709 13:13:49.632998  1912 consensus_queue.cc:260] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.634199  1912 raft_consensus.cc:3060] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:49.637751  1766 raft_consensus.cc:2468] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:49.640769  1915 raft_consensus.cc:2468] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:49.642148  2472 leader_election.cc:304] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:49.642369  1912 raft_consensus.cc:2468] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:49.643086  2787 raft_consensus.cc:2804] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:49.643501  1736 leader_election.cc:304] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:49.643595  2787 raft_consensus.cc:697] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:49.644726  2787 consensus_queue.cc:237] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:49.644726  2804 raft_consensus.cc:2804] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:49.646953  2804 raft_consensus.cc:697] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Becoming Leader. State: Replica: 386cc1a635be43ebb1e3c43b793fb7d7, State: Running, Role: LEADER
I20260709 13:13:49.647816  2804 consensus_queue.cc:237] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } }
I20260709 13:13:49.650372  1591 catalog_manager.cc:5697] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.675280  1591 catalog_manager.cc:5697] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.639904  1920 raft_consensus.cc:2468] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:49.687089  1842 raft_consensus.cc:2468] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386cc1a635be43ebb1e3c43b793fb7d7 in term 2.
I20260709 13:13:49.696200  1592 catalog_manager.cc:5697] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 reported cstate change: term changed from 1 to 2, leader changed from d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132) to 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.950929  1920 raft_consensus.cc:1275] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:49.952355  2787 consensus_queue.cc:1048] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.963474  1766 raft_consensus.cc:1275] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:49.966349  2780 consensus_queue.cc:1048] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:50.021970  1843 raft_consensus.cc:1275] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.023229  2787 consensus_queue.cc:1048] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.029171  1920 raft_consensus.cc:1275] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.030383  2698 consensus_queue.cc:1048] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.053550  1915 raft_consensus.cc:1275] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.055209  2782 consensus_queue.cc:1048] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.067698  1842 raft_consensus.cc:1275] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.074280  2698 consensus_queue.cc:1048] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.090215  1766 raft_consensus.cc:1275] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.091194  1920 raft_consensus.cc:1275] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:50.093302  2782 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:50.094337  2787 consensus_queue.cc:1048] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.095264  1845 raft_consensus.cc:1275] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:50.105469  2787 consensus_queue.cc:1048] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:50.109656  1845 raft_consensus.cc:1275] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.117498  2804 consensus_queue.cc:1048] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.132515  1912 raft_consensus.cc:1275] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 386cc1a635be43ebb1e3c43b793fb7d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.137766  2698 consensus_queue.cc:1048] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:50.174989  2473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.132:36955, user_credentials={real_user=slave}} blocked reactor thread for 48359.1us
I20260709 13:13:50.184535  1919 raft_consensus.cc:1275] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.192267  2787 consensus_queue.cc:1048] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.393275 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:50.446501 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:50.507220  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:50.507918  1842 raft_consensus.cc:606] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:50.512662  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:50.513309  1842 raft_consensus.cc:606] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:50.516606  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:50.517220  1842 raft_consensus.cc:606] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:50.520454  1842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e657952244e94190a86359d442ba3335"
dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
mode: GRACEFUL
new_leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:33424
I20260709 13:13:50.520951  1842 raft_consensus.cc:606] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Received request to transfer leadership to TS 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:50.522094 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:50.523993 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:50.641496  2756 raft_consensus.cc:993] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.642207  2776 raft_consensus.cc:1081] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.644006  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e657952244e94190a86359d442ba3335"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:50.644510  2522 raft_consensus.cc:493] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.644804  2522 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.651664  2522 raft_consensus.cc:515] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.653509  2522 leader_election.cc:290] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:50.653849  1766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:50.654187  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e657952244e94190a86359d442ba3335" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:50.654614  1766 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.654897  1842 raft_consensus.cc:3055] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.655279  1842 raft_consensus.cc:740] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:50.655968  1842 consensus_queue.cc:260] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.656919  1842 raft_consensus.cc:3060] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.662171  1766 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:50.663046  1842 raft_consensus.cc:2468] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 3.
I20260709 13:13:50.663578  2472 leader_election.cc:304] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:50.664805  2787 raft_consensus.cc:2804] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.665405  2787 raft_consensus.cc:697] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:50.666489  2787 consensus_queue.cc:237] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.678794  1591 catalog_manager.cc:5697] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 2 to 3, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 3 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.698318  2776 raft_consensus.cc:993] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.698853  2756 raft_consensus.cc:1081] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.701324  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:50.701831  2522 raft_consensus.cc:493] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.702217  2522 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.707854  2522 raft_consensus.cc:515] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.709466  2522 leader_election.cc:290] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637), f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969)
I20260709 13:13:50.710332  1766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386cc1a635be43ebb1e3c43b793fb7d7"
I20260709 13:13:50.710574  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ba3b40ea604e49a8568edd5462a025" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:50.710937  1766 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.711272  1842 raft_consensus.cc:3055] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.711668  1842 raft_consensus.cc:740] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:50.712682  1842 consensus_queue.cc:260] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.714201  1842 raft_consensus.cc:3060] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.720108  1766 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.721575  2472 leader_election.cc:304] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c; no voters: 
I20260709 13:13:50.722169  1842 raft_consensus.cc:2468] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.722378  2787 raft_consensus.cc:2804] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.722947  2787 raft_consensus.cc:697] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:50.723805  2787 consensus_queue.cc:237] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } }
I20260709 13:13:50.744081  1591 catalog_manager.cc:5697] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.797556  2776 raft_consensus.cc:993] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.803555  2848 raft_consensus.cc:1081] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.832350  2522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:50.832932  2522 raft_consensus.cc:493] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.833230  2522 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.840256  2756 raft_consensus.cc:993] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: : Instructing follower 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.840865  2756 raft_consensus.cc:1081] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Signalling peer 7709ff2ce6f24859b1ca96d2af6bd84c to start an election
I20260709 13:13:50.844834  2525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166"
dest_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c"
 from {username='slave'} at 127.0.0.1:54788
I20260709 13:13:50.845350  2525 raft_consensus.cc:493] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.845716  2525 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.849937  2522 raft_consensus.cc:515] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.849990  2525 raft_consensus.cc:515] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.852108  2522 leader_election.cc:290] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:50.853713  1920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:50.854377  1920 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.855041  1845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:50.855753  1845 raft_consensus.cc:3055] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.856093  1845 raft_consensus.cc:740] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:50.856549  1915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c81fffe19c343e488f9511f34ee3166" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fc1f76c2214405a104ba2cc2d4c865"
I20260709 13:13:50.857187  1915 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.856931  1845 consensus_queue.cc:260] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.858307  1845 raft_consensus.cc:3060] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.862829  1920 raft_consensus.cc:2468] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.865429  2473 leader_election.cc:304] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, d7fc1f76c2214405a104ba2cc2d4c865; no voters: 
I20260709 13:13:50.866384  2782 raft_consensus.cc:2804] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.867396  2782 raft_consensus.cc:697] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:50.868341  2782 consensus_queue.cc:237] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.869458  1845 raft_consensus.cc:2468] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.873507  2525 leader_election.cc:290] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Requested vote from peers f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969), d7fc1f76c2214405a104ba2cc2d4c865 (127.25.109.132:36955)
I20260709 13:13:50.874841  2473 leader_election.cc:304] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7709ff2ce6f24859b1ca96d2af6bd84c, f8863ebea2ba4d47949f4b8b6a757d47; no voters: 
I20260709 13:13:50.877236  2787 raft_consensus.cc:2804] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.877704  2787 raft_consensus.cc:697] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Becoming Leader. State: Replica: 7709ff2ce6f24859b1ca96d2af6bd84c, State: Running, Role: LEADER
I20260709 13:13:50.878563  2787 consensus_queue.cc:237] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.873064  1842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9d93f2b6f149aab543319fc847c471" candidate_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8863ebea2ba4d47949f4b8b6a757d47"
I20260709 13:13:50.886276  1842 raft_consensus.cc:3055] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.886633  1842 raft_consensus.cc:740] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8863ebea2ba4d47949f4b8b6a757d47, State: Running, Role: LEADER
I20260709 13:13:50.887604  1842 consensus_queue.cc:260] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } }
I20260709 13:13:50.889153  1842 raft_consensus.cc:3060] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.872730  1915 raft_consensus.cc:2468] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.897384  1842 raft_consensus.cc:2468] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7709ff2ce6f24859b1ca96d2af6bd84c in term 2.
I20260709 13:13:50.906965  1591 catalog_manager.cc:5697] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.923275  1591 catalog_manager.cc:5697] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c reported cstate change: term changed from 1 to 2, leader changed from f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131) to 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129). New cstate: current_term: 2 leader_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:51.067762  1766 raft_consensus.cc:1275] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:51.069150  2782 consensus_queue.cc:1048] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:51.103410  1842 raft_consensus.cc:1275] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:51.106964  2787 consensus_queue.cc:1048] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:51.191306  1842 raft_consensus.cc:1275] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:51.242873  1736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:33969, user_credentials={real_user=slave}} blocked reactor thread for 73734.5us
I20260709 13:13:51.242688  2838 consensus_queue.cc:1048] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.266609  1766 raft_consensus.cc:1275] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.268523  2838 consensus_queue.cc:1048] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.340929  1842 raft_consensus.cc:1275] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.343317  2838 consensus_queue.cc:1048] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.350558  1843 raft_consensus.cc:1275] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.355639  2838 consensus_queue.cc:1048] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8863ebea2ba4d47949f4b8b6a757d47" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 33969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:51.439333  1920 raft_consensus.cc:1275] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.459157  1920 raft_consensus.cc:1275] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Refusing update from remote peer 7709ff2ce6f24859b1ca96d2af6bd84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.466408  2782 consensus_queue.cc:1048] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:51.467226  2867 consensus_queue.cc:1048] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.525228 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:51.573048 26038 tablet_server.cc:179] TabletServer@127.25.109.129:38637 shutting down...
W20260709 13:13:51.580775  1811 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 40 similar messages]
W20260709 13:13:51.585330  1811 consensus_peers.cc:597] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.589057  1811 consensus_peers.cc:597] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.598321  1811 consensus_peers.cc:597] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.609092  1811 consensus_peers.cc:597] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.614691 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:51.615645 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.616968 26038 raft_consensus.cc:2243] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.617494 26038 raft_consensus.cc:2272] T a7887b321a8542bc8499248d7af82425 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.620527 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.621436 26038 raft_consensus.cc:2243] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.621872 26038 raft_consensus.cc:2272] T 6f635924519644d2b33d03b432f2f0dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.623976 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.624678 26038 raft_consensus.cc:2243] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.625044 26038 raft_consensus.cc:2272] T f1d7ce33e05c432bae9a05f6c1235ffd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.627023 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.627516 26038 raft_consensus.cc:2243] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.627897 26038 raft_consensus.cc:2272] T ea6b19867dd34bddba378c80d0f7f88b P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.630908 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.631657 26038 raft_consensus.cc:2243] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.632164 26038 raft_consensus.cc:2272] T 64617ce40ab24976ab92cd93d4a43fc2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.633515  1885 consensus_peers.cc:597] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.635998 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.636972 26038 raft_consensus.cc:2243] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.637507 26038 raft_consensus.cc:2272] T 8fd57330f2d548d086f9d7a41e682ee5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.641549 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.642336 26038 raft_consensus.cc:2243] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.642861 26038 raft_consensus.cc:2272] T 95515768424547f5a244a3c431e77af8 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.644353  1885 consensus_peers.cc:597] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.645037  1885 consensus_peers.cc:597] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.646193 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.647109 26038 raft_consensus.cc:2243] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:51.647897  1885 consensus_peers.cc:597] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.648267 26038 raft_consensus.cc:2272] T 71ac1c31917741069cdbad88e94789ff P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.651854 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.652719 26038 raft_consensus.cc:2243] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.654347 26038 raft_consensus.cc:2272] T e0ec621eac4f4ceaa9cc2b261a096071 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.654764  1811 consensus_peers.cc:597] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.656694 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.657315 26038 raft_consensus.cc:2243] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.657650 26038 raft_consensus.cc:2272] T f92e2274307749e7b3c88af5cc18eeec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.659672 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.660187 26038 raft_consensus.cc:2243] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.661037 26038 raft_consensus.cc:2272] T e657952244e94190a86359d442ba3335 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.663625 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.664407 26038 raft_consensus.cc:2243] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.665211 26038 raft_consensus.cc:2272] T 024e65939c3e424ba2affe47d09b8ff1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.666803  1737 consensus_peers.cc:597] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.667320 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.667986 26038 raft_consensus.cc:2243] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.668411 26038 raft_consensus.cc:2272] T 1fa4b01ab9a44167bda5a2e595a210c7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.670559 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.671088 26038 raft_consensus.cc:2243] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.671638 26038 raft_consensus.cc:2272] T 799285a16a0448ffa4198dd63be9c7b1 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.674194 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.674737 26038 raft_consensus.cc:2243] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.675415 26038 raft_consensus.cc:2272] T 2ad89189227840cfa6fd1096b4ca2ed6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.677352 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.677815 26038 raft_consensus.cc:2243] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.678260 26038 raft_consensus.cc:2272] T 09e3bee67221424696e7ac634661ab94 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.680153 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.680625 26038 raft_consensus.cc:2243] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.681007 26038 raft_consensus.cc:2272] T e8060ba9d7934ce88c1dc9d768e1bfce P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.682926 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.683436 26038 raft_consensus.cc:2243] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.683753 26038 raft_consensus.cc:2272] T a5895ed0fa1543c7b85a1646e8f8d99d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.685576 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.686132 26038 raft_consensus.cc:2243] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.686553 26038 raft_consensus.cc:2272] T ca1fd895a5da448497336f82b5d7c68f P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.688297 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.688880 26038 raft_consensus.cc:2243] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.689679 26038 raft_consensus.cc:2272] T 36ba3b40ea604e49a8568edd5462a025 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.694569 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.695367 26038 raft_consensus.cc:2243] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.695958 26038 raft_consensus.cc:2272] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.698271 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.699026 26038 raft_consensus.cc:2243] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.699561 26038 raft_consensus.cc:2272] T be2c8382c1d946388b362b876a2f85f6 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.702330 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.702953 26038 raft_consensus.cc:2243] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.703343 26038 raft_consensus.cc:2272] T cb5217ef91e14dcdac796f4a5a1626f7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.705291 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.705895 26038 raft_consensus.cc:2243] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.706842 26038 raft_consensus.cc:2272] T 633e916bc3f7458f9700a7de1ffe30de P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.709139 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.709712 26038 raft_consensus.cc:2243] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.710245 26038 raft_consensus.cc:2272] T 6c54b72c5fca48d3aebdcb078b3259e2 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.712646 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.713243 26038 raft_consensus.cc:2243] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.713688 26038 raft_consensus.cc:2272] T 2961890859c44bf99c4531325d5d5dda P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.715647 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.716208 26038 raft_consensus.cc:2243] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.716648 26038 raft_consensus.cc:2272] T 4266e947d76f4ade89d52bf8b7488b8d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.719046 26038 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:51.719574  1737 consensus_peers.cc:597] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.719774 26038 raft_consensus.cc:2243] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.720592 26038 raft_consensus.cc:2272] T e23ddfe5abd743ceb5a11392adbf8f21 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.722611 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.723122 26038 raft_consensus.cc:2243] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.723503 26038 raft_consensus.cc:2272] T 10013cf9834c48139cae7a7418d8cfc5 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.725391 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.725948 26038 raft_consensus.cc:2243] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.726488 26038 raft_consensus.cc:2272] T 5e539b2d67f744f882c34f0039a390b7 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.728763 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.729288 26038 raft_consensus.cc:2243] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.730020 26038 raft_consensus.cc:2272] T fbae727a35c2401ba95837189c5fb36c P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.732223 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.732756 26038 raft_consensus.cc:2243] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.733469 26038 raft_consensus.cc:2272] T f45f5c68e96e495fb422b6f5d1734b44 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.735551 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.736265 26038 raft_consensus.cc:2243] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.736698 26038 raft_consensus.cc:2272] T 895498f388084e08825b03b57b266577 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.738605 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.739128 26038 raft_consensus.cc:2243] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.739882 26038 raft_consensus.cc:2272] T 9e9d93f2b6f149aab543319fc847c471 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.742247 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.742877 26038 raft_consensus.cc:2243] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.743323 26038 raft_consensus.cc:2272] T b4f3dde06d094fd381efb549e6f2ec75 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.745618 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.746192 26038 raft_consensus.cc:2243] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.747089 26038 raft_consensus.cc:2272] T 0d7e5823ed724e64809a4092d83dbdec P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.749187 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.749711 26038 raft_consensus.cc:2243] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.750260 26038 raft_consensus.cc:2272] T 826a8ad6d33b46ecb299a4c360f2eabf P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.752367 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.752883 26038 raft_consensus.cc:2243] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.753687 26038 raft_consensus.cc:2272] T 9edd4d5916bd457ebee0a8735672f478 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.756691 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.757439 26038 raft_consensus.cc:2243] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.757927 26038 raft_consensus.cc:2272] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.760273 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.760828 26038 raft_consensus.cc:2243] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:51.761030  1811 consensus_peers.cc:597] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.761457 26038 raft_consensus.cc:2272] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.764448 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.765137 26038 raft_consensus.cc:2243] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.766072 26038 raft_consensus.cc:2272] T 6c81fffe19c343e488f9511f34ee3166 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.768221 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.768723 26038 raft_consensus.cc:2243] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.769181 26038 raft_consensus.cc:2272] T 5e03e9a428544fe4bd57cb92c09bc12e P 7709ff2ce6f24859b1ca96d2af6bd84c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.771502 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.772164 26038 raft_consensus.cc:2243] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.772505 26038 raft_consensus.cc:2272] T f83bd1fbb8394658b54b12ae731dc56a P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.774392 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.774830 26038 raft_consensus.cc:2243] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.775130 26038 raft_consensus.cc:2272] T 381e5c55f4de4d3997b89df0724ef37d P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.777645 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:51.778242 26038 raft_consensus.cc:2243] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.778703 26038 raft_consensus.cc:2272] T 4d9cece044e64d77b14148afae56b5a0 P 7709ff2ce6f24859b1ca96d2af6bd84c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.782579  1737 consensus_peers.cc:597] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.790905  1737 consensus_peers.cc:597] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.833410  1737 consensus_peers.cc:597] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.844696  1737 consensus_peers.cc:597] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.851819 26038 tablet_server.cc:196] TabletServer@127.25.109.129:38637 shutdown complete.
W20260709 13:13:51.877406  1737 consensus_peers.cc:597] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.883432  1885 consensus_peers.cc:597] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.920017  1811 consensus_peers.cc:597] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.936225  1737 consensus_peers.cc:597] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.945323 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:13:51.951925  1811 consensus_peers.cc:597] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.958644  1883 consensus_peers.cc:597] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.972250  1809 consensus_peers.cc:597] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.979961  1737 consensus_peers.cc:597] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.990319  1883 consensus_peers.cc:597] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.992352  1809 consensus_peers.cc:597] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.994215  1811 consensus_peers.cc:597] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:51.996661  1737 consensus_peers.cc:597] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.004513 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.005375 26038 tablet_replica.cc:333] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.006188 26038 raft_consensus.cc:2243] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.006667 26038 raft_consensus.cc:2272] T b4f3dde06d094fd381efb549e6f2ec75 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.008685 26038 tablet_replica.cc:333] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.009249 26038 raft_consensus.cc:2243] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.009696 26038 raft_consensus.cc:2272] T 5e539b2d67f744f882c34f0039a390b7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.012445 26038 tablet_replica.cc:333] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.013080 26038 raft_consensus.cc:2243] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.013614 26038 raft_consensus.cc:2272] T e657952244e94190a86359d442ba3335 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.014364  1809 consensus_peers.cc:597] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.016312 26038 tablet_replica.cc:333] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.017261 26038 raft_consensus.cc:2243] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.018316 26038 raft_consensus.cc:2272] T 5bfa49cabd9d408cad9a18a6f67ec10e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.020830 26038 tablet_replica.cc:333] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
W20260709 13:13:52.020943  1809 consensus_peers.cc:597] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.021816 26038 raft_consensus.cc:2243] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.022436 26038 raft_consensus.cc:2272] T 95515768424547f5a244a3c431e77af8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.023901  1809 consensus_peers.cc:597] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.025339 26038 tablet_replica.cc:333] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.026271 26038 raft_consensus.cc:2243] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.026846 26038 raft_consensus.cc:2272] T f1d7ce33e05c432bae9a05f6c1235ffd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.026952  1811 consensus_peers.cc:597] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.029223  1883 consensus_peers.cc:597] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.029525 26038 tablet_replica.cc:333] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.030218 26038 raft_consensus.cc:2243] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.030669 26038 raft_consensus.cc:2272] T fbae727a35c2401ba95837189c5fb36c P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.032943 26038 tablet_replica.cc:333] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.033766 26038 raft_consensus.cc:2243] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.034349 26038 raft_consensus.cc:2272] T 09e3bee67221424696e7ac634661ab94 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.037132 26038 tablet_replica.cc:333] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.037945 26038 raft_consensus.cc:2243] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.038506 26038 raft_consensus.cc:2272] T 175c1595f94b42a2a3a55a81907d9ca9 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.043241 26038 tablet_replica.cc:333] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.044090 26038 raft_consensus.cc:2243] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:52.044498  1883 consensus_peers.cc:597] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.045272 26038 raft_consensus.cc:2272] T 22a73eb01dda4e8c9b2d0f84b2974e65 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.045251  1885 consensus_peers.cc:597] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.047427  1885 consensus_peers.cc:597] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.048293 26038 tablet_replica.cc:333] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.049258 26038 raft_consensus.cc:2243] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.049830 26038 raft_consensus.cc:2272] T abff7eb16e2f4ed2a372f6fb6e6944e0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.051832  1885 consensus_peers.cc:597] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.052939 26038 tablet_replica.cc:333] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.053587 26038 raft_consensus.cc:2243] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.054037 26038 raft_consensus.cc:2272] T 63426b4990cb4e66baddcc699073609b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.056460 26038 tablet_replica.cc:333] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.057152 26038 raft_consensus.cc:2243] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.057608 26038 raft_consensus.cc:2272] T 024e65939c3e424ba2affe47d09b8ff1 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.059958 26038 tablet_replica.cc:333] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.060489 26038 raft_consensus.cc:2243] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.061251 26038 raft_consensus.cc:2272] T 1fa4b01ab9a44167bda5a2e595a210c7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.063412 26038 tablet_replica.cc:333] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.064103 26038 raft_consensus.cc:2243] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.064558 26038 raft_consensus.cc:2272] T e3beaacc9a4b49abbc8a573403e1d836 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.067977 26038 tablet_replica.cc:333] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.068753 26038 raft_consensus.cc:2243] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.069705 26038 raft_consensus.cc:2272] T 895498f388084e08825b03b57b266577 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.070564  1883 consensus_peers.cc:597] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.072491 26038 tablet_replica.cc:333] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.073372 26038 raft_consensus.cc:2243] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.073925 26038 raft_consensus.cc:2272] T ebae9483f2ce49e68f23279ac74cfbf4 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.073966  1811 consensus_peers.cc:597] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.076617 26038 tablet_replica.cc:333] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.077376 26038 raft_consensus.cc:2243] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.077867 26038 raft_consensus.cc:2272] T 7d7367c106e34612bcfd73ecbf29dc01 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.080019  1885 consensus_peers.cc:597] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.080525 26038 tablet_replica.cc:333] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.081363 26038 raft_consensus.cc:2243] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:52.081521  1885 consensus_peers.cc:597] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Couldn't send request to peer 7709ff2ce6f24859b1ca96d2af6bd84c. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.081941 26038 raft_consensus.cc:2272] T 4d9cece044e64d77b14148afae56b5a0 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.084864 26038 tablet_replica.cc:333] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.085706 26038 raft_consensus.cc:2243] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.086897 26038 raft_consensus.cc:2272] T 381e5c55f4de4d3997b89df0724ef37d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.089035 26038 tablet_replica.cc:333] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.089680 26038 raft_consensus.cc:2243] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.090546 26038 raft_consensus.cc:2272] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.092963 26038 tablet_replica.cc:333] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.093721 26038 raft_consensus.cc:2243] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.094280 26038 raft_consensus.cc:2272] T 3f1204d86fd546ac9b9805231af432d6 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.097152 26038 tablet_replica.cc:333] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
W20260709 13:13:52.097628  1809 consensus_peers.cc:597] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.097898 26038 raft_consensus.cc:2243] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.098793 26038 raft_consensus.cc:2272] T f92e2274307749e7b3c88af5cc18eeec P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.100850 26038 tablet_replica.cc:333] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.101531 26038 raft_consensus.cc:2243] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.102340 26038 raft_consensus.cc:2272] T 826a8ad6d33b46ecb299a4c360f2eabf P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.104089 26038 tablet_replica.cc:333] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.104575 26038 raft_consensus.cc:2243] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.105284 26038 raft_consensus.cc:2272] T 0001ab95b0df41219d8182675cadcadd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.107115 26038 tablet_replica.cc:333] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.107641 26038 raft_consensus.cc:2243] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.108057 26038 raft_consensus.cc:2272] T d8a09118e3c24ab680616b74c499467f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.110067 26038 tablet_replica.cc:333] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.110785 26038 raft_consensus.cc:2243] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.111340 26038 raft_consensus.cc:2272] T 6f635924519644d2b33d03b432f2f0dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.113727 26038 tablet_replica.cc:333] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.114423 26038 raft_consensus.cc:2243] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.115321 26038 raft_consensus.cc:2272] T d87e09536d0847e4b4f25725f653c052 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.117280 26038 tablet_replica.cc:333] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.117828 26038 raft_consensus.cc:2243] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.118273 26038 raft_consensus.cc:2272] T 5e03e9a428544fe4bd57cb92c09bc12e P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.120690 26038 tablet_replica.cc:333] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.121201 26038 raft_consensus.cc:2243] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.121685 26038 raft_consensus.cc:2272] T cb5217ef91e14dcdac796f4a5a1626f7 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.123713 26038 tablet_replica.cc:333] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.124361 26038 raft_consensus.cc:2243] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.124754 26038 raft_consensus.cc:2272] T 4266e947d76f4ade89d52bf8b7488b8d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.127404 26038 tablet_replica.cc:333] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
W20260709 13:13:52.127754  1883 consensus_peers.cc:597] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.127950 26038 raft_consensus.cc:2243] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.128537 26038 raft_consensus.cc:2272] T 6c54b72c5fca48d3aebdcb078b3259e2 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.130611 26038 tablet_replica.cc:333] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.131155 26038 raft_consensus.cc:2243] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.132162 26038 raft_consensus.cc:2272] T 2961890859c44bf99c4531325d5d5dda P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.133912  1809 consensus_peers.cc:597] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.134473 26038 tablet_replica.cc:333] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.135215 26038 raft_consensus.cc:2243] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.135632 26038 raft_consensus.cc:2272] T 36ba3b40ea604e49a8568edd5462a025 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.138270 26038 tablet_replica.cc:333] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.138970 26038 raft_consensus.cc:2243] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.139509 26038 raft_consensus.cc:2272] T 49403423e3f14ee3b8a3680660ceb467 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.142024 26038 tablet_replica.cc:333] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.142717 26038 raft_consensus.cc:2243] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.143617 26038 raft_consensus.cc:2272] T 6c06e30d8c0f4a09a24ebb8e781f18dd P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.145494 26038 tablet_replica.cc:333] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.146039 26038 raft_consensus.cc:2243] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.146512 26038 raft_consensus.cc:2272] T ea6b19867dd34bddba378c80d0f7f88b P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.148595 26038 tablet_replica.cc:333] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.149039 26038 raft_consensus.cc:2243] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.149394 26038 raft_consensus.cc:2272] T ca1fd895a5da448497336f82b5d7c68f P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.151216 26038 tablet_replica.cc:333] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.151631 26038 raft_consensus.cc:2243] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.152591 26038 raft_consensus.cc:2272] T a5895ed0fa1543c7b85a1646e8f8d99d P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.155031 26038 tablet_replica.cc:333] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
W20260709 13:13:52.155514  1809 consensus_peers.cc:597] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.155601 26038 raft_consensus.cc:2243] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.156150 26038 raft_consensus.cc:2272] T 30c63166b5cb40ff87aacce96cd3f111 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.158210 26038 tablet_replica.cc:333] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.158728 26038 raft_consensus.cc:2243] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.159134 26038 raft_consensus.cc:2272] T e23ddfe5abd743ceb5a11392adbf8f21 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.161068 26038 tablet_replica.cc:333] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.161535 26038 raft_consensus.cc:2243] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.162616 26038 raft_consensus.cc:2272] T 10013cf9834c48139cae7a7418d8cfc5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.165234 26038 tablet_replica.cc:333] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.165823 26038 raft_consensus.cc:2243] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:52.166229  1883 consensus_peers.cc:597] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.166378 26038 raft_consensus.cc:2272] T e8060ba9d7934ce88c1dc9d768e1bfce P 386cc1a635be43ebb1e3c43b793fb7d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.168715 26038 tablet_replica.cc:333] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7: stopping tablet replica
I20260709 13:13:52.169198 26038 raft_consensus.cc:2243] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.169926 26038 raft_consensus.cc:2272] T ab95aaaee39e4e359c7dc696ab38ebf5 P 386cc1a635be43ebb1e3c43b793fb7d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.245527 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
W20260709 13:13:52.277107  1883 consensus_peers.cc:597] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.303853  1809 consensus_peers.cc:597] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.323345 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
W20260709 13:13:52.335008  1883 consensus_peers.cc:597] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.343665  1883 consensus_peers.cc:597] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.348977  1809 consensus_peers.cc:597] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.365234  1809 consensus_peers.cc:597] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.375363 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.376032 26038 tablet_replica.cc:333] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.376608 26038 raft_consensus.cc:2243] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.376991 26038 raft_consensus.cc:2272] T e657952244e94190a86359d442ba3335 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.378849 26038 tablet_replica.cc:333] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.379355 26038 raft_consensus.cc:2243] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.379701 26038 raft_consensus.cc:2272] T e0ec621eac4f4ceaa9cc2b261a096071 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.381361 26038 tablet_replica.cc:333] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.381848 26038 raft_consensus.cc:2243] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.382308 26038 raft_consensus.cc:2272] T 9e9d93f2b6f149aab543319fc847c471 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.385169 26038 tablet_replica.cc:333] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.385689 26038 raft_consensus.cc:2243] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.386096 26038 raft_consensus.cc:2272] T f83bd1fbb8394658b54b12ae731dc56a P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.387998 26038 tablet_replica.cc:333] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.388625 26038 raft_consensus.cc:2243] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.389182 26038 raft_consensus.cc:2272] T 5bfa49cabd9d408cad9a18a6f67ec10e P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.391611 26038 tablet_replica.cc:333] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.392414 26038 raft_consensus.cc:2243] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.393345 26038 raft_consensus.cc:2272] T 5e539b2d67f744f882c34f0039a390b7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.395174 26038 tablet_replica.cc:333] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.395676 26038 raft_consensus.cc:2243] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.396327 26038 raft_consensus.cc:2272] T ca1fd895a5da448497336f82b5d7c68f P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.398044 26038 tablet_replica.cc:333] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.398586 26038 raft_consensus.cc:2243] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.398927 26038 raft_consensus.cc:2272] T a5895ed0fa1543c7b85a1646e8f8d99d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.400789 26038 tablet_replica.cc:333] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.401247 26038 raft_consensus.cc:2243] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.402132 26038 raft_consensus.cc:2272] T 175c1595f94b42a2a3a55a81907d9ca9 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.404654 26038 tablet_replica.cc:333] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.405560 26038 raft_consensus.cc:2243] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.406713 26038 raft_consensus.cc:2272] T f1d7ce33e05c432bae9a05f6c1235ffd P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.406955  1809 consensus_peers.cc:597] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.409351 26038 tablet_replica.cc:333] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.410269 26038 raft_consensus.cc:2243] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.411309 26038 raft_consensus.cc:2272] T abff7eb16e2f4ed2a372f6fb6e6944e0 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.414263 26038 tablet_replica.cc:333] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.415189 26038 raft_consensus.cc:2243] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.415786 26038 raft_consensus.cc:2272] T 2ad89189227840cfa6fd1096b4ca2ed6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.418219 26038 tablet_replica.cc:333] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.418825 26038 raft_consensus.cc:2243] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.419644 26038 raft_consensus.cc:2272] T 09e3bee67221424696e7ac634661ab94 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.419903  1883 consensus_peers.cc:597] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.421626 26038 tablet_replica.cc:333] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.422310 26038 raft_consensus.cc:2243] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.422811 26038 raft_consensus.cc:2272] T 63426b4990cb4e66baddcc699073609b P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.425361 26038 tablet_replica.cc:333] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.426119 26038 raft_consensus.cc:2243] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.426666 26038 raft_consensus.cc:2272] T 799285a16a0448ffa4198dd63be9c7b1 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.428972 26038 tablet_replica.cc:333] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.429595 26038 raft_consensus.cc:2243] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.430003 26038 raft_consensus.cc:2272] T 633e916bc3f7458f9700a7de1ffe30de P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.432029 26038 tablet_replica.cc:333] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.432773 26038 raft_consensus.cc:2243] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.433619 26038 raft_consensus.cc:2272] T cb5217ef91e14dcdac796f4a5a1626f7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.435801 26038 tablet_replica.cc:333] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.436517 26038 raft_consensus.cc:2243] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.436985 26038 raft_consensus.cc:2272] T 9edd4d5916bd457ebee0a8735672f478 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.439002 26038 tablet_replica.cc:333] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.439666 26038 raft_consensus.cc:2243] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.440099 26038 raft_consensus.cc:2272] T 826a8ad6d33b46ecb299a4c360f2eabf P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.442824 26038 tablet_replica.cc:333] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.443564 26038 raft_consensus.cc:2243] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.444080 26038 raft_consensus.cc:2272] T 0d7e5823ed724e64809a4092d83dbdec P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.446583 26038 tablet_replica.cc:333] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.447314 26038 raft_consensus.cc:2243] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.448318 26038 raft_consensus.cc:2272] T e3beaacc9a4b49abbc8a573403e1d836 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.450480 26038 tablet_replica.cc:333] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.450985 26038 raft_consensus.cc:2243] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.451366 26038 raft_consensus.cc:2272] T f45f5c68e96e495fb422b6f5d1734b44 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.453250 26038 tablet_replica.cc:333] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.453770 26038 raft_consensus.cc:2243] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.454545 26038 raft_consensus.cc:2272] T ebae9483f2ce49e68f23279ac74cfbf4 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.456265 26038 tablet_replica.cc:333] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.456770 26038 raft_consensus.cc:2243] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.457165 26038 raft_consensus.cc:2272] T 7d7367c106e34612bcfd73ecbf29dc01 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.459055 26038 tablet_replica.cc:333] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.459563 26038 raft_consensus.cc:2243] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.459966 26038 raft_consensus.cc:2272] T a7887b321a8542bc8499248d7af82425 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.461788 26038 tablet_replica.cc:333] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.462523 26038 raft_consensus.cc:2243] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.463436 26038 raft_consensus.cc:2272] T 3f1204d86fd546ac9b9805231af432d6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.465421 26038 tablet_replica.cc:333] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.465965 26038 raft_consensus.cc:2243] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.466413 26038 raft_consensus.cc:2272] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.468185 26038 tablet_replica.cc:333] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.468717 26038 raft_consensus.cc:2243] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.469120 26038 raft_consensus.cc:2272] T 381e5c55f4de4d3997b89df0724ef37d P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.471087 26038 tablet_replica.cc:333] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.471635 26038 raft_consensus.cc:2243] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.472071 26038 raft_consensus.cc:2272] T 0001ab95b0df41219d8182675cadcadd P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.473948 26038 tablet_replica.cc:333] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.474545 26038 raft_consensus.cc:2243] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.474915 26038 raft_consensus.cc:2272] T d8a09118e3c24ab680616b74c499467f P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.476809 26038 tablet_replica.cc:333] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.477262 26038 raft_consensus.cc:2243] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.477962 26038 raft_consensus.cc:2272] T 5e03e9a428544fe4bd57cb92c09bc12e P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.479749 26038 tablet_replica.cc:333] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.480193 26038 raft_consensus.cc:2243] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.480530 26038 raft_consensus.cc:2272] T 6c81fffe19c343e488f9511f34ee3166 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.482306 26038 tablet_replica.cc:333] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.482797 26038 raft_consensus.cc:2243] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.483316 26038 raft_consensus.cc:2272] T 1fa4b01ab9a44167bda5a2e595a210c7 P f8863ebea2ba4d47949f4b8b6a757d47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.485929 26038 tablet_replica.cc:333] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.486650 26038 raft_consensus.cc:2243] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.487622 26038 raft_consensus.cc:2272] T ea6b19867dd34bddba378c80d0f7f88b P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.488484  1883 consensus_peers.cc:597] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Couldn't send request to peer 386cc1a635be43ebb1e3c43b793fb7d7. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.489792 26038 tablet_replica.cc:333] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.490394 26038 raft_consensus.cc:2243] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.491120 26038 raft_consensus.cc:2272] T 64617ce40ab24976ab92cd93d4a43fc2 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.492849 26038 tablet_replica.cc:333] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.493299 26038 raft_consensus.cc:2243] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.493697 26038 raft_consensus.cc:2272] T d87e09536d0847e4b4f25725f653c052 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.496747 26038 tablet_replica.cc:333] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.497504 26038 raft_consensus.cc:2243] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.497978 26038 raft_consensus.cc:2272] T 36ba3b40ea604e49a8568edd5462a025 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.500623 26038 tablet_replica.cc:333] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.501349 26038 raft_consensus.cc:2243] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.501873 26038 raft_consensus.cc:2272] T 49403423e3f14ee3b8a3680660ceb467 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.504379 26038 tablet_replica.cc:333] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.504982 26038 raft_consensus.cc:2243] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.505774 26038 raft_consensus.cc:2272] T 8fd57330f2d548d086f9d7a41e682ee5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.508046 26038 tablet_replica.cc:333] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.508610 26038 raft_consensus.cc:2243] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.509011 26038 raft_consensus.cc:2272] T 71ac1c31917741069cdbad88e94789ff P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.510983 26038 tablet_replica.cc:333] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.511533 26038 raft_consensus.cc:2243] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.511981 26038 raft_consensus.cc:2272] T 30c63166b5cb40ff87aacce96cd3f111 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.513854 26038 tablet_replica.cc:333] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.514355 26038 raft_consensus.cc:2243] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.514703 26038 raft_consensus.cc:2272] T 10013cf9834c48139cae7a7418d8cfc5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.516355 26038 tablet_replica.cc:333] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.516836 26038 raft_consensus.cc:2243] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.517505 26038 raft_consensus.cc:2272] T be2c8382c1d946388b362b876a2f85f6 P f8863ebea2ba4d47949f4b8b6a757d47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.519270 26038 tablet_replica.cc:333] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47: stopping tablet replica
I20260709 13:13:52.519690 26038 raft_consensus.cc:2243] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.520021 26038 raft_consensus.cc:2272] T ab95aaaee39e4e359c7dc696ab38ebf5 P f8863ebea2ba4d47949f4b8b6a757d47 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.527968  1884 consensus_peers.cc:597] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.541263  1884 consensus_peers.cc:597] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.628993 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:13:52.632159  2883 raft_consensus.cc:493] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7709ff2ce6f24859b1ca96d2af6bd84c)
I20260709 13:13:52.632710  2883 raft_consensus.cc:515] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7fc1f76c2214405a104ba2cc2d4c865" member_type: VOTER last_known_addr { host: "127.25.109.132" port: 36955 } } peers { permanent_uuid: "7709ff2ce6f24859b1ca96d2af6bd84c" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 38637 } } peers { permanent_uuid: "386cc1a635be43ebb1e3c43b793fb7d7" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 37637 } }
I20260709 13:13:52.635067  2883 leader_election.cc:290] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637), 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637)
W20260709 13:13:52.638865  1885 leader_election.cc:336] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7709ff2ce6f24859b1ca96d2af6bd84c (127.25.109.129:38637): Network error: Client connection negotiation failed: client connection to 127.25.109.129:38637: connect: Connection refused (error 111)
W20260709 13:13:52.639485  1883 leader_election.cc:336] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 386cc1a635be43ebb1e3c43b793fb7d7 (127.25.109.130:37637): Network error: Client connection negotiation failed: client connection to 127.25.109.130:37637: connect: Connection refused (error 111)
I20260709 13:13:52.639926  1883 leader_election.cc:304] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fc1f76c2214405a104ba2cc2d4c865; no voters: 386cc1a635be43ebb1e3c43b793fb7d7, 7709ff2ce6f24859b1ca96d2af6bd84c
I20260709 13:13:52.640589  2883 raft_consensus.cc:2749] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:52.659312  1884 consensus_peers.cc:597] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.668996  1884 consensus_peers.cc:597] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.678592  1884 consensus_peers.cc:597] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.712648 26038 tablet_server.cc:179] TabletServer@127.25.109.132:0 shutting down...
W20260709 13:13:52.726595  1884 consensus_peers.cc:597] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.746335  1884 consensus_peers.cc:597] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.755555 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.756366 26038 tablet_replica.cc:333] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.757051 26038 raft_consensus.cc:2243] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.757880 26038 raft_consensus.cc:2272] T b4f3dde06d094fd381efb549e6f2ec75 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.760005 26038 tablet_replica.cc:333] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.760572 26038 raft_consensus.cc:2243] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.761332 26038 raft_consensus.cc:2272] T f83bd1fbb8394658b54b12ae731dc56a P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.763327 26038 tablet_replica.cc:333] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.763921 26038 raft_consensus.cc:2243] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.764374 26038 raft_consensus.cc:2272] T 5bfa49cabd9d408cad9a18a6f67ec10e P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.767153 26038 tablet_replica.cc:333] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.767730 26038 raft_consensus.cc:2243] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.768173 26038 raft_consensus.cc:2272] T 9e9d93f2b6f149aab543319fc847c471 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.769999 26038 tablet_replica.cc:333] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.770579 26038 raft_consensus.cc:2243] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.770975 26038 raft_consensus.cc:2272] T 22a73eb01dda4e8c9b2d0f84b2974e65 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.772732 26038 tablet_replica.cc:333] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.773268 26038 raft_consensus.cc:2243] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.773669 26038 raft_consensus.cc:2272] T 2ad89189227840cfa6fd1096b4ca2ed6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.775550 26038 tablet_replica.cc:333] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.776060 26038 raft_consensus.cc:2243] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.776453 26038 raft_consensus.cc:2272] T 633e916bc3f7458f9700a7de1ffe30de P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.778223 26038 tablet_replica.cc:333] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.778729 26038 raft_consensus.cc:2243] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.779116 26038 raft_consensus.cc:2272] T fbae727a35c2401ba95837189c5fb36c P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.780886 26038 tablet_replica.cc:333] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.781394 26038 raft_consensus.cc:2243] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.781788 26038 raft_consensus.cc:2272] T 175c1595f94b42a2a3a55a81907d9ca9 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.783655 26038 tablet_replica.cc:333] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.784166 26038 raft_consensus.cc:2243] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.784577 26038 raft_consensus.cc:2272] T 895498f388084e08825b03b57b266577 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.786424 26038 tablet_replica.cc:333] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.786955 26038 raft_consensus.cc:2243] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.787351 26038 raft_consensus.cc:2272] T e3beaacc9a4b49abbc8a573403e1d836 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.789110 26038 tablet_replica.cc:333] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.789626 26038 raft_consensus.cc:2243] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.790030 26038 raft_consensus.cc:2272] T ebae9483f2ce49e68f23279ac74cfbf4 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.791810 26038 tablet_replica.cc:333] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.792300 26038 raft_consensus.cc:2243] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.792694 26038 raft_consensus.cc:2272] T f45f5c68e96e495fb422b6f5d1734b44 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.794411 26038 tablet_replica.cc:333] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.794893 26038 raft_consensus.cc:2243] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.795656 26038 raft_consensus.cc:2272] T 7d7367c106e34612bcfd73ecbf29dc01 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.797317 26038 tablet_replica.cc:333] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.797765 26038 raft_consensus.cc:2243] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.798158 26038 raft_consensus.cc:2272] T e0ec621eac4f4ceaa9cc2b261a096071 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.799894 26038 tablet_replica.cc:333] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.800350 26038 raft_consensus.cc:2243] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.800683 26038 raft_consensus.cc:2272] T f92e2274307749e7b3c88af5cc18eeec P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.802326 26038 tablet_replica.cc:333] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.802785 26038 raft_consensus.cc:2243] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.803114 26038 raft_consensus.cc:2272] T 0d7e5823ed724e64809a4092d83dbdec P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.804780 26038 tablet_replica.cc:333] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.805238 26038 raft_consensus.cc:2243] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.805570 26038 raft_consensus.cc:2272] T 9edd4d5916bd457ebee0a8735672f478 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.807372 26038 tablet_replica.cc:333] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.807894 26038 raft_consensus.cc:2243] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.808833 26038 raft_consensus.cc:2272] T 63426b4990cb4e66baddcc699073609b P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.811419 26038 tablet_replica.cc:333] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.811947 26038 raft_consensus.cc:2243] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.812304 26038 raft_consensus.cc:2272] T d87e09536d0847e4b4f25725f653c052 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.813933 26038 tablet_replica.cc:333] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.814459 26038 raft_consensus.cc:2243] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.815126 26038 raft_consensus.cc:2272] T 95515768424547f5a244a3c431e77af8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.816840 26038 tablet_replica.cc:333] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.817289 26038 raft_consensus.cc:2243] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.817655 26038 raft_consensus.cc:2272] T 8fd57330f2d548d086f9d7a41e682ee5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.819324 26038 tablet_replica.cc:333] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.819799 26038 raft_consensus.cc:2243] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.820132 26038 raft_consensus.cc:2272] T 71ac1c31917741069cdbad88e94789ff P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.821975 26038 tablet_replica.cc:333] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.822515 26038 raft_consensus.cc:2243] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.823171 26038 raft_consensus.cc:2272] T 30c63166b5cb40ff87aacce96cd3f111 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.824923 26038 tablet_replica.cc:333] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.825439 26038 raft_consensus.cc:2243] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.825825 26038 raft_consensus.cc:2272] T e23ddfe5abd743ceb5a11392adbf8f21 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.827559 26038 tablet_replica.cc:333] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.828094 26038 raft_consensus.cc:2243] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.828984 26038 raft_consensus.cc:2272] T a7887b321a8542bc8499248d7af82425 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.830811 26038 tablet_replica.cc:333] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.831249 26038 raft_consensus.cc:2243] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.831595 26038 raft_consensus.cc:2272] T 87d27c1df32e4d62bdcd7c81e3dcddc8 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.833173 26038 tablet_replica.cc:333] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.833612 26038 raft_consensus.cc:2243] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.833946 26038 raft_consensus.cc:2272] T 3f1204d86fd546ac9b9805231af432d6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.835708 26038 tablet_replica.cc:333] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.836146 26038 raft_consensus.cc:2243] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.836813 26038 raft_consensus.cc:2272] T 4d9cece044e64d77b14148afae56b5a0 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.838568 26038 tablet_replica.cc:333] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.839035 26038 raft_consensus.cc:2243] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.839679 26038 raft_consensus.cc:2272] T 6f635924519644d2b33d03b432f2f0dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.841506 26038 tablet_replica.cc:333] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.841945 26038 raft_consensus.cc:2243] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.842338 26038 raft_consensus.cc:2272] T 0001ab95b0df41219d8182675cadcadd P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.844108 26038 tablet_replica.cc:333] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.844547 26038 raft_consensus.cc:2243] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.845180 26038 raft_consensus.cc:2272] T d8a09118e3c24ab680616b74c499467f P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.846861 26038 tablet_replica.cc:333] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.847280 26038 raft_consensus.cc:2243] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.847615 26038 raft_consensus.cc:2272] T 6c81fffe19c343e488f9511f34ee3166 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.849246 26038 tablet_replica.cc:333] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.849670 26038 raft_consensus.cc:2243] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.850035 26038 raft_consensus.cc:2272] T 64617ce40ab24976ab92cd93d4a43fc2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.851698 26038 tablet_replica.cc:333] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.852125 26038 raft_consensus.cc:2243] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.852766 26038 raft_consensus.cc:2272] T 4266e947d76f4ade89d52bf8b7488b8d P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.854561 26038 tablet_replica.cc:333] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.855296 26038 raft_consensus.cc:2243] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.856051 26038 raft_consensus.cc:2272] T 6c54b72c5fca48d3aebdcb078b3259e2 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.858435 26038 tablet_replica.cc:333] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.859053 26038 raft_consensus.cc:2243] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.859575 26038 raft_consensus.cc:2272] T 2961890859c44bf99c4531325d5d5dda P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.859604  1884 consensus_peers.cc:597] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 -> Peer f8863ebea2ba4d47949f4b8b6a757d47 (127.25.109.131:33969): Couldn't send request to peer f8863ebea2ba4d47949f4b8b6a757d47. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.131:33969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.861688 26038 tablet_replica.cc:333] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.862255 26038 raft_consensus.cc:2243] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.862998 26038 raft_consensus.cc:2272] T 799285a16a0448ffa4198dd63be9c7b1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.864763 26038 tablet_replica.cc:333] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.865243 26038 raft_consensus.cc:2243] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.865604 26038 raft_consensus.cc:2272] T 6c06e30d8c0f4a09a24ebb8e781f18dd P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.867425 26038 tablet_replica.cc:333] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.867851 26038 raft_consensus.cc:2243] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.868507 26038 raft_consensus.cc:2272] T 49403423e3f14ee3b8a3680660ceb467 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.870508 26038 tablet_replica.cc:333] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.870952 26038 raft_consensus.cc:2243] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.871275 26038 raft_consensus.cc:2272] T 024e65939c3e424ba2affe47d09b8ff1 P d7fc1f76c2214405a104ba2cc2d4c865 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.872934 26038 tablet_replica.cc:333] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.873356 26038 raft_consensus.cc:2243] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.873979 26038 raft_consensus.cc:2272] T e8060ba9d7934ce88c1dc9d768e1bfce P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.875715 26038 tablet_replica.cc:333] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.876122 26038 raft_consensus.cc:2243] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.876458 26038 raft_consensus.cc:2272] T be2c8382c1d946388b362b876a2f85f6 P d7fc1f76c2214405a104ba2cc2d4c865 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.878134 26038 tablet_replica.cc:333] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865: stopping tablet replica
I20260709 13:13:52.878509 26038 raft_consensus.cc:2243] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.878949 26038 raft_consensus.cc:2272] T ab95aaaee39e4e359c7dc696ab38ebf5 P d7fc1f76c2214405a104ba2cc2d4c865 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.943208 26038 tablet_server.cc:196] TabletServer@127.25.109.132:0 shutdown complete.
I20260709 13:13:53.007063 26038 master.cc:562] Master@127.25.109.190:37007 shutting down...
W20260709 13:13:53.032122  1643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:13:53.033109 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:53.033620 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:53.033942 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P ab00e6e9f3204c779d447ee29e534e73: stopping tablet replica
I20260709 13:13:53.055840 26038 master.cc:584] Master@127.25.109.190:37007 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (27281 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:53.142433 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:33193
I20260709 13:13:53.143556 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.149384  2886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.150244  2889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.149756  2887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.151047 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:53.152199 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.152395 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.152563 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602833152532 us; error 0 us; skew 500 ppm
I20260709 13:13:53.153098 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.155478 26038 webserver.cc:533] Webserver started at http://127.25.109.190:33787/ using document root <none> and password file <none>
I20260709 13:13:53.155970 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.156159 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.156443 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.157572 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.163142 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:53.166539  2894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.167415 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:53.167708 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.167985 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.191478 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.192709 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.232338 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:33193
I20260709 13:13:53.232406  2945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:33193 every 8 connection(s)
I20260709 13:13:53.236191  2946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.246371  2946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e: Bootstrap starting.
I20260709 13:13:53.251155  2946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.255873  2946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e: No bootstrap required, opened a new log
I20260709 13:13:53.257966  2946 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER }
I20260709 13:13:53.258419  2946 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.258662  2946 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e96e087a4e341bfb7ec3dc8917e6b5e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.259298  2946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER }
I20260709 13:13:53.259752  2946 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:53.259976  2946 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:53.260242  2946 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.265331  2946 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER }
I20260709 13:13:53.265832  2946 leader_election.cc:304] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e96e087a4e341bfb7ec3dc8917e6b5e; no voters: 
I20260709 13:13:53.267026  2946 leader_election.cc:290] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:53.267434  2949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.268850  2949 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 1 LEADER]: Becoming Leader. State: Replica: 4e96e087a4e341bfb7ec3dc8917e6b5e, State: Running, Role: LEADER
I20260709 13:13:53.269567  2949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER }
I20260709 13:13:53.270253  2946 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:53.273790  2950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER } }
I20260709 13:13:53.274155  2951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e96e087a4e341bfb7ec3dc8917e6b5e. Latest consensus state: current_term: 1 leader_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e96e087a4e341bfb7ec3dc8917e6b5e" member_type: VOTER } }
I20260709 13:13:53.274771  2950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:53.274787  2951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:53.284826  2955 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:53.289466  2955 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:53.290594 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:53.298134  2955 catalog_manager.cc:1383] Generated new cluster ID: 5f8179cd0c8d4d75b3697c6d6ea92145
I20260709 13:13:53.298435  2955 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:53.328358  2955 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:53.329761  2955 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:53.344012  2955 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e: Generated new TSK 0
I20260709 13:13:53.344705  2955 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:53.357482 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.363865  2967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.365027  2968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.366531  2970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.366816 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:53.367889 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.368081 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.368201 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602833368190 us; error 0 us; skew 500 ppm
I20260709 13:13:53.368716 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.371340 26038 webserver.cc:533] Webserver started at http://127.25.109.129:41843/ using document root <none> and password file <none>
I20260709 13:13:53.371856 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.372063 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.372334 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.373430 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "ea18d7b298b64be9b83bdd3729115c19"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.377978 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:53.381428  2975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.382354 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:53.382604 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "ea18d7b298b64be9b83bdd3729115c19"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.382858 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.394846 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.396047 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.397383 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.399708 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.399890 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.400193 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.400360 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.440049 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:34499
I20260709 13:13:53.440168  3037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:34499 every 8 connection(s)
I20260709 13:13:53.445217 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.452350  3042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.452392  3043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.456555  3046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.456616 26038 server_base.cc:1061] running on GCE node
I20260709 13:13:53.457904 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.458173 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.458348 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602833458331 us; error 0 us; skew 500 ppm
I20260709 13:13:53.458997 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.461812 26038 webserver.cc:533] Webserver started at http://127.25.109.130:46489/ using document root <none> and password file <none>
I20260709 13:13:53.462459 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.462497  3038 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33193
I20260709 13:13:53.462703 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.462994  3038 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:53.463085 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.463768  3038 heartbeater.cc:507] Master 127.25.109.190:33193 requested a full tablet report, sending...
I20260709 13:13:53.464463 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "15e3cee76749436eaed7b727fdb0191e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.466097  2911 ts_manager.cc:194] Registered new tserver with Master: ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499)
I20260709 13:13:53.468613  2911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47876
I20260709 13:13:53.470780 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:13:53.474273  3050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.475069 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:53.475364 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "15e3cee76749436eaed7b727fdb0191e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.475632 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.522851 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.524056 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.525559 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.527743 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.527971 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.528211 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.528383 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.568218 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:34283
I20260709 13:13:53.568338  3112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:34283 every 8 connection(s)
I20260709 13:13:53.573016 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.580731  3116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.581440  3117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.585187 26038 server_base.cc:1061] running on GCE node
W20260709 13:13:53.585592  3119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.586611 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.586863 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.587073 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602833587049 us; error 0 us; skew 500 ppm
I20260709 13:13:53.587606 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.590282  3113 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33193
I20260709 13:13:53.590632  3113 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:53.591321  3113 heartbeater.cc:507] Master 127.25.109.190:33193 requested a full tablet report, sending...
I20260709 13:13:53.591401 26038 webserver.cc:533] Webserver started at http://127.25.109.131:40911/ using document root <none> and password file <none>
I20260709 13:13:53.592021 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.592268 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.592592 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.593400  2911 ts_manager.cc:194] Registered new tserver with Master: 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:53.593778 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "50b05c32044f49ca894ae6b2b427bad5"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.594913  2911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47890
I20260709 13:13:53.598527 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:53.601814  3124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.602583 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:53.602890 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "50b05c32044f49ca894ae6b2b427bad5"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:13:53.603189 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.617671 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.618903 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.620357 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.622565 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.622784 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.623024 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.623198 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.663401 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:40231
I20260709 13:13:53.663511  3186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:40231 every 8 connection(s)
I20260709 13:13:53.677698  3187 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33193
I20260709 13:13:53.678208  3187 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:53.679025  3187 heartbeater.cc:507] Master 127.25.109.190:33193 requested a full tablet report, sending...
I20260709 13:13:53.680967  2911 ts_manager.cc:194] Registered new tserver with Master: 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:53.681226 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014742016s
I20260709 13:13:53.682494  2911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47904
I20260709 13:13:53.706684  2911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47906:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:53.709684  2911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:53.782392  3078 tablet_service.cc:1511] Processing CreateTablet for tablet bc23729582c347e19c2daa1902f63b0f (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:53.783094  3076 tablet_service.cc:1511] Processing CreateTablet for tablet b19abe1355e446a9b9a676d766b0de46 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:53.784370  3078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc23729582c347e19c2daa1902f63b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.785537  3077 tablet_service.cc:1511] Processing CreateTablet for tablet 0b029ee8ebb64d3b97e3fde0d63807a4 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:53.787042  3077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b029ee8ebb64d3b97e3fde0d63807a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.786761  3075 tablet_service.cc:1511] Processing CreateTablet for tablet 9263a47dce1c4c9d9f605cc784309307 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:53.788246  3075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263a47dce1c4c9d9f605cc784309307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.789525  3076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19abe1355e446a9b9a676d766b0de46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.811197  3074 tablet_service.cc:1511] Processing CreateTablet for tablet 835b87eabc214c0d96b339bc3b0873b5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:53.813190  3074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835b87eabc214c0d96b339bc3b0873b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.839239  3152 tablet_service.cc:1511] Processing CreateTablet for tablet bc23729582c347e19c2daa1902f63b0f (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:53.840445  3201 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:53.840346  3150 tablet_service.cc:1511] Processing CreateTablet for tablet b19abe1355e446a9b9a676d766b0de46 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:53.841164  3152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc23729582c347e19c2daa1902f63b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.841965  3150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19abe1355e446a9b9a676d766b0de46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.844760  3151 tablet_service.cc:1511] Processing CreateTablet for tablet 0b029ee8ebb64d3b97e3fde0d63807a4 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:53.846602  3151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b029ee8ebb64d3b97e3fde0d63807a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.847097  3149 tablet_service.cc:1511] Processing CreateTablet for tablet 9263a47dce1c4c9d9f605cc784309307 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:53.849496  3148 tablet_service.cc:1511] Processing CreateTablet for tablet 835b87eabc214c0d96b339bc3b0873b5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:53.850801  3148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835b87eabc214c0d96b339bc3b0873b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.856199  3149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263a47dce1c4c9d9f605cc784309307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.862946  3075 tablet_service.cc:1511] Processing CreateTablet for tablet a1620e5f9ee74d90b8513075b0c7fdfd (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:53.864346  3075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1620e5f9ee74d90b8513075b0c7fdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.868562  3147 tablet_service.cc:1511] Processing CreateTablet for tablet a1620e5f9ee74d90b8513075b0c7fdfd (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:53.870069  3147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1620e5f9ee74d90b8513075b0c7fdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.875332  3001 tablet_service.cc:1511] Processing CreateTablet for tablet b19abe1355e446a9b9a676d766b0de46 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:53.876067  3003 tablet_service.cc:1511] Processing CreateTablet for tablet bc23729582c347e19c2daa1902f63b0f (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:53.876807  3001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19abe1355e446a9b9a676d766b0de46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.879400  3002 tablet_service.cc:1511] Processing CreateTablet for tablet 0b029ee8ebb64d3b97e3fde0d63807a4 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:53.880836  3003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc23729582c347e19c2daa1902f63b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.883203  3000 tablet_service.cc:1511] Processing CreateTablet for tablet 9263a47dce1c4c9d9f605cc784309307 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:53.884531  3000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9263a47dce1c4c9d9f605cc784309307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.886545  2997 tablet_service.cc:1511] Processing CreateTablet for tablet 5718cd028729404689ba3efa810621d5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:53.895396  3146 tablet_service.cc:1511] Processing CreateTablet for tablet 5718cd028729404689ba3efa810621d5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:53.897099  3146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5718cd028729404689ba3efa810621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.899362  2998 tablet_service.cc:1511] Processing CreateTablet for tablet a1620e5f9ee74d90b8513075b0c7fdfd (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:53.908268  3075 tablet_service.cc:1511] Processing CreateTablet for tablet 5718cd028729404689ba3efa810621d5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:53.909366  3002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b029ee8ebb64d3b97e3fde0d63807a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.909940  3075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5718cd028729404689ba3efa810621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.910099  2997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5718cd028729404689ba3efa810621d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.889308  2999 tablet_service.cc:1511] Processing CreateTablet for tablet 835b87eabc214c0d96b339bc3b0873b5 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:53.911230  2999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835b87eabc214c0d96b339bc3b0873b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.922765  2998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1620e5f9ee74d90b8513075b0c7fdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.923962  3202 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:53.930801  3201 tablet_bootstrap.cc:654] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.932849  3202 tablet_bootstrap.cc:654] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.953302  3000 tablet_service.cc:1511] Processing CreateTablet for tablet 242bdcaead5743108241e9798f270337 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:53.954694  3000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242bdcaead5743108241e9798f270337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.957263  3151 tablet_service.cc:1511] Processing CreateTablet for tablet 242bdcaead5743108241e9798f270337 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:53.958639  3151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242bdcaead5743108241e9798f270337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.973906  3076 tablet_service.cc:1511] Processing CreateTablet for tablet 242bdcaead5743108241e9798f270337 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:53.979358  3076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242bdcaead5743108241e9798f270337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.988425  2996 tablet_service.cc:1511] Processing CreateTablet for tablet 823e2db013344e21ba2dc9cd21d16c7e (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:53.990392  2996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823e2db013344e21ba2dc9cd21d16c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.041050  3075 tablet_service.cc:1511] Processing CreateTablet for tablet 823e2db013344e21ba2dc9cd21d16c7e (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:54.042480  3075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823e2db013344e21ba2dc9cd21d16c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.055729  2995 tablet_service.cc:1511] Processing CreateTablet for tablet a4c22f2f57044d4a892b39996ec19078 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:54.057866  2995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c22f2f57044d4a892b39996ec19078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.067071  3150 tablet_service.cc:1511] Processing CreateTablet for tablet 823e2db013344e21ba2dc9cd21d16c7e (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:54.068461  3150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823e2db013344e21ba2dc9cd21d16c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.068971  3202 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.069782  3202 ts_tablet_manager.cc:1403] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.057s
I20260709 13:13:54.071899  3201 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.072500  3201 ts_tablet_manager.cc:1403] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.011s
I20260709 13:13:54.082667  3202 raft_consensus.cc:359] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.085418  3202 raft_consensus.cc:385] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.083268  3203 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.092695  3203 tablet_bootstrap.cc:654] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.092528  3074 tablet_service.cc:1511] Processing CreateTablet for tablet a4c22f2f57044d4a892b39996ec19078 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:54.085807  3202 raft_consensus.cc:740] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.083455  3201 raft_consensus.cc:359] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.093650  3201 raft_consensus.cc:385] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.093891  3074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c22f2f57044d4a892b39996ec19078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.094033  3201 raft_consensus.cc:740] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.095147  3201 consensus_queue.cc:260] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.094174  3202 consensus_queue.cc:260] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.103857  3187 heartbeater.cc:499] Master 127.25.109.190:33193 was elected leader, sending a full tablet report...
I20260709 13:13:54.105347  3202 ts_tablet_manager.cc:1434] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:13:54.106912  3202 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.108995  3146 tablet_service.cc:1511] Processing CreateTablet for tablet a4c22f2f57044d4a892b39996ec19078 (DEFAULT_TABLE table=test-workload [id=2027c9e5d8be4074bf8bcb7703db4483]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:54.110373  3146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c22f2f57044d4a892b39996ec19078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:54.112172  3203 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.114137  3203 ts_tablet_manager.cc:1403] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:13:54.115275  3113 heartbeater.cc:499] Master 127.25.109.190:33193 was elected leader, sending a full tablet report...
I20260709 13:13:54.115902  3202 tablet_bootstrap.cc:654] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.115696  3201 ts_tablet_manager.cc:1434] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.043s	user 0.015s	sys 0.000s
I20260709 13:13:54.121016  3201 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.128537  3201 tablet_bootstrap.cc:654] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.130885  3202 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.131748  3203 raft_consensus.cc:359] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.132789  3203 raft_consensus.cc:385] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.132895  3202 ts_tablet_manager.cc:1403] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:13:54.133212  3203 raft_consensus.cc:740] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.134209  3203 consensus_queue.cc:260] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.136058  3202 raft_consensus.cc:359] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.136814  3202 raft_consensus.cc:385] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.137141  3202 raft_consensus.cc:740] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.137908  3202 consensus_queue.cc:260] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.140374  3202 ts_tablet_manager.cc:1434] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:54.140942  3206 raft_consensus.cc:493] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.141324  3202 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.141440  3206 raft_consensus.cc:515] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.145977  3201 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.149828  3201 ts_tablet_manager.cc:1403] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:13:54.149127  3038 heartbeater.cc:499] Master 127.25.109.190:33193 was elected leader, sending a full tablet report...
I20260709 13:13:54.153147  3206 leader_election.cc:290] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.149233  3203 ts_tablet_manager.cc:1434] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:13:54.148609  3202 tablet_bootstrap.cc:654] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.154623  3203 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.153193  3201 raft_consensus.cc:359] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.158206  3201 raft_consensus.cc:385] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.158641  3201 raft_consensus.cc:740] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.159549  3201 consensus_queue.cc:260] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.162030  3203 tablet_bootstrap.cc:654] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.163996  3201 ts_tablet_manager.cc:1434] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:54.166602  3201 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.174304  3203 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.174935  3203 ts_tablet_manager.cc:1403] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 13:13:54.175045  3201 tablet_bootstrap.cc:654] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.174347  3202 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.178222  3202 ts_tablet_manager.cc:1403] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.006s
I20260709 13:13:54.181043  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
W20260709 13:13:54.182646  3053 leader_election.cc:343] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.181241  3202 raft_consensus.cc:359] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.183194  3202 raft_consensus.cc:385] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.183538  3202 raft_consensus.cc:740] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.181886  3203 raft_consensus.cc:359] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.184160  3203 raft_consensus.cc:385] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.184574  3203 raft_consensus.cc:740] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.184574  3202 consensus_queue.cc:260] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.186396  3203 consensus_queue.cc:260] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.187110  3202 ts_tablet_manager.cc:1434] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:13:54.188179  3202 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.188185  3201 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.188530  3203 ts_tablet_manager.cc:1434] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:13:54.188973  3201 ts_tablet_manager.cc:1403] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:13:54.189471  3203 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.195387  3202 tablet_bootstrap.cc:654] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.196429  3203 tablet_bootstrap.cc:654] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.197031  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.197769  3013 raft_consensus.cc:2468] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.199788  3054 leader_election.cc:304] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:13:54.201334  3206 raft_consensus.cc:2804] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.201809  3206 raft_consensus.cc:493] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.202251  3206 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.212817  3206 raft_consensus.cc:515] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.219445  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.220192  3013 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.215260  3201 raft_consensus.cc:359] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.222397  3201 raft_consensus.cc:385] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.222885  3201 raft_consensus.cc:740] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.223969  3201 consensus_queue.cc:260] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.227058  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
W20260709 13:13:54.229374  3053 leader_election.cc:343] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.230844  3206 leader_election.cc:290] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.231148  3013 raft_consensus.cc:2468] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.233696  3208 raft_consensus.cc:493] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.234241  3208 raft_consensus.cc:515] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.236830  3208 leader_election.cc:290] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.241250  3054 leader_election.cc:304] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:13:54.242836  3206 raft_consensus.cc:2804] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.243428  3206 raft_consensus.cc:697] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:54.244501  3206 consensus_queue.cc:237] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.247879  3201 ts_tablet_manager.cc:1434] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.009s
I20260709 13:13:54.248817  3202 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.248986  3201 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.249351  3202 ts_tablet_manager.cc:1403] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.039s
I20260709 13:13:54.252197  3203 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.252770  3203 ts_tablet_manager.cc:1403] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.020s
I20260709 13:13:54.252324  3202 raft_consensus.cc:359] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.253394  3202 raft_consensus.cc:385] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.253741  3202 raft_consensus.cc:740] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.254556  3202 consensus_queue.cc:260] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.256084  3203 raft_consensus.cc:359] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.256789  3203 raft_consensus.cc:385] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.257122  3203 raft_consensus.cc:740] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.258030  3203 consensus_queue.cc:260] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.259308  3202 ts_tablet_manager.cc:1434] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:54.260278  3202 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.266994  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.267338  3201 tablet_bootstrap.cc:654] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.267711  3088 raft_consensus.cc:2468] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.270776  3210 raft_consensus.cc:493] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.271531  3202 tablet_bootstrap.cc:654] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.271271  3210 raft_consensus.cc:515] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.270316  3125 leader_election.cc:304] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: 
I20260709 13:13:54.272547  2908 catalog_manager.cc:5697] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 0 to 1, leader changed from <none> to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 1 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.273517  3208 raft_consensus.cc:2804] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.273960  3208 raft_consensus.cc:493] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.274362  3208 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.280074  3210 leader_election.cc:290] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
W20260709 13:13:54.282752  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:54.286774  3203 ts_tablet_manager.cc:1434] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 13:13:54.290187  3206 raft_consensus.cc:493] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.290848  3206 raft_consensus.cc:515] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.292413  3203 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.293673  3206 leader_election.cc:290] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.295324  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.296036  3162 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.297407  3053 leader_election.cc:304] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: 
I20260709 13:13:54.298840  3206 raft_consensus.cc:2804] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.299316  3206 raft_consensus.cc:493] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.299727  3206 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.288976  3208 raft_consensus.cc:515] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.317619  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.318279  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.318403  3013 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.320221  3203 tablet_bootstrap.cc:654] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:54.321178  2976 leader_election.cc:343] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.321313  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
W20260709 13:13:54.323200  2978 leader_election.cc:343] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.323850  2978 leader_election.cc:304] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea18d7b298b64be9b83bdd3729115c19; no voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:13:54.325043  3210 raft_consensus.cc:2749] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.330566  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
W20260709 13:13:54.332181  3128 leader_election.cc:343] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.333678  3203 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.334424  3203 ts_tablet_manager.cc:1403] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:13:54.335341  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
W20260709 13:13:54.336941  3128 leader_election.cc:343] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.338299  3203 raft_consensus.cc:359] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.339320  3203 raft_consensus.cc:385] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.339679  3203 raft_consensus.cc:740] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.339967  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:13:54.340629  3088 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.340703  3203 consensus_queue.cc:260] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.347965  3088 raft_consensus.cc:2468] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.349320  3125 leader_election.cc:304] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:54.352052  3208 leader_election.cc:290] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.352648  3208 raft_consensus.cc:2804] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.353049  3208 raft_consensus.cc:697] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:13:54.355322  3206 raft_consensus.cc:515] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.358880  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.359426  3013 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.369501  3013 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.371605  3054 leader_election.cc:304] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.353780  3208 consensus_queue.cc:237] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.372551  3219 raft_consensus.cc:2804] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.373024  3201 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.373764  3201 ts_tablet_manager.cc:1403] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.125s	user 0.037s	sys 0.000s
I20260709 13:13:54.374946  3224 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.375612  3224 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.359349  3203 ts_tablet_manager.cc:1434] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:13:54.378489  3224 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.380254  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.381793  3219 raft_consensus.cc:697] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:54.382858  3219 consensus_queue.cc:237] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.384886  3203 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.385525  3202 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.386243  3202 ts_tablet_manager.cc:1403] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.126s	user 0.030s	sys 0.056s
I20260709 13:13:54.386875  3206 leader_election.cc:290] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.377727  3201 raft_consensus.cc:359] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.390133  3201 raft_consensus.cc:385] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.390468  3201 raft_consensus.cc:740] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.391487  3201 consensus_queue.cc:260] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.390424  3202 raft_consensus.cc:359] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.393136  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.396108  3203 tablet_bootstrap.cc:654] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.396497  3161 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 0.
I20260709 13:13:54.397897  2978 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.393579  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
W20260709 13:13:54.399587  2976 leader_election.cc:343] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.399997  3162 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.400624  3224 raft_consensus.cc:2804] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.394459  3202 raft_consensus.cc:385] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.400323  3201 ts_tablet_manager.cc:1434] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:13:54.402375  3202 raft_consensus.cc:740] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.403928  3201 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.401496  3224 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.409258  3224 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.403756  3202 consensus_queue.cc:260] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.412474  3201 tablet_bootstrap.cc:654] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.412521  3202 ts_tablet_manager.cc:1434] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 13:13:54.413939  3202 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.415237  2910 catalog_manager.cc:5697] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.421552  3202 tablet_bootstrap.cc:654] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.429631  3162 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.430910  3224 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.435751  3224 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 election: Requested vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.438665  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
W20260709 13:13:54.440600  2976 leader_election.cc:343] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.440732  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:54.441386  3162 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.443442  3202 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.443993  3202 ts_tablet_manager.cc:1403] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.001s
I20260709 13:13:54.447073  3202 raft_consensus.cc:359] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.447741  3202 raft_consensus.cc:385] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.448017  3202 raft_consensus.cc:740] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.448590  3162 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 1.
I20260709 13:13:54.448772  3202 consensus_queue.cc:260] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.449836  2978 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 15e3cee76749436eaed7b727fdb0191e
I20260709 13:13:54.450699  3224 raft_consensus.cc:2804] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.451128  3202 ts_tablet_manager.cc:1434] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:13:54.451232  3224 raft_consensus.cc:697] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 LEADER]: Becoming Leader. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Running, Role: LEADER
I20260709 13:13:54.452212  3202 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.452287  3224 consensus_queue.cc:237] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.454530  3203 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.455132  3203 ts_tablet_manager.cc:1403] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 13:13:54.455583  3201 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.456137  3201 ts_tablet_manager.cc:1403] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.011s
I20260709 13:13:54.458544  3203 raft_consensus.cc:359] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.459481  3203 raft_consensus.cc:385] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.459287  3201 raft_consensus.cc:359] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.459959  3203 raft_consensus.cc:740] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.460204  3201 raft_consensus.cc:385] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.460987  3201 raft_consensus.cc:740] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.461202  3203 consensus_queue.cc:260] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.462903  3202 tablet_bootstrap.cc:654] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.462880  3201 consensus_queue.cc:260] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.464491  3203 ts_tablet_manager.cc:1434] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:13:54.465451  3201 ts_tablet_manager.cc:1434] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:13:54.467195  3203 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.467958  3201 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.476054  3203 tablet_bootstrap.cc:654] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.479416  2908 catalog_manager.cc:5697] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 0 to 1, leader changed from <none> to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 1 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.480540  2909 catalog_manager.cc:5697] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "ea18d7b298b64be9b83bdd3729115c19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.489020  3203 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.489768  3203 ts_tablet_manager.cc:1403] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:13:54.493764  3203 raft_consensus.cc:359] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.494776  3203 raft_consensus.cc:385] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.495158  3203 raft_consensus.cc:740] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.495797  3201 tablet_bootstrap.cc:654] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.496129  3203 consensus_queue.cc:260] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.499166  3202 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.499656  3202 ts_tablet_manager.cc:1403] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.048s	user 0.030s	sys 0.012s
I20260709 13:13:54.502727  3202 raft_consensus.cc:359] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.503509  3202 raft_consensus.cc:385] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.503795  3202 raft_consensus.cc:740] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.503860  3203 ts_tablet_manager.cc:1434] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:13:54.504689  3202 consensus_queue.cc:260] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.506944  3202 ts_tablet_manager.cc:1434] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:13:54.507895  3202 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.509984  3201 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.510592  3201 ts_tablet_manager.cc:1403] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.003s
I20260709 13:13:54.505100  3203 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.513937  3201 raft_consensus.cc:359] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.514743  3201 raft_consensus.cc:385] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.515087  3201 raft_consensus.cc:740] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.516017  3201 consensus_queue.cc:260] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.518431  3201 ts_tablet_manager.cc:1434] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:54.519588  3201 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.520210  3203 tablet_bootstrap.cc:654] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.523526  3202 tablet_bootstrap.cc:654] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.525630  3201 tablet_bootstrap.cc:654] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.528317  3203 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.528985  3203 ts_tablet_manager.cc:1403] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:13:54.533250  3203 raft_consensus.cc:359] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.534452  3203 raft_consensus.cc:385] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.534991  3203 raft_consensus.cc:740] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.536072  3203 consensus_queue.cc:260] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.536787  3202 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.537292  3202 ts_tablet_manager.cc:1403] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.006s
I20260709 13:13:54.538105  3201 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.538504  3203 ts_tablet_manager.cc:1434] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:13:54.538681  3201 ts_tablet_manager.cc:1403] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 13:13:54.539633  3203 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.539811  3202 raft_consensus.cc:359] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.540490  3202 raft_consensus.cc:385] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.540750  3202 raft_consensus.cc:740] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.541507  3202 consensus_queue.cc:260] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.541898  3201 raft_consensus.cc:359] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.542754  3201 raft_consensus.cc:385] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.543079  3201 raft_consensus.cc:740] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.544078  3201 consensus_queue.cc:260] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.547230  3203 tablet_bootstrap.cc:654] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.549494  3202 ts_tablet_manager.cc:1434] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:54.550470  3202 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.555649  3201 ts_tablet_manager.cc:1434] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:54.556020  3202 tablet_bootstrap.cc:654] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.559376  3201 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.559226  3230 raft_consensus.cc:493] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.560092  3230 raft_consensus.cc:515] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.563302  3230 leader_election.cc:290] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.564128  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.565393  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
W20260709 13:13:54.565579  3128 leader_election.cc:343] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.566011  3203 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.566123  3088 raft_consensus.cc:2468] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.566684  3203 ts_tablet_manager.cc:1403] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.012s
I20260709 13:13:54.567555  3201 tablet_bootstrap.cc:654] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.567665  3125 leader_election.cc:304] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:54.569309  3230 raft_consensus.cc:2804] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.570369  3230 raft_consensus.cc:493] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.570801  3230 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.569837  3203 raft_consensus.cc:359] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.572223  3203 raft_consensus.cc:385] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.572393  3202 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.572734  3203 raft_consensus.cc:740] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.573036  3202 ts_tablet_manager.cc:1403] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:13:54.573920  3203 consensus_queue.cc:260] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.575853  3202 raft_consensus.cc:359] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.576416  3203 ts_tablet_manager.cc:1434] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:13:54.576514  3202 raft_consensus.cc:385] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.576959  3202 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.577757  3203 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.577716  3202 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.582437  3202 ts_tablet_manager.cc:1434] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:54.583330  3202 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: Bootstrap starting.
I20260709 13:13:54.586707  3203 tablet_bootstrap.cc:654] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.587481  3224 raft_consensus.cc:493] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.587697  3201 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.588219  3201 ts_tablet_manager.cc:1403] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 13:13:54.588060  3224 raft_consensus.cc:515] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.590108  3202 tablet_bootstrap.cc:654] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.591008  3201 raft_consensus.cc:359] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.591686  3201 raft_consensus.cc:385] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.591950  3201 raft_consensus.cc:740] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.592072  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.592389  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.592963  3088 raft_consensus.cc:2393] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea18d7b298b64be9b83bdd3729115c19 in current term 1: Already voted for candidate 50b05c32044f49ca894ae6b2b427bad5 in this term.
I20260709 13:13:54.592703  3201 consensus_queue.cc:260] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.594777  2976 leader_election.cc:304] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea18d7b298b64be9b83bdd3729115c19; no voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:13:54.596092  3210 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.596314  3208 raft_consensus.cc:493] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.596884  3208 raft_consensus.cc:515] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.597455  3201 ts_tablet_manager.cc:1434] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:54.598397  3201 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.601651  3208 leader_election.cc:290] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.603263  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.603922  3201 tablet_bootstrap.cc:654] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.604046  3013 raft_consensus.cc:2393] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50b05c32044f49ca894ae6b2b427bad5 in current term 1: Already voted for candidate 15e3cee76749436eaed7b727fdb0191e in this term.
I20260709 13:13:54.612634  3224 leader_election.cc:290] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.615247  3201 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.615741  3201 ts_tablet_manager.cc:1403] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:13:54.615612  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.618101  3125 leader_election.cc:304] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5; no voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:54.618408  3201 raft_consensus.cc:359] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.619107  3201 raft_consensus.cc:385] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.619294  3208 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.619364  3201 raft_consensus.cc:740] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.620396  3201 consensus_queue.cc:260] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.625293  3201 ts_tablet_manager.cc:1434] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:13:54.626310  3201 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: Bootstrap starting.
I20260709 13:13:54.626235  3210 raft_consensus.cc:2749] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.628433  3208 raft_consensus.cc:2749] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.631816  3230 raft_consensus.cc:515] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.632856  3201 tablet_bootstrap.cc:654] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.635378  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
W20260709 13:13:54.637282  3128 leader_election.cc:343] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.639997  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:13:54.640733  3088 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.657105  3088 raft_consensus.cc:2468] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.657750  3230 leader_election.cc:290] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.660152  3125 leader_election.cc:304] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:54.661368  3230 raft_consensus.cc:2804] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.663041  3230 raft_consensus.cc:697] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:13:54.664922  3202 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: No bootstrap required, opened a new log
I20260709 13:13:54.664258  3230 consensus_queue.cc:237] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.665481  3202 ts_tablet_manager.cc:1403] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: Time spent bootstrapping tablet: real 0.082s	user 0.041s	sys 0.035s
I20260709 13:13:54.665485  3203 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.666299  3203 ts_tablet_manager.cc:1403] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.020s
I20260709 13:13:54.668694  3202 raft_consensus.cc:359] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.668962  3203 raft_consensus.cc:359] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.669486  3202 raft_consensus.cc:385] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.669677  3203 raft_consensus.cc:385] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.669853  3202 raft_consensus.cc:740] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.670027  3203 raft_consensus.cc:740] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.670704  3202 consensus_queue.cc:260] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.670917  3203 consensus_queue.cc:260] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.673695  3203 ts_tablet_manager.cc:1434] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:13:54.674721  3203 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:13:54.680171  3201 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: No bootstrap required, opened a new log
I20260709 13:13:54.680737  3201 ts_tablet_manager.cc:1403] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.028s
I20260709 13:13:54.682349  3203 tablet_bootstrap.cc:654] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.686142  3202 ts_tablet_manager.cc:1434] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:13:54.683648  3201 raft_consensus.cc:359] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.687533  3201 raft_consensus.cc:385] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.687911  3201 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.689164  3201 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.689148  2910 catalog_manager.cc:5697] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.692108  3201 ts_tablet_manager.cc:1434] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:54.693638  3203 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: No bootstrap required, opened a new log
I20260709 13:13:54.694164  3203 ts_tablet_manager.cc:1403] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:13:54.696045  3203 raft_consensus.cc:359] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.696552  3203 raft_consensus.cc:385] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.696823  3203 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.697552  3203 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.699498  3203 ts_tablet_manager.cc:1434] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:54.703979  3230 raft_consensus.cc:493] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.704573  3230 raft_consensus.cc:515] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.707406  3230 leader_election.cc:290] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.707587  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19abe1355e446a9b9a676d766b0de46" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.707998  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19abe1355e446a9b9a676d766b0de46" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.708209  3013 raft_consensus.cc:2468] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.708714  3088 raft_consensus.cc:2468] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.709573  3128 leader_election.cc:304] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.710515  3230 raft_consensus.cc:2804] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.710872  3230 raft_consensus.cc:493] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.711205  3230 raft_consensus.cc:3060] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.712285  3219 raft_consensus.cc:493] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.712800  3219 raft_consensus.cc:515] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.714562  3219 leader_election.cc:290] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.715291  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.715927  3013 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.716014  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.716745  3162 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.716998  3054 leader_election.cc:304] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.717554  3230 raft_consensus.cc:515] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.718515  3219 raft_consensus.cc:2804] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.718998  3219 raft_consensus.cc:493] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.719328  3219 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.719527  3230 leader_election.cc:290] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.720466  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19abe1355e446a9b9a676d766b0de46" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.720976  3013 raft_consensus.cc:3060] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.720731  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19abe1355e446a9b9a676d766b0de46" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:13:54.721545  3088 raft_consensus.cc:3060] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.725845  3013 raft_consensus.cc:2468] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.726984  3128 leader_election.cc:304] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.727664  3230 raft_consensus.cc:2804] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.727383  3219 raft_consensus.cc:515] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.728199  3230 raft_consensus.cc:697] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:13:54.728886  3230 consensus_queue.cc:237] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.729207  3088 raft_consensus.cc:2468] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.731276  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.731925  3013 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.732950  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:54.733639  3162 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.734980  3219 leader_election.cc:290] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.737363  2909 catalog_manager.cc:5697] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.739801  3013 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.741099  3054 leader_election.cc:304] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.741976  3219 raft_consensus.cc:2804] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.742229  3162 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.742578  3219 raft_consensus.cc:697] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:54.743393  3219 consensus_queue.cc:237] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.747161  3219 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.747608  3219 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.749675  3219 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.749974  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.750283  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.751178  3162 raft_consensus.cc:2393] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15e3cee76749436eaed7b727fdb0191e in current term 1: Already voted for candidate ea18d7b298b64be9b83bdd3729115c19 in this term.
I20260709 13:13:54.752079  3053 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e; no voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:54.752731  3219 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.752693  2909 catalog_manager.cc:5697] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 0 to 1, leader changed from <none> to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 1 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.756067  3206 raft_consensus.cc:493] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.756613  3206 raft_consensus.cc:515] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.758258  3219 raft_consensus.cc:2749] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.758823  3206 leader_election.cc:290] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.759600  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.760313  3013 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.760515  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.761252  3162 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 0.
I20260709 13:13:54.761505  3054 leader_election.cc:304] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.762588  3206 raft_consensus.cc:2804] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.762907  3206 raft_consensus.cc:493] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.763202  3206 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.768257  3206 raft_consensus.cc:515] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.769987  3206 leader_election.cc:290] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.770793  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.771067  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:54.771456  3013 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.771663  3162 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.778616  3013 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.778616  3162 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:54.779929  3054 leader_election.cc:304] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.780767  3206 raft_consensus.cc:2804] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.781286  3206 raft_consensus.cc:697] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:54.782037  3206 consensus_queue.cc:237] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.789330  2909 catalog_manager.cc:5697] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 0 to 1, leader changed from <none> to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 1 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.792991  3206 consensus_queue.cc:1048] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.795315  3230 raft_consensus.cc:493] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.795845  3230 raft_consensus.cc:515] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.798009  3230 leader_election.cc:290] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.799077  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19" is_pre_election: true
I20260709 13:13:54.799784  3013 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.800993  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.801669  3088 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 0.
I20260709 13:13:54.801679  3128 leader_election.cc:304] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.802968  3206 consensus_queue.cc:1048] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.805137  3230 raft_consensus.cc:2804] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.805630  3230 raft_consensus.cc:493] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.806087  3230 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.820492  3230 raft_consensus.cc:515] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.824733  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:13:54.825287  3013 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.825655  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:13:54.826356  3088 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.834151  3088 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.833907  3208 consensus_queue.cc:1048] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.834662  3230 leader_election.cc:290] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:54.836822  3219 consensus_queue.cc:1048] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.837625  3125 leader_election.cc:304] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: 
I20260709 13:13:54.838963  3208 raft_consensus.cc:2804] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.839452  3208 raft_consensus.cc:697] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:13:54.840272  3208 consensus_queue.cc:237] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.840902  3013 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 1.
I20260709 13:13:54.856267  2909 catalog_manager.cc:5697] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.866963  3231 consensus_queue.cc:1048] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.876129  3208 consensus_queue.cc:1048] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.888060  3210 consensus_queue.cc:1048] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.902387  3224 consensus_queue.cc:1048] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.908910  3273 raft_consensus.cc:493] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.909471  3273 raft_consensus.cc:515] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.912035  3273 leader_election.cc:290] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.914009  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.914935  3087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.915738  3087 raft_consensus.cc:2393] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea18d7b298b64be9b83bdd3729115c19 in current term 1: Already voted for candidate 50b05c32044f49ca894ae6b2b427bad5 in this term.
I20260709 13:13:54.917194  2976 leader_election.cc:304] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea18d7b298b64be9b83bdd3729115c19; no voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:13:54.918468  3210 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.927575  3210 raft_consensus.cc:2749] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.976553  3210 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.977185  3210 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.978996  3210 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.979926  3087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:54.980031  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:54.980572  3087 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 0.
I20260709 13:13:54.980657  3161 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 0.
I20260709 13:13:54.981742  2978 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:54.982426  3210 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.982802  3210 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.983088  3210 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.988204  3210 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:54.989914  3210 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 election: Requested vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:54.990710  3087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:13:54.990929  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "ea18d7b298b64be9b83bdd3729115c19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:54.991362  3087 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.991451  3161 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.998870  3161 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 1.
I20260709 13:13:54.998874  3087 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea18d7b298b64be9b83bdd3729115c19 in term 1.
I20260709 13:13:55.000177  2976 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:13:55.001070  3210 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.001562  3210 raft_consensus.cc:697] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 LEADER]: Becoming Leader. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Running, Role: LEADER
I20260709 13:13:55.002303  3210 consensus_queue.cc:237] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:55.009438  2910 catalog_manager.cc:5697] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "ea18d7b298b64be9b83bdd3729115c19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.125538  3266 consensus_queue.cc:1048] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.136092  3230 consensus_queue.cc:1048] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.179484  3231 consensus_queue.cc:1048] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.193974  3206 consensus_queue.cc:1048] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.249053  3230 consensus_queue.cc:1048] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.255584  3230 consensus_queue.cc:1048] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.263007  3230 consensus_queue.cc:1048] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.267354  3206 consensus_queue.cc:1048] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.279999 26038 ts_manager.cc:295] Set tserver state for ea18d7b298b64be9b83bdd3729115c19 to MAINTENANCE_MODE
I20260709 13:13:55.280889 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
I20260709 13:13:55.283416  3266 consensus_queue.cc:1048] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:55.286597  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:55.320813  3128 consensus_peers.cc:597] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.324683  3054 consensus_peers.cc:597] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.331457 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:55.332192 26038 tablet_replica.cc:333] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.332774 26038 raft_consensus.cc:2243] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.333244 26038 raft_consensus.cc:2272] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.335577 26038 tablet_replica.cc:333] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.336155 26038 raft_consensus.cc:2243] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.336540 26038 raft_consensus.cc:2272] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.338716 26038 tablet_replica.cc:333] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.339422 26038 raft_consensus.cc:2243] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.339928 26038 raft_consensus.cc:2272] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.342891 26038 tablet_replica.cc:333] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.343556 26038 raft_consensus.cc:2243] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.343942 26038 raft_consensus.cc:2272] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.345589 26038 tablet_replica.cc:333] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.346177 26038 raft_consensus.cc:2243] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.346586 26038 raft_consensus.cc:2272] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.348635 26038 tablet_replica.cc:333] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.349164 26038 raft_consensus.cc:2243] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.349731 26038 pending_rounds.cc:70] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Trying to abort 1 pending ops.
I20260709 13:13:55.349929 26038 pending_rounds.cc:77] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637212176183296 op_type: NO_OP noop_request { }
I20260709 13:13:55.350289 26038 raft_consensus.cc:2889] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:55.350564 26038 raft_consensus.cc:2272] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.352698 26038 tablet_replica.cc:333] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.353216 26038 raft_consensus.cc:2243] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.353615 26038 raft_consensus.cc:2272] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.355772 26038 tablet_replica.cc:333] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.356285 26038 raft_consensus.cc:2243] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.356688 26038 raft_consensus.cc:2272] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.358759 26038 tablet_replica.cc:333] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.359253 26038 raft_consensus.cc:2243] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.359649 26038 raft_consensus.cc:2272] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.361701 26038 tablet_replica.cc:333] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: stopping tablet replica
I20260709 13:13:55.362236 26038 raft_consensus.cc:2243] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.362972 26038 raft_consensus.cc:2272] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.385334 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
W20260709 13:13:55.437894  3054 consensus_peers.cc:597] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.502290  3128 consensus_peers.cc:597] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.644960  3054 consensus_peers.cc:597] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.693176  3128 consensus_peers.cc:597] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.710866  3054 consensus_peers.cc:597] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.721274  3128 consensus_peers.cc:597] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:56.288023  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:56.418735  3231 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea18d7b298b64be9b83bdd3729115c19)
I20260709 13:13:56.419617  3231 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.420821  3268 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea18d7b298b64be9b83bdd3729115c19)
I20260709 13:13:56.421687  3268 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.422501  3231 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:56.423774  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:56.424670  3161 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:56.424278  3268 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:13:56.426551  3053 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: 
I20260709 13:13:56.427111  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15e3cee76749436eaed7b727fdb0191e" is_pre_election: true
I20260709 13:13:56.427512  3231 raft_consensus.cc:2804] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:56.427824  3054 leader_election.cc:336] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111)
I20260709 13:13:56.428009  3231 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea18d7b298b64be9b83bdd3729115c19)
I20260709 13:13:56.428406  3231 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:56.428633  3128 leader_election.cc:336] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111)
I20260709 13:13:56.435709  3231 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.436673  3088 raft_consensus.cc:2393] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 50b05c32044f49ca894ae6b2b427bad5 in current term 2: Already voted for candidate 15e3cee76749436eaed7b727fdb0191e in this term.
I20260709 13:13:56.437644  3231 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:56.439301  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:56.439962  3161 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:56.442216  3054 leader_election.cc:336] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111)
I20260709 13:13:56.442365  3125 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5; no voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:56.447098  3161 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:13:56.447594  3268 raft_consensus.cc:2749] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:56.448340  3053 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:56.449187  3231 raft_consensus.cc:2804] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.449757  3231 raft_consensus.cc:697] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:56.451251  3231 consensus_queue.cc:237] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.460207  2908 catalog_manager.cc:5697] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 1 to 2, leader changed from ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 2 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:56.600972  3128 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111) [suppressed 121 similar messages]
I20260709 13:13:56.663143  3231 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.663796  3231 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.665752  3231 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:56.666873  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5" is_pre_election: true
I20260709 13:13:56.667728  3161 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 1.
I20260709 13:13:56.668725  3053 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: 
I20260709 13:13:56.669538  3231 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:56.669616  3054 leader_election.cc:336] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111)
I20260709 13:13:56.669922  3231 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.670312  3231 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.678062  3231 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.679940  3231 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:13:56.681077  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:13:56.681717  3161 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:56.683487  3054 leader_election.cc:336] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111)
I20260709 13:13:56.687134  3161 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:13:56.688089  3053 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, 50b05c32044f49ca894ae6b2b427bad5; no voters: ea18d7b298b64be9b83bdd3729115c19
I20260709 13:13:56.688707  3231 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:56.689132  3231 raft_consensus.cc:697] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:13:56.690030  3231 consensus_queue.cc:237] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:13:56.697592  2908 catalog_manager.cc:5697] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 1 to 2, leader changed from ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 2 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.992679  3161 raft_consensus.cc:1275] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:56.994360  3231 consensus_queue.cc:1048] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:57.008423  3054 consensus_peers.cc:597] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:57.098796  3054 consensus_peers.cc:597] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:57.111610  3161 raft_consensus.cc:1275] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:57.112921  3219 consensus_queue.cc:1048] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:57.289198  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:57.603259  3128 consensus_peers.cc:597] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:57.817332  3054 consensus_peers.cc:597] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:57.940618  3054 consensus_peers.cc:597] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:57.955263  3128 consensus_peers.cc:597] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:58.024454  3128 consensus_peers.cc:597] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:58.101259  3054 consensus_peers.cc:597] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:58.260165  3128 consensus_peers.cc:597] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:58.290174  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:58.328421  3054 consensus_peers.cc:597] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:59.291266  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:59.463034  3054 consensus_peers.cc:597] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:59.526558  3054 consensus_peers.cc:597] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:00.007588  3128 consensus_peers.cc:597] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:00.026832  3128 consensus_peers.cc:597] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:00.241164  3054 consensus_peers.cc:597] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:14:00.292193  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:00.404537 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:00.414944  3303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:00.415953  3304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:00.420887 26038 server_base.cc:1061] running on GCE node
W20260709 13:14:00.421741  3306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:00.422789 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:00.423120 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:00.423309 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602840423291 us; error 0 us; skew 500 ppm
I20260709 13:14:00.423906 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:00.426657 26038 webserver.cc:533] Webserver started at http://127.25.109.129:41843/ using document root <none> and password file <none>
I20260709 13:14:00.427181 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:00.427385 26038 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:14:00.431205 26038 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:14:00.435300  3311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:00.436102 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:14:00.436498 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "ea18d7b298b64be9b83bdd3729115c19"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-zhdc"
I20260709 13:14:00.437021 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:00.458293 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:00.459566 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:00.461283 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:00.465049  3318 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:14:00.516885 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:14:00.517212 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:14:00.517558 26038 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:14:00.522984  3318 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.536741  3318 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.537520  3318 tablet_bootstrap.cc:492] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.538173  3318 ts_tablet_manager.cc:1403] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.004s
I20260709 13:14:00.540442  3318 raft_consensus.cc:359] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.540977  3318 raft_consensus.cc:740] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.541637  3318 consensus_queue.cc:260] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.543985  3318 ts_tablet_manager.cc:1434] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:14:00.544685  3318 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.557624 26038 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:14:00.558106 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.041s	sys 0.000s
I20260709 13:14:00.558490  3318 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:14:00.558827  3054 consensus_peers.cc:597] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:14:00.559638  3318 tablet_bootstrap.cc:492] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.560282  3318 ts_tablet_manager.cc:1403] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:14:00.562577  3318 raft_consensus.cc:359] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.563256  3318 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.563845  3318 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.565364  3318 ts_tablet_manager.cc:1434] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:14:00.566148  3318 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.581934  3318 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.582922  3318 tablet_bootstrap.cc:492] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.583518  3318 ts_tablet_manager.cc:1403] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:14:00.585655  3318 raft_consensus.cc:359] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.586457  3318 raft_consensus.cc:740] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.587248  3318 consensus_queue.cc:260] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.588874  3318 ts_tablet_manager.cc:1434] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:00.589514  3318 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.605906  3318 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.606777  3318 tablet_bootstrap.cc:492] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.607301  3318 ts_tablet_manager.cc:1403] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:14:00.609416  3318 raft_consensus.cc:359] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.609961  3318 raft_consensus.cc:740] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.610661  3318 consensus_queue.cc:260] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.612080  3318 ts_tablet_manager.cc:1434] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:00.612869  3318 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.625918  3318 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.627185  3318 tablet_bootstrap.cc:492] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.628430  3318 ts_tablet_manager.cc:1403] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:14:00.631348  3318 raft_consensus.cc:359] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.631901  3318 raft_consensus.cc:740] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.632645  3318 consensus_queue.cc:260] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.634265  3318 ts_tablet_manager.cc:1434] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:00.634929  3318 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.635746 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:34499
I20260709 13:14:00.635881  3380 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:34499 every 8 connection(s)
I20260709 13:14:00.642426 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:00.648775  3382 tablet.cc:2406] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:00.680270  3318 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.681483  3318 tablet_bootstrap.cc:492] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.682147  3318 ts_tablet_manager.cc:1403] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.020s
I20260709 13:14:00.684612  3318 raft_consensus.cc:359] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.685493  3318 raft_consensus.cc:740] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.686255  3318 consensus_queue.cc:260] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.688279  3318 ts_tablet_manager.cc:1434] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:00.689059  3318 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.694597  3088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:00.695449  3088 raft_consensus.cc:606] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:00.699481  3088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:00.700062  3088 raft_consensus.cc:606] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:00.701215 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:00.701886 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:00.702869 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:00.709247  3318 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.710250  3318 tablet_bootstrap.cc:492] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.710960  3318 ts_tablet_manager.cc:1403] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 13:14:00.712642  3381 heartbeater.cc:344] Connected to a master server at 127.25.109.190:33193
I20260709 13:14:00.713080  3381 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:00.713325  3318 raft_consensus.cc:359] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.713810  3318 raft_consensus.cc:740] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.713843  3381 heartbeater.cc:507] Master 127.25.109.190:33193 requested a full tablet report, sending...
I20260709 13:14:00.714434  3318 consensus_queue.cc:260] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.716295  3318 ts_tablet_manager.cc:1434] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:14:00.717064  3318 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.721063  2908 ts_manager.cc:194] Re-registered known tserver with Master: ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499)
I20260709 13:14:00.728992  3318 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.729112  2908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37738
I20260709 13:14:00.729889  3318 tablet_bootstrap.cc:492] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.730450  3318 ts_tablet_manager.cc:1403] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:14:00.732710  3381 heartbeater.cc:499] Master 127.25.109.190:33193 was elected leader, sending a full tablet report...
I20260709 13:14:00.733062  3318 raft_consensus.cc:359] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.733726  3318 raft_consensus.cc:740] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.734426  3318 consensus_queue.cc:260] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.736199  3318 ts_tablet_manager.cc:1434] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:00.736994  3318 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.749029  3318 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.749781  3318 tablet_bootstrap.cc:492] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.750412  3318 ts_tablet_manager.cc:1403] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:14:00.752358  3318 raft_consensus.cc:359] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.752868  3318 raft_consensus.cc:740] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.753535  3318 consensus_queue.cc:260] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.755573  3318 ts_tablet_manager.cc:1434] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:00.756390  3318 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap starting.
I20260709 13:14:00.767742  3318 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:00.768371  3318 tablet_bootstrap.cc:492] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Bootstrap complete.
I20260709 13:14:00.768867  3318 ts_tablet_manager.cc:1403] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:14:00.770880  3318 raft_consensus.cc:359] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.771360  3318 raft_consensus.cc:740] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea18d7b298b64be9b83bdd3729115c19, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.772082  3318 consensus_queue.cc:260] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:00.773844  3318 ts_tablet_manager.cc:1434] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:00.775425  3354 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.784081  3354 pending_rounds.cc:85] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Aborting all ops after (but not including) 0
I20260709 13:14:00.784358  3354 pending_rounds.cc:107] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:14:00.784695  3354 raft_consensus.cc:2889] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:01.118451  3354 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.167227  3396 raft_consensus.cc:993] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:01.167699  3396 raft_consensus.cc:1081] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:01.169827  3161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:01.170475  3161 raft_consensus.cc:493] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.170828  3161 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.178112  3161 raft_consensus.cc:515] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.180101  3161 leader_election.cc:290] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:14:01.181222  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:01.181663  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9263a47dce1c4c9d9f605cc784309307" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:01.182030  3088 raft_consensus.cc:3055] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.182370  3354 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.182516  3088 raft_consensus.cc:740] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:01.183468  3088 consensus_queue.cc:260] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.184576  3088 raft_consensus.cc:3060] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.188246  3354 raft_consensus.cc:2468] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:01.191321  3128 leader_election.cc:304] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:01.192631  3400 raft_consensus.cc:2804] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.193207  3400 raft_consensus.cc:697] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:01.193347  3088 raft_consensus.cc:2468] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:01.195058  3400 consensus_queue.cc:237] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.202526  2908 catalog_manager.cc:5697] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 1 to 2, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.227310  3396 raft_consensus.cc:993] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:01.227875  3302 raft_consensus.cc:1081] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:01.229323  3161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:01.229851  3161 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.230186  3161 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.235134  3161 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.236761  3161 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 3 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:14:01.237592  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:01.237808  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:01.238298  3354 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.238454  3088 raft_consensus.cc:3055] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:01.238871  3088 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:01.239584  3088 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.240520  3088 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.243290  3354 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 3.
I20260709 13:14:01.244280  3128 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:01.244992  3400 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:01.245479  3400 raft_consensus.cc:697] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:01.246191  3088 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 3.
I20260709 13:14:01.246515  3400 consensus_queue.cc:237] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:01.253165  2908 catalog_manager.cc:5697] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 2 to 3, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:01.293299  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:01.629673  3088 raft_consensus.cc:1275] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:01.630976  3400 consensus_queue.cc:1048] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.641044  3354 raft_consensus.cc:1275] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:01.642961  3301 consensus_queue.cc:1048] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.713837 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:01.731469  3161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
mode: GRACEFUL
new_leader_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:14:01.732028  3161 raft_consensus.cc:606] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Received request to transfer leadership to TS 15e3cee76749436eaed7b727fdb0191e
I20260709 13:14:01.734551  3161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
mode: GRACEFUL
new_leader_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:14:01.735018  3161 raft_consensus.cc:606] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Received request to transfer leadership to TS 15e3cee76749436eaed7b727fdb0191e
I20260709 13:14:01.735958 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:01.736548 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:01.737217 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:01.785894  3088 raft_consensus.cc:1275] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.787178  3301 consensus_queue.cc:1048] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.795874  3354 raft_consensus.cc:1275] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.797292  3301 consensus_queue.cc:1048] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.040452  3400 raft_consensus.cc:993] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: : Instructing follower 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:02.040881  3301 raft_consensus.cc:1081] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Signalling peer 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:02.042380  3088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:42442
I20260709 13:14:02.042868  3088 raft_consensus.cc:493] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.043187  3088 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.048167  3088 raft_consensus.cc:515] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.050042  3088 leader_election.cc:290] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 4 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:14:02.051273  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:14:02.051584  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4c22f2f57044d4a892b39996ec19078" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:02.052027  3162 raft_consensus.cc:3055] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:02.052165  3354 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.052410  3162 raft_consensus.cc:740] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:02.053364  3162 consensus_queue.cc:260] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.054698  3162 raft_consensus.cc:3060] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.059731  3354 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 4.
I20260709 13:14:02.060966  3054 leader_election.cc:304] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:02.061659  3396 raft_consensus.cc:2804] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:02.062148  3396 raft_consensus.cc:697] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 4 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:02.062341  3162 raft_consensus.cc:2468] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 4.
I20260709 13:14:02.062930  3396 consensus_queue.cc:237] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.069196  2910 catalog_manager.cc:5697] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 3 to 4, leader changed from 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 4 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.213857  3400 raft_consensus.cc:993] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: : Instructing follower 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:02.214309  3301 raft_consensus.cc:1081] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Signalling peer 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:02.215695  3088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:42442
I20260709 13:14:02.216096  3088 raft_consensus.cc:493] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.216341  3088 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.220736  3088 raft_consensus.cc:515] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.222029  3088 leader_election.cc:290] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:14:02.222906  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:02.223244  3162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823e2db013344e21ba2dc9cd21d16c7e" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:14:02.223575  3354 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.223898  3162 raft_consensus.cc:3055] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:02.224229  3162 raft_consensus.cc:740] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:02.225005  3162 consensus_queue.cc:260] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.225982  3162 raft_consensus.cc:3060] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.229315  3354 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:02.230564  3054 leader_election.cc:304] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:02.231613  3396 raft_consensus.cc:2804] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:02.232295  3396 raft_consensus.cc:697] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:02.232915  3162 raft_consensus.cc:2468] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:02.233126  3396 consensus_queue.cc:237] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.240067  2910 catalog_manager.cc:5697] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 1 to 2, leader changed from 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 2 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:02.294204  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:02.532457  3162 raft_consensus.cc:1275] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 4 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.533739  3396 consensus_queue.cc:1048] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:02.545008  3354 raft_consensus.cc:1275] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 4 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.546517  3396 consensus_queue.cc:1048] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:02.693841  3162 raft_consensus.cc:1275] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.695245  3396 consensus_queue.cc:1048] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.706238  3354 raft_consensus.cc:1275] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.707542  3396 consensus_queue.cc:1048] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.744722 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:02.752120  3088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:02.752561  3088 raft_consensus.cc:606] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:02.754962  3088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:02.755334  3088 raft_consensus.cc:606] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:02.756322 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:02.756737 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:02.757226 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:02.888733  3408 raft_consensus.cc:993] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:02.889299  3396 raft_consensus.cc:1081] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:02.890775  3162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:02.891266  3162 raft_consensus.cc:493] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.891577  3162 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.896944  3162 raft_consensus.cc:515] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.898662  3162 leader_election.cc:290] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 3 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:14:02.899525  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:02.899616  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1620e5f9ee74d90b8513075b0c7fdfd" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:02.900225  3354 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.900254  3088 raft_consensus.cc:3055] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:02.901005  3088 raft_consensus.cc:740] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:02.901678  3088 consensus_queue.cc:260] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.902566  3088 raft_consensus.cc:3060] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.905649  3354 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 3.
I20260709 13:14:02.906783  3128 leader_election.cc:304] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:02.907507  3088 raft_consensus.cc:2468] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 3.
I20260709 13:14:02.907615  3301 raft_consensus.cc:2804] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:02.908773  3301 raft_consensus.cc:697] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:02.909698  3301 consensus_queue.cc:237] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:02.915952  2908 catalog_manager.cc:5697] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 2 to 3, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:03.075762  3408 raft_consensus.cc:993] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:03.076227  3396 raft_consensus.cc:1081] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:03.077615  3162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:03.078105  3162 raft_consensus.cc:493] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.078372  3162 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.083524  3162 raft_consensus.cc:515] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:03.085278  3162 leader_election.cc:290] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Requested vote from peers 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283), ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499)
I20260709 13:14:03.085927  3088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:03.086565  3088 raft_consensus.cc:3055] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.086532  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc23729582c347e19c2daa1902f63b0f" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:03.086992  3088 raft_consensus.cc:740] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:03.087219  3354 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.087787  3088 consensus_queue.cc:260] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:03.088721  3088 raft_consensus.cc:3060] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.092343  3354 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:03.093072  3088 raft_consensus.cc:2468] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:03.093443  3128 leader_election.cc:304] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:03.094451  3301 raft_consensus.cc:2804] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.094862  3301 raft_consensus.cc:697] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:03.095625  3301 consensus_queue.cc:237] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:03.102530  2908 catalog_manager.cc:5697] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 1 to 2, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:03.295194  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:03.371694  3354 raft_consensus.cc:1275] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.373157  3301 consensus_queue.cc:1048] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.384361  3087 raft_consensus.cc:1275] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.385952  3428 consensus_queue.cc:1048] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.482566  3087 raft_consensus.cc:1275] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.483778  3428 consensus_queue.cc:1048] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.493335  3354 raft_consensus.cc:1275] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.495177  3441 consensus_queue.cc:1048] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:03.763298 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:03.770207  3162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
mode: GRACEFUL
new_leader_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:14:03.770856  3162 raft_consensus.cc:606] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Received request to transfer leadership to TS 15e3cee76749436eaed7b727fdb0191e
I20260709 13:14:03.773401  3162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
mode: GRACEFUL
new_leader_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:14:03.773877  3162 raft_consensus.cc:606] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Received request to transfer leadership to TS 15e3cee76749436eaed7b727fdb0191e
I20260709 13:14:03.775034 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:03.775568 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:03.776124 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:04.296077  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:04.302901  3441 raft_consensus.cc:993] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: : Instructing follower 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:04.303431  3301 raft_consensus.cc:1081] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Signalling peer 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:04.304827  3087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:42442
I20260709 13:14:04.305315  3087 raft_consensus.cc:493] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.305627  3087 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.311569  3087 raft_consensus.cc:515] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.313076  3087 leader_election.cc:290] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:14:04.314114  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:04.314225  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b029ee8ebb64d3b97e3fde0d63807a4" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:14:04.314764  3354 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.314813  3161 raft_consensus.cc:3055] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.315253  3161 raft_consensus.cc:740] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:04.315862  3161 consensus_queue.cc:260] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.316746  3161 raft_consensus.cc:3060] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.319410  3354 raft_consensus.cc:2468] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:04.320426  3054 leader_election.cc:304] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:04.321092  3396 raft_consensus.cc:2804] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.321178  3161 raft_consensus.cc:2468] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:04.321552  3396 raft_consensus.cc:697] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:04.322512  3396 consensus_queue.cc:237] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.330658  2910 catalog_manager.cc:5697] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 1 to 2, leader changed from 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 2 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.387926  3441 raft_consensus.cc:993] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: : Instructing follower 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:04.388474  3301 raft_consensus.cc:1081] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Signalling peer 15e3cee76749436eaed7b727fdb0191e to start an election
I20260709 13:14:04.389755  3087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
 from {username='slave'} at 127.0.0.1:42442
I20260709 13:14:04.390280  3087 raft_consensus.cc:493] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.390601  3087 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.396224  3087 raft_consensus.cc:515] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.397944  3087 leader_election.cc:290] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131:40231)
I20260709 13:14:04.398670  3354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:04.398950  3161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835b87eabc214c0d96b339bc3b0873b5" candidate_uuid: "15e3cee76749436eaed7b727fdb0191e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
I20260709 13:14:04.399250  3354 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.399567  3161 raft_consensus.cc:3055] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.399847  3161 raft_consensus.cc:740] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:04.400538  3161 consensus_queue.cc:260] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.401312  3161 raft_consensus.cc:3060] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.404770  3354 raft_consensus.cc:2468] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:04.406276  3054 leader_election.cc:304] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15e3cee76749436eaed7b727fdb0191e, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:04.406915  3161 raft_consensus.cc:2468] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15e3cee76749436eaed7b727fdb0191e in term 2.
I20260709 13:14:04.407105  3396 raft_consensus.cc:2804] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.407596  3396 raft_consensus.cc:697] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Becoming Leader. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:04.408694  3396 consensus_queue.cc:237] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.416941  2910 catalog_manager.cc:5697] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e reported cstate change: term changed from 1 to 2, leader changed from 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131) to 15e3cee76749436eaed7b727fdb0191e (127.25.109.130). New cstate: current_term: 2 leader_uuid: "15e3cee76749436eaed7b727fdb0191e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:04.721702  3354 raft_consensus.cc:1275] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.723048  3396 consensus_queue.cc:1048] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.733026  3161 raft_consensus.cc:1275] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.734992  3452 consensus_queue.cc:1048] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.782523 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:04.789856  3087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242bdcaead5743108241e9798f270337"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:04.790501  3087 raft_consensus.cc:606] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:04.793071  3087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5718cd028729404689ba3efa810621d5"
dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
mode: GRACEFUL
new_leader_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:34696
I20260709 13:14:04.793607  3087 raft_consensus.cc:606] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Received request to transfer leadership to TS 50b05c32044f49ca894ae6b2b427bad5
I20260709 13:14:04.794828 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:04.795364 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:04.795959 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:04.880669  3396 raft_consensus.cc:993] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:04.881263  3443 raft_consensus.cc:1081] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:04.882746  3161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5718cd028729404689ba3efa810621d5"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:04.883155  3161 raft_consensus.cc:493] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:04.883374  3161 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.887852  3161 raft_consensus.cc:515] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.889428  3161 leader_election.cc:290] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:14:04.890571  3087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:04.890849  3355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5718cd028729404689ba3efa810621d5" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:04.891376  3087 raft_consensus.cc:3055] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:04.891450  3355 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.891884  3087 raft_consensus.cc:740] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:04.892274  3354 raft_consensus.cc:1275] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.892807  3087 consensus_queue.cc:260] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.894356  3443 consensus_queue.cc:1048] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.894387  3087 raft_consensus.cc:3060] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:04.900054  3355 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:04.901409  3128 leader_election.cc:304] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:04.902612  3301 raft_consensus.cc:2804] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:04.905205  3087 raft_consensus.cc:2468] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:04.906495  3161 raft_consensus.cc:1275] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Refusing update from remote peer 15e3cee76749436eaed7b727fdb0191e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:04.909075  3301 raft_consensus.cc:697] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:04.910898  3396 consensus_queue.cc:1048] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.911273  3301 consensus_queue.cc:237] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:04.936934  2908 catalog_manager.cc:5697] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 1 to 2, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.204192  3452 raft_consensus.cc:993] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: : Instructing follower 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:05.204800  3459 raft_consensus.cc:1081] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Signalling peer 50b05c32044f49ca894ae6b2b427bad5 to start an election
I20260709 13:14:05.206197  3161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "242bdcaead5743108241e9798f270337"
dest_uuid: "50b05c32044f49ca894ae6b2b427bad5"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:14:05.206642  3161 raft_consensus.cc:493] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.206954  3161 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.211428  3161 raft_consensus.cc:515] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:05.212939  3161 leader_election.cc:290] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Requested vote from peers ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499), 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283)
I20260709 13:14:05.213681  3355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea18d7b298b64be9b83bdd3729115c19"
I20260709 13:14:05.213966  3087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242bdcaead5743108241e9798f270337" candidate_uuid: "50b05c32044f49ca894ae6b2b427bad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15e3cee76749436eaed7b727fdb0191e"
I20260709 13:14:05.214265  3355 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.214605  3087 raft_consensus.cc:3055] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.214920  3087 raft_consensus.cc:740] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15e3cee76749436eaed7b727fdb0191e, State: Running, Role: LEADER
I20260709 13:14:05.215610  3087 consensus_queue.cc:260] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:05.216579  3087 raft_consensus.cc:3060] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.219368  3355 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:05.220386  3128 leader_election.cc:304] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b05c32044f49ca894ae6b2b427bad5, ea18d7b298b64be9b83bdd3729115c19; no voters: 
I20260709 13:14:05.221232  3460 raft_consensus.cc:2804] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.221626  3460 raft_consensus.cc:697] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Becoming Leader. State: Replica: 50b05c32044f49ca894ae6b2b427bad5, State: Running, Role: LEADER
I20260709 13:14:05.221745  3087 raft_consensus.cc:2468] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b05c32044f49ca894ae6b2b427bad5 in term 2.
I20260709 13:14:05.222533  3460 consensus_queue.cc:237] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } }
I20260709 13:14:05.229635  2908 catalog_manager.cc:5697] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 reported cstate change: term changed from 1 to 2, leader changed from 15e3cee76749436eaed7b727fdb0191e (127.25.109.130) to 50b05c32044f49ca894ae6b2b427bad5 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "50b05c32044f49ca894ae6b2b427bad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b05c32044f49ca894ae6b2b427bad5" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 40231 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:05.297001  2959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:14:05.297724  3355 raft_consensus.cc:1275] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.299160  3458 consensus_queue.cc:1048] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:05.311251  3087 raft_consensus.cc:1275] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.312552  3460 consensus_queue.cc:1048] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.614329  3087 raft_consensus.cc:1275] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.615468  3460 consensus_queue.cc:1048] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15e3cee76749436eaed7b727fdb0191e" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.624850  3355 raft_consensus.cc:1275] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Refusing update from remote peer 50b05c32044f49ca894ae6b2b427bad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:05.626183  3460 consensus_queue.cc:1048] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea18d7b298b64be9b83bdd3729115c19" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 34499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.803792 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:05.863694 26038 tablet_server.cc:179] TabletServer@127.25.109.129:34499 shutting down...
W20260709 13:14:05.896694  3054 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 83 similar messages]
I20260709 13:14:05.899405 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:05.900902 26038 tablet_replica.cc:333] stopping tablet replica
W20260709 13:14:05.901654  3054 consensus_peers.cc:597] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.902803 26038 raft_consensus.cc:2243] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.903811 26038 raft_consensus.cc:2272] T 823e2db013344e21ba2dc9cd21d16c7e P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.909010 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.910250 26038 raft_consensus.cc:2243] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:05.910386  3128 consensus_peers.cc:597] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:05.911075 26038 raft_consensus.cc:2272] T 242bdcaead5743108241e9798f270337 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.914850 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.915689 26038 raft_consensus.cc:2243] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.916180 26038 raft_consensus.cc:2272] T b19abe1355e446a9b9a676d766b0de46 P ea18d7b298b64be9b83bdd3729115c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.919183 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.920228 26038 raft_consensus.cc:2243] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.920883 26038 raft_consensus.cc:2272] T 9263a47dce1c4c9d9f605cc784309307 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.924352 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.924830 26038 raft_consensus.cc:2243] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.925386 26038 raft_consensus.cc:2272] T a1620e5f9ee74d90b8513075b0c7fdfd P ea18d7b298b64be9b83bdd3729115c19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.929375 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.929948 26038 raft_consensus.cc:2243] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.930763 26038 raft_consensus.cc:2272] T 5718cd028729404689ba3efa810621d5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.934317 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.934888 26038 raft_consensus.cc:2243] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.935384 26038 raft_consensus.cc:2272] T bc23729582c347e19c2daa1902f63b0f P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.937814 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.938387 26038 raft_consensus.cc:2243] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.939035 26038 raft_consensus.cc:2272] T a4c22f2f57044d4a892b39996ec19078 P ea18d7b298b64be9b83bdd3729115c19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.941545 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.941978 26038 raft_consensus.cc:2243] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.942529 26038 raft_consensus.cc:2272] T 835b87eabc214c0d96b339bc3b0873b5 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.944795 26038 tablet_replica.cc:333] stopping tablet replica
I20260709 13:14:05.945277 26038 raft_consensus.cc:2243] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.945752 26038 raft_consensus.cc:2272] T 0b029ee8ebb64d3b97e3fde0d63807a4 P ea18d7b298b64be9b83bdd3729115c19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.980722 26038 tablet_server.cc:196] TabletServer@127.25.109.129:34499 shutdown complete.
W20260709 13:14:06.009302  3128 consensus_peers.cc:597] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.017488 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:14:06.041419  3128 consensus_peers.cc:597] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.043666 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:06.044476 26038 tablet_replica.cc:333] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.045303 26038 raft_consensus.cc:2243] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.046388 26038 raft_consensus.cc:2272] T 823e2db013344e21ba2dc9cd21d16c7e P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.048970 26038 tablet_replica.cc:333] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.049592 26038 raft_consensus.cc:2243] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.050249 26038 raft_consensus.cc:2272] T 242bdcaead5743108241e9798f270337 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.053498 26038 tablet_replica.cc:333] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.054272 26038 raft_consensus.cc:2243] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.054826 26038 raft_consensus.cc:2272] T b19abe1355e446a9b9a676d766b0de46 P 15e3cee76749436eaed7b727fdb0191e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.057282 26038 tablet_replica.cc:333] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.057822 26038 raft_consensus.cc:2243] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.058339 26038 raft_consensus.cc:2272] T a1620e5f9ee74d90b8513075b0c7fdfd P 15e3cee76749436eaed7b727fdb0191e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.060642 26038 tablet_replica.cc:333] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.061213 26038 raft_consensus.cc:2243] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.062420 26038 raft_consensus.cc:2272] T 835b87eabc214c0d96b339bc3b0873b5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.064848 26038 tablet_replica.cc:333] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.065475 26038 raft_consensus.cc:2243] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.066666 26038 raft_consensus.cc:2272] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.070475 26038 tablet_replica.cc:333] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.071393 26038 raft_consensus.cc:2243] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.073594 26038 raft_consensus.cc:2272] T a4c22f2f57044d4a892b39996ec19078 P 15e3cee76749436eaed7b727fdb0191e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.076793 26038 tablet_replica.cc:333] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.077334 26038 raft_consensus.cc:2243] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.077939 26038 raft_consensus.cc:2272] T 5718cd028729404689ba3efa810621d5 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.080770 26038 tablet_replica.cc:333] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.081233 26038 raft_consensus.cc:2243] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.081684 26038 raft_consensus.cc:2272] T bc23729582c347e19c2daa1902f63b0f P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.084076 26038 tablet_replica.cc:333] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e: stopping tablet replica
I20260709 13:14:06.084477 26038 raft_consensus.cc:2243] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.084980 26038 raft_consensus.cc:2272] T 9263a47dce1c4c9d9f605cc784309307 P 15e3cee76749436eaed7b727fdb0191e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:06.102828  3125 consensus_peers.cc:597] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer 15e3cee76749436eaed7b727fdb0191e (127.25.109.130:34283): Couldn't send request to peer 15e3cee76749436eaed7b727fdb0191e. Status: Network error: recv got EOF from 127.25.109.130:34283 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:06.102977 26038 connection.cc:466] server connection from 127.0.0.1:42442 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42442 (request call id 139) could send its response
I20260709 13:14:06.120294 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
I20260709 13:14:06.148257 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
W20260709 13:14:06.165485  3128 consensus_peers.cc:597] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 -> Peer ea18d7b298b64be9b83bdd3729115c19 (127.25.109.129:34499): Couldn't send request to peer ea18d7b298b64be9b83bdd3729115c19. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:34499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.177975 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:06.178951 26038 tablet_replica.cc:333] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.179762 26038 raft_consensus.cc:2243] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.180351 26038 raft_consensus.cc:2272] T 823e2db013344e21ba2dc9cd21d16c7e P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.182896 26038 tablet_replica.cc:333] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.183496 26038 raft_consensus.cc:2243] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.184429 26038 raft_consensus.cc:2272] T 242bdcaead5743108241e9798f270337 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.187991 26038 tablet_replica.cc:333] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.188555 26038 raft_consensus.cc:2243] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.189631 26038 raft_consensus.cc:2272] T b19abe1355e446a9b9a676d766b0de46 P 50b05c32044f49ca894ae6b2b427bad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.191977 26038 tablet_replica.cc:333] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.192538 26038 raft_consensus.cc:2243] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.193512 26038 raft_consensus.cc:2272] T a1620e5f9ee74d90b8513075b0c7fdfd P 50b05c32044f49ca894ae6b2b427bad5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.195746 26038 tablet_replica.cc:333] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.196283 26038 raft_consensus.cc:2243] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.197255 26038 raft_consensus.cc:2272] T 9263a47dce1c4c9d9f605cc784309307 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.199692 26038 tablet_replica.cc:333] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.200234 26038 raft_consensus.cc:2243] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.200775 26038 raft_consensus.cc:2272] T a4c22f2f57044d4a892b39996ec19078 P 50b05c32044f49ca894ae6b2b427bad5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.203003 26038 tablet_replica.cc:333] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.203486 26038 raft_consensus.cc:2243] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.204377 26038 raft_consensus.cc:2272] T 5718cd028729404689ba3efa810621d5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.208072 26038 tablet_replica.cc:333] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.208636 26038 raft_consensus.cc:2243] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.209589 26038 raft_consensus.cc:2272] T bc23729582c347e19c2daa1902f63b0f P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.211768 26038 tablet_replica.cc:333] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.212260 26038 raft_consensus.cc:2243] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.212805 26038 raft_consensus.cc:2272] T 835b87eabc214c0d96b339bc3b0873b5 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.214968 26038 tablet_replica.cc:333] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5: stopping tablet replica
I20260709 13:14:06.215463 26038 raft_consensus.cc:2243] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:06.216006 26038 raft_consensus.cc:2272] T 0b029ee8ebb64d3b97e3fde0d63807a4 P 50b05c32044f49ca894ae6b2b427bad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.249022 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:14:06.275748 26038 master.cc:562] Master@127.25.109.190:33193 shutting down...
I20260709 13:14:06.298979 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:06.299606 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:06.299913 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4e96e087a4e341bfb7ec3dc8917e6b5e: stopping tablet replica
I20260709 13:14:06.320591 26038 master.cc:584] Master@127.25.109.190:33193 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13224 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:14:06.366703 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:43581
I20260709 13:14:06.367884 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:06.373600  3479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.373764  3478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.374955  3481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:06.376267 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:06.377104 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:06.377321 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:06.377477 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602846377460 us; error 0 us; skew 500 ppm
I20260709 13:14:06.378010 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:06.380398 26038 webserver.cc:533] Webserver started at http://127.25.109.190:39685/ using document root <none> and password file <none>
I20260709 13:14:06.380913 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:06.381153 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:06.381429 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:06.382676 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "a7a50f94b20a4245a909b10103a6e506"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.387182 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:14:06.390758  3486 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.391732 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:14:06.391994 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "a7a50f94b20a4245a909b10103a6e506"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.392249 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:06.441187 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:06.442667 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:06.485617 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:43581
I20260709 13:14:06.485740  3537 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:43581 every 8 connection(s)
I20260709 13:14:06.490027  3538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:06.502516  3538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506: Bootstrap starting.
I20260709 13:14:06.507473  3538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:06.511687  3538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506: No bootstrap required, opened a new log
I20260709 13:14:06.513896  3538 raft_consensus.cc:359] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER }
I20260709 13:14:06.514377  3538 raft_consensus.cc:385] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:06.514616  3538 raft_consensus.cc:740] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7a50f94b20a4245a909b10103a6e506, State: Initialized, Role: FOLLOWER
I20260709 13:14:06.515213  3538 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER }
I20260709 13:14:06.515692  3538 raft_consensus.cc:399] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:06.515928  3538 raft_consensus.cc:493] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:06.516211  3538 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:06.520957  3538 raft_consensus.cc:515] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER }
I20260709 13:14:06.521473  3538 leader_election.cc:304] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7a50f94b20a4245a909b10103a6e506; no voters: 
I20260709 13:14:06.522580  3538 leader_election.cc:290] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:06.522998  3541 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:06.524376  3541 raft_consensus.cc:697] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 1 LEADER]: Becoming Leader. State: Replica: a7a50f94b20a4245a909b10103a6e506, State: Running, Role: LEADER
I20260709 13:14:06.525100  3541 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER }
I20260709 13:14:06.525494  3538 sys_catalog.cc:565] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:06.528098  3542 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7a50f94b20a4245a909b10103a6e506" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER } }
I20260709 13:14:06.528895  3542 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:06.528098  3543 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7a50f94b20a4245a909b10103a6e506. Latest consensus state: current_term: 1 leader_uuid: "a7a50f94b20a4245a909b10103a6e506" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7a50f94b20a4245a909b10103a6e506" member_type: VOTER } }
I20260709 13:14:06.529513  3543 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:06.532557  3547 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:06.540392  3547 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:06.541375 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:06.549081  3547 catalog_manager.cc:1383] Generated new cluster ID: cad6e256cf2a40a5b33b07b6b53edc81
I20260709 13:14:06.549358  3547 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:06.571233  3547 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:06.572567  3547 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:06.588734  3547 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506: Generated new TSK 0
I20260709 13:14:06.589382  3547 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:06.607753 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:06.613898  3559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.614825  3560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.616355  3562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:06.616586 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:06.617529 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:06.617713 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:06.617835 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602846617824 us; error 0 us; skew 500 ppm
I20260709 13:14:06.618394 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:06.620599 26038 webserver.cc:533] Webserver started at http://127.25.109.129:32999/ using document root <none> and password file <none>
I20260709 13:14:06.621011 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:06.621160 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:06.621372 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:06.622568 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "4649df7fee7d48ed889e11f2d8d59791"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.627019 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:14:06.630406  3567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.631166 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:06.631445 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "4649df7fee7d48ed889e11f2d8d59791"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.631683 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:06.644857 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:06.646309 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:06.647825 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:06.650450 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:06.650681 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.650969 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:06.651163 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.694190 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:42691
I20260709 13:14:06.694404  3629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:42691 every 8 connection(s)
I20260709 13:14:06.699221 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:06.707289  3634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.708804  3635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.713162  3637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:06.713598 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:06.714808 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:06.714816  3630 heartbeater.cc:344] Connected to a master server at 127.25.109.190:43581
W20260709 13:14:06.715176 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:06.715332  3630 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:06.715382 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602846715364 us; error 0 us; skew 500 ppm
I20260709 13:14:06.716380 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:06.716394  3630 heartbeater.cc:507] Master 127.25.109.190:43581 requested a full tablet report, sending...
I20260709 13:14:06.718977  3503 ts_manager.cc:194] Registered new tserver with Master: 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691)
I20260709 13:14:06.719408 26038 webserver.cc:533] Webserver started at http://127.25.109.130:35161/ using document root <none> and password file <none>
I20260709 13:14:06.719960 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:06.720149 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:06.720432 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:06.721174  3503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36940
I20260709 13:14:06.721618 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.726802 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:14:06.730170  3642 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.731000 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:06.731283 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.731554 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:06.750452 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:06.751679 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:06.753108 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:06.755488 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:06.755705 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.755960 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:06.756131 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.795774 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:34963
I20260709 13:14:06.795881  3704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:34963 every 8 connection(s)
I20260709 13:14:06.800760 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:06.808175  3708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:06.816478  3709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:06.816844  3705 heartbeater.cc:344] Connected to a master server at 127.25.109.190:43581
I20260709 13:14:06.817464  3705 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:06.818709  3705 heartbeater.cc:507] Master 127.25.109.190:43581 requested a full tablet report, sending...
I20260709 13:14:06.819419 26038 server_base.cc:1061] running on GCE node
W20260709 13:14:06.820235  3711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:06.821130  3503 ts_manager.cc:194] Registered new tserver with Master: cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963)
I20260709 13:14:06.821206 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:06.821491 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:06.821615 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602846821603 us; error 0 us; skew 500 ppm
I20260709 13:14:06.822232 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:06.822705  3503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36956
I20260709 13:14:06.824993 26038 webserver.cc:533] Webserver started at http://127.25.109.131:43707/ using document root <none> and password file <none>
I20260709 13:14:06.825559 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:06.825762 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:06.826026 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:06.827346 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "c1696a89225944da806cac63f29842e3"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.831604 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:06.834885  3716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.835644 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:06.835934 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "c1696a89225944da806cac63f29842e3"
format_stamp: "Formatted at 2026-07-09 13:14:06 on dist-test-slave-zhdc"
I20260709 13:14:06.836217 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:06.850643 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:06.851965 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:06.853536 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:06.856001 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:06.856251 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.856529 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:06.856729 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:06.900415 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:46421
I20260709 13:14:06.900535  3778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:46421 every 8 connection(s)
I20260709 13:14:06.915627  3779 heartbeater.cc:344] Connected to a master server at 127.25.109.190:43581
I20260709 13:14:06.916131  3779 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:06.916884  3779 heartbeater.cc:507] Master 127.25.109.190:43581 requested a full tablet report, sending...
I20260709 13:14:06.918882  3503 ts_manager.cc:194] Registered new tserver with Master: c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:06.919744 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015535882s
I20260709 13:14:06.920469  3503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36960
I20260709 13:14:06.945693  3503 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36976:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:06.948009  3503 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:06.987464  3744 tablet_service.cc:1511] Processing CreateTablet for tablet 4b926ddbc9d047f191216b6ae28face4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:06.988932  3744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b926ddbc9d047f191216b6ae28face4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:06.991050  3743 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd1f793ff0942e381d35a34ebc8320f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:06.994019  3743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd1f793ff0942e381d35a34ebc8320f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.001696  3670 tablet_service.cc:1511] Processing CreateTablet for tablet 4b926ddbc9d047f191216b6ae28face4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:07.002159  3669 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd1f793ff0942e381d35a34ebc8320f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:07.003249  3670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b926ddbc9d047f191216b6ae28face4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.003904  3669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd1f793ff0942e381d35a34ebc8320f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.014683  3595 tablet_service.cc:1511] Processing CreateTablet for tablet 4b926ddbc9d047f191216b6ae28face4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:07.016135  3595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b926ddbc9d047f191216b6ae28face4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.019271  3594 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd1f793ff0942e381d35a34ebc8320f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5b9b14f55f414dddb6ecde1e5b8bd33f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:07.020576  3594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd1f793ff0942e381d35a34ebc8320f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.036191  3793 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: Bootstrap starting.
I20260709 13:14:07.043568  3795 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: Bootstrap starting.
I20260709 13:14:07.044687  3793 tablet_bootstrap.cc:654] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.048262  3794 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: Bootstrap starting.
I20260709 13:14:07.051054  3795 tablet_bootstrap.cc:654] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.055910  3793 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: No bootstrap required, opened a new log
I20260709 13:14:07.056107  3795 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: No bootstrap required, opened a new log
I20260709 13:14:07.056392  3793 ts_tablet_manager.cc:1403] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:14:07.056649  3795 ts_tablet_manager.cc:1403] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:14:07.057415  3794 tablet_bootstrap.cc:654] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.058971  3793 raft_consensus.cc:359] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.059574  3793 raft_consensus.cc:385] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.059816  3793 raft_consensus.cc:740] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.059949  3795 raft_consensus.cc:359] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.060539  3793 consensus_queue.cc:260] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.060925  3795 raft_consensus.cc:385] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.061421  3795 raft_consensus.cc:740] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.062181  3795 consensus_queue.cc:260] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.063145  3705 heartbeater.cc:499] Master 127.25.109.190:43581 was elected leader, sending a full tablet report...
I20260709 13:14:07.063705  3793 ts_tablet_manager.cc:1434] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:07.063915  3794 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: No bootstrap required, opened a new log
I20260709 13:14:07.064709  3794 ts_tablet_manager.cc:1403] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 13:14:07.064656  3793 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: Bootstrap starting.
I20260709 13:14:07.068423  3794 raft_consensus.cc:359] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.069538  3794 raft_consensus.cc:385] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.069980  3794 raft_consensus.cc:740] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1696a89225944da806cac63f29842e3, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.071165  3794 consensus_queue.cc:260] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.072367  3630 heartbeater.cc:499] Master 127.25.109.190:43581 was elected leader, sending a full tablet report...
I20260709 13:14:07.073333  3793 tablet_bootstrap.cc:654] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.073449  3795 ts_tablet_manager.cc:1434] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:14:07.074589  3795 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: Bootstrap starting.
I20260709 13:14:07.082726  3779 heartbeater.cc:499] Master 127.25.109.190:43581 was elected leader, sending a full tablet report...
I20260709 13:14:07.083904  3794 ts_tablet_manager.cc:1434] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:14:07.085064  3794 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: Bootstrap starting.
I20260709 13:14:07.085397  3795 tablet_bootstrap.cc:654] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.094913  3794 tablet_bootstrap.cc:654] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.096081  3793 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: No bootstrap required, opened a new log
I20260709 13:14:07.096690  3793 ts_tablet_manager.cc:1403] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.016s
I20260709 13:14:07.099740  3793 raft_consensus.cc:359] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.100454  3793 raft_consensus.cc:385] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.100747  3793 raft_consensus.cc:740] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.101505  3793 consensus_queue.cc:260] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.104256  3795 tablet_bootstrap.cc:492] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: No bootstrap required, opened a new log
I20260709 13:14:07.104852  3795 ts_tablet_manager.cc:1403] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.013s
I20260709 13:14:07.105317  3794 tablet_bootstrap.cc:492] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: No bootstrap required, opened a new log
I20260709 13:14:07.105898  3794 ts_tablet_manager.cc:1403] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:14:07.108879  3794 raft_consensus.cc:359] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.109639  3794 raft_consensus.cc:385] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.109993  3794 raft_consensus.cc:740] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1696a89225944da806cac63f29842e3, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.110116  3795 raft_consensus.cc:359] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.110895  3795 raft_consensus.cc:385] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.111068  3794 consensus_queue.cc:260] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.111732  3795 raft_consensus.cc:740] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.112516  3795 consensus_queue.cc:260] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.115789  3794 ts_tablet_manager.cc:1434] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:07.120908  3795 ts_tablet_manager.cc:1434] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:14:07.121253  3793 ts_tablet_manager.cc:1434] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: Time spent starting tablet: real 0.024s	user 0.017s	sys 0.009s
I20260709 13:14:07.121955  3800 raft_consensus.cc:493] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.122495  3800 raft_consensus.cc:515] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.125455  3800 leader_election.cc:290] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1696a89225944da806cac63f29842e3 (127.25.109.131:46421), cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963)
I20260709 13:14:07.131675  3805 raft_consensus.cc:493] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.132172  3805 raft_consensus.cc:515] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.137369  3805 leader_election.cc:290] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.139580  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b926ddbc9d047f191216b6ae28face4" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3" is_pre_election: true
I20260709 13:14:07.140439  3754 raft_consensus.cc:2468] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 0.
I20260709 13:14:07.142737  3569 leader_election.cc:304] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, c1696a89225944da806cac63f29842e3; no voters: 
I20260709 13:14:07.143654  3800 raft_consensus.cc:2804] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:07.144032  3800 raft_consensus.cc:493] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.144368  3800 raft_consensus.cc:3060] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.147634  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791" is_pre_election: true
I20260709 13:14:07.148406  3605 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.149796  3643 leader_election.cc:304] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.149896  3680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b926ddbc9d047f191216b6ae28face4" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" is_pre_election: true
I20260709 13:14:07.150631  3680 raft_consensus.cc:2468] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 0.
I20260709 13:14:07.150786  3805 raft_consensus.cc:2804] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:07.151194  3805 raft_consensus.cc:493] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.151216  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3" is_pre_election: true
I20260709 13:14:07.152386  3805 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.152894  3754 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.156620  3800 raft_consensus.cc:515] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.158454  3800 leader_election.cc:290] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 1 election: Requested vote from peers c1696a89225944da806cac63f29842e3 (127.25.109.131:46421), cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963)
I20260709 13:14:07.158317  3805 raft_consensus.cc:515] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.159193  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b926ddbc9d047f191216b6ae28face4" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.159804  3754 raft_consensus.cc:3060] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.160050  3680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b926ddbc9d047f191216b6ae28face4" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
I20260709 13:14:07.160610  3680 raft_consensus.cc:3060] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.160823  3805 leader_election.cc:290] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.161168  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
I20260709 13:14:07.162019  3605 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.167001  3753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.166249  3680 raft_consensus.cc:2468] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 1.
I20260709 13:14:07.167585  3753 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.167599  3754 raft_consensus.cc:2468] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 1.
I20260709 13:14:07.168788  3568 leader_election.cc:304] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.169842  3605 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.170037  3800 raft_consensus.cc:2804] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:07.170990  3643 leader_election.cc:304] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.171627  3800 raft_consensus.cc:697] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 1 LEADER]: Becoming Leader. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Running, Role: LEADER
I20260709 13:14:07.171839  3805 raft_consensus.cc:2804] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:07.172406  3805 raft_consensus.cc:697] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Leader. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.172595  3800 consensus_queue.cc:237] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } }
I20260709 13:14:07.173142  3805 consensus_queue.cc:237] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.176445  3753 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.181579  3501 catalog_manager.cc:5697] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "4649df7fee7d48ed889e11f2d8d59791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.181622  3500 catalog_manager.cc:5697] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.260465  3500 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36982:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:07.262454  3500 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:07.284682  3594 tablet_service.cc:1511] Processing CreateTablet for tablet 718ab7bf3cf843b3a9e755861774850b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:07.286016  3594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718ab7bf3cf843b3a9e755861774850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.286114  3670 tablet_service.cc:1511] Processing CreateTablet for tablet 718ab7bf3cf843b3a9e755861774850b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:07.287690  3670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718ab7bf3cf843b3a9e755861774850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.287667  3744 tablet_service.cc:1511] Processing CreateTablet for tablet 718ab7bf3cf843b3a9e755861774850b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:14:07.288930  3744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 718ab7bf3cf843b3a9e755861774850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.289556  3595 tablet_service.cc:1511] Processing CreateTablet for tablet b6836b18ab07471dafb8e240a47462ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:07.290793  3595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6836b18ab07471dafb8e240a47462ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.291761  3669 tablet_service.cc:1511] Processing CreateTablet for tablet b6836b18ab07471dafb8e240a47462ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:07.292976  3669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6836b18ab07471dafb8e240a47462ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.305786  3793 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Bootstrap starting.
I20260709 13:14:07.307626  3743 tablet_service.cc:1511] Processing CreateTablet for tablet b6836b18ab07471dafb8e240a47462ca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f8d396b6ee6948448ae96ab38c81c857]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:14:07.308948  3743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6836b18ab07471dafb8e240a47462ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.310181  3794 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: Bootstrap starting.
I20260709 13:14:07.312407  3793 tablet_bootstrap.cc:654] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.316823  3794 tablet_bootstrap.cc:654] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.328787  3795 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: Bootstrap starting.
I20260709 13:14:07.328899  3793 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: No bootstrap required, opened a new log
I20260709 13:14:07.329653  3793 ts_tablet_manager.cc:1403] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:14:07.330828  3794 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: No bootstrap required, opened a new log
I20260709 13:14:07.331398  3794 ts_tablet_manager.cc:1403] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:14:07.332548  3793 raft_consensus.cc:359] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.333344  3793 raft_consensus.cc:385] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.333660  3793 raft_consensus.cc:740] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.334596  3794 raft_consensus.cc:359] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.334844  3793 consensus_queue.cc:260] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.335481  3794 raft_consensus.cc:385] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.335837  3794 raft_consensus.cc:740] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1696a89225944da806cac63f29842e3, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.336630  3795 tablet_bootstrap.cc:654] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.337234  3793 ts_tablet_manager.cc:1434] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:07.336632  3794 consensus_queue.cc:260] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.340104  3793 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: Bootstrap starting.
I20260709 13:14:07.340274  3794 ts_tablet_manager.cc:1434] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:07.341586  3794 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: Bootstrap starting.
I20260709 13:14:07.350754  3794 tablet_bootstrap.cc:654] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.357059  3793 tablet_bootstrap.cc:654] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.357440  3794 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: No bootstrap required, opened a new log
I20260709 13:14:07.357921  3794 ts_tablet_manager.cc:1403] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:14:07.358188  3795 tablet_bootstrap.cc:492] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: No bootstrap required, opened a new log
I20260709 13:14:07.358729  3795 ts_tablet_manager.cc:1403] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.013s
I20260709 13:14:07.360272  3794 raft_consensus.cc:359] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.361101  3794 raft_consensus.cc:385] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.361384  3794 raft_consensus.cc:740] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1696a89225944da806cac63f29842e3, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.361848  3795 raft_consensus.cc:359] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.362128  3794 consensus_queue.cc:260] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.362628  3793 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: No bootstrap required, opened a new log
I20260709 13:14:07.362645  3795 raft_consensus.cc:385] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.363184  3795 raft_consensus.cc:740] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.363282  3793 ts_tablet_manager.cc:1403] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:14:07.364297  3794 ts_tablet_manager.cc:1434] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:14:07.365084  3795 consensus_queue.cc:260] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.367507  3795 ts_tablet_manager.cc:1434] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:14:07.368492  3795 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: Bootstrap starting.
I20260709 13:14:07.369344  3793 raft_consensus.cc:359] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.370102  3793 raft_consensus.cc:385] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.370376  3793 raft_consensus.cc:740] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.371212  3793 consensus_queue.cc:260] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.375723  3795 tablet_bootstrap.cc:654] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:07.376310  3793 ts_tablet_manager.cc:1434] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:07.381232  3795 tablet_bootstrap.cc:492] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: No bootstrap required, opened a new log
I20260709 13:14:07.381807  3795 ts_tablet_manager.cc:1403] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:14:07.384690  3795 raft_consensus.cc:359] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.385445  3795 raft_consensus.cc:385] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:07.385735  3795 raft_consensus.cc:740] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Initialized, Role: FOLLOWER
I20260709 13:14:07.386514  3795 consensus_queue.cc:260] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.388141  3795 ts_tablet_manager.cc:1434] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:14:07.423053  3805 raft_consensus.cc:493] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.423722  3805 raft_consensus.cc:515] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.425361  3805 leader_election.cc:290] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.426236  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791" is_pre_election: true
I20260709 13:14:07.426452  3753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3" is_pre_election: true
I20260709 13:14:07.426848  3605 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.427225  3753 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.427906  3643 leader_election.cc:304] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.428761  3805 raft_consensus.cc:2804] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:07.429091  3805 raft_consensus.cc:493] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.429375  3805 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.434908  3805 raft_consensus.cc:515] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.436474  3805 leader_election.cc:290] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.437264  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
I20260709 13:14:07.437450  3753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.437863  3605 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.438153  3753 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.443333  3605 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.443656  3753 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.444406  3643 leader_election.cc:304] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.445421  3805 raft_consensus.cc:2804] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:07.445863  3805 raft_consensus.cc:697] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Leader. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.446518  3805 consensus_queue.cc:237] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.453603  3501 catalog_manager.cc:5697] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.517546  3805 raft_consensus.cc:493] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.518139  3805 raft_consensus.cc:515] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.519959  3805 leader_election.cc:290] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.520571  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791" is_pre_election: true
I20260709 13:14:07.520946  3753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3" is_pre_election: true
I20260709 13:14:07.521185  3605 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.521628  3753 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 0.
I20260709 13:14:07.522315  3643 leader_election.cc:304] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.523177  3805 raft_consensus.cc:2804] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:07.523471  3805 raft_consensus.cc:493] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.523741  3805 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.528594  3805 raft_consensus.cc:515] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.530272  3805 leader_election.cc:290] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Requested vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.530948  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
I20260709 13:14:07.531280  3753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.531572  3605 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:07.531862  3753 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:07.536137  3551 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:07.538715  3753 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.538715  3605 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 1.
I20260709 13:14:07.540349  3644 leader_election.cc:304] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1696a89225944da806cac63f29842e3, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.541102  3805 raft_consensus.cc:2804] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:07.541570  3805 raft_consensus.cc:697] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Leader. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.542256  3805 consensus_queue.cc:237] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.548822  3501 catalog_manager.cc:5697] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.577816  3680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f"
dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
mode: GRACEFUL
new_leader_uuid: "c1696a89225944da806cac63f29842e3"
 from {username='slave'} at 127.0.0.1:46062
I20260709 13:14:07.578472  3680 raft_consensus.cc:606] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Received request to transfer leadership to TS c1696a89225944da806cac63f29842e3
I20260709 13:14:07.583730  3680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b"
dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
mode: GRACEFUL
new_leader_uuid: "4649df7fee7d48ed889e11f2d8d59791"
 from {username='slave'} at 127.0.0.1:46062
I20260709 13:14:07.584210  3680 raft_consensus.cc:606] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Received request to transfer leadership to TS 4649df7fee7d48ed889e11f2d8d59791
I20260709 13:14:07.588814  3680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca"
dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
mode: GRACEFUL
new_leader_uuid: "4649df7fee7d48ed889e11f2d8d59791"
 from {username='slave'} at 127.0.0.1:46062
I20260709 13:14:07.589280  3680 raft_consensus.cc:606] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Received request to transfer leadership to TS 4649df7fee7d48ed889e11f2d8d59791
I20260709 13:14:07.614671  3805 consensus_queue.cc:1048] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.621778  3799 raft_consensus.cc:993] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: : Instructing follower c1696a89225944da806cac63f29842e3 to start an election
I20260709 13:14:07.622563  3805 raft_consensus.cc:1081] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Signalling peer c1696a89225944da806cac63f29842e3 to start an election
I20260709 13:14:07.627066  3754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f"
dest_uuid: "c1696a89225944da806cac63f29842e3"
 from {username='slave'} at 127.0.0.1:58276
I20260709 13:14:07.631392  3754 raft_consensus.cc:493] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:07.631803  3754 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.640509  3799 consensus_queue.cc:1048] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.641283  3754 raft_consensus.cc:515] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.652374  3754 leader_election.cc:290] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [CANDIDATE]: Term 2 election: Requested vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963)
I20260709 13:14:07.667644  3680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "c1696a89225944da806cac63f29842e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
I20260709 13:14:07.668291  3680 raft_consensus.cc:3055] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:07.668649  3680 raft_consensus.cc:740] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.669518  3680 consensus_queue.cc:260] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.670396  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd1f793ff0942e381d35a34ebc8320f" candidate_uuid: "c1696a89225944da806cac63f29842e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
I20260709 13:14:07.670835  3680 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.671016  3605 raft_consensus.cc:3060] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.678035  3680 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1696a89225944da806cac63f29842e3 in term 2.
I20260709 13:14:07.678035  3605 raft_consensus.cc:2468] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1696a89225944da806cac63f29842e3 in term 2.
I20260709 13:14:07.679512  3717 leader_election.cc:304] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1696a89225944da806cac63f29842e3, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:07.680371  3801 raft_consensus.cc:2804] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.681416  3801 raft_consensus.cc:697] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 2 LEADER]: Becoming Leader. State: Replica: c1696a89225944da806cac63f29842e3, State: Running, Role: LEADER
I20260709 13:14:07.682312  3801 consensus_queue.cc:237] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.689672  3500 catalog_manager.cc:5697] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 reported cstate change: term changed from 1 to 2, leader changed from cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130) to c1696a89225944da806cac63f29842e3 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "c1696a89225944da806cac63f29842e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.697659  3800 consensus_queue.cc:1048] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.710378  3800 consensus_queue.cc:1048] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:07.873191  3799 consensus_queue.cc:1048] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.883787  3826 consensus_queue.cc:1048] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.893162  3805 raft_consensus.cc:993] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: : Instructing follower 4649df7fee7d48ed889e11f2d8d59791 to start an election
I20260709 13:14:07.893628  3799 raft_consensus.cc:1081] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Signalling peer 4649df7fee7d48ed889e11f2d8d59791 to start an election
I20260709 13:14:07.895301  3605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b"
dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
 from {username='slave'} at 127.0.0.1:54236
I20260709 13:14:07.895879  3605 raft_consensus.cc:493] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:07.896289  3605 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.903286  3605 raft_consensus.cc:515] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.906039  3680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
I20260709 13:14:07.906177  3605 leader_election.cc:290] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 2 election: Requested vote from peers cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.906387  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.906675  3680 raft_consensus.cc:3055] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:07.907007  3754 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.907053  3680 raft_consensus.cc:740] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.908116  3680 consensus_queue.cc:260] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.909327  3680 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.914876  3754 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 2.
I20260709 13:14:07.916069  3569 leader_election.cc:304] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, c1696a89225944da806cac63f29842e3; no voters: 
I20260709 13:14:07.916344  3680 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 2.
I20260709 13:14:07.916955  3800 raft_consensus.cc:2804] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.917490  3800 raft_consensus.cc:697] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Becoming Leader. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Running, Role: LEADER
I20260709 13:14:07.918318  3800 consensus_queue.cc:237] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.924252  3499 catalog_manager.cc:5697] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 reported cstate change: term changed from 1 to 2, leader changed from cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130) to 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "4649df7fee7d48ed889e11f2d8d59791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.928355  3826 consensus_queue.cc:1048] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.939816  3799 consensus_queue.cc:1048] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:07.949607  3805 raft_consensus.cc:993] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: : Instructing follower 4649df7fee7d48ed889e11f2d8d59791 to start an election
I20260709 13:14:07.950044  3799 raft_consensus.cc:1081] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Signalling peer 4649df7fee7d48ed889e11f2d8d59791 to start an election
I20260709 13:14:07.951627  3605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca"
dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
 from {username='slave'} at 127.0.0.1:54236
I20260709 13:14:07.952220  3605 raft_consensus.cc:493] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:07.952617  3605 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.957432  3605 raft_consensus.cc:515] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.959627  3605 leader_election.cc:290] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 2 election: Requested vote from peers cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:07.960187  3680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
I20260709 13:14:07.960255  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6836b18ab07471dafb8e240a47462ca" candidate_uuid: "4649df7fee7d48ed889e11f2d8d59791" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:07.961302  3680 raft_consensus.cc:3055] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:07.961390  3754 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.961741  3680 raft_consensus.cc:740] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:07.962626  3680 consensus_queue.cc:260] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.963949  3680 raft_consensus.cc:3060] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:07.969255  3754 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 2.
I20260709 13:14:07.970571  3569 leader_election.cc:304] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, c1696a89225944da806cac63f29842e3; no voters: 
I20260709 13:14:07.970890  3680 raft_consensus.cc:2468] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4649df7fee7d48ed889e11f2d8d59791 in term 2.
I20260709 13:14:07.971305  3800 raft_consensus.cc:2804] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:07.971830  3800 raft_consensus.cc:697] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Becoming Leader. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Running, Role: LEADER
I20260709 13:14:07.972687  3800 consensus_queue.cc:237] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:07.978828  3501 catalog_manager.cc:5697] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 reported cstate change: term changed from 1 to 2, leader changed from cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130) to 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "4649df7fee7d48ed889e11f2d8d59791" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.064884 26038 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:14:08.066471 26038 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:14:08.066850 26038 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:14:08.078379  3605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b"
dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
mode: GRACEFUL
new_leader_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
 from {username='slave'} at 127.0.0.1:41266
I20260709 13:14:08.078867  3605 raft_consensus.cc:606] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Received request to transfer leadership to TS cd3f645580554e2b8ce5c9c446c93fc8
I20260709 13:14:08.079936 26038 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:14:08.113161  3605 raft_consensus.cc:1275] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Refusing update from remote peer c1696a89225944da806cac63f29842e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.114470  3801 consensus_queue.cc:1048] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.122644  3680 raft_consensus.cc:1275] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Refusing update from remote peer c1696a89225944da806cac63f29842e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.124228  3801 consensus_queue.cc:1048] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.338821  3754 raft_consensus.cc:1275] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Refusing update from remote peer 4649df7fee7d48ed889e11f2d8d59791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.340250  3845 consensus_queue.cc:1048] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.346601  3680 raft_consensus.cc:1275] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Refusing update from remote peer 4649df7fee7d48ed889e11f2d8d59791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.348030  3800 consensus_queue.cc:1048] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.354892  3800 raft_consensus.cc:993] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: : Instructing follower cd3f645580554e2b8ce5c9c446c93fc8 to start an election
I20260709 13:14:08.355438  3837 raft_consensus.cc:1081] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Signalling peer cd3f645580554e2b8ce5c9c446c93fc8 to start an election
I20260709 13:14:08.355460  3754 raft_consensus.cc:1275] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Refusing update from remote peer 4649df7fee7d48ed889e11f2d8d59791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.357167  3837 consensus_queue.cc:1048] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.357260  3680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b"
dest_uuid: "cd3f645580554e2b8ce5c9c446c93fc8"
 from {username='slave'} at 127.0.0.1:46050
I20260709 13:14:08.357963  3680 raft_consensus.cc:493] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:08.358366  3680 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.365636  3680 raft_consensus.cc:515] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:08.367341  3679 raft_consensus.cc:1275] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Refusing update from remote peer 4649df7fee7d48ed889e11f2d8d59791: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:08.368983  3800 consensus_queue.cc:1048] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.371765  3680 leader_election.cc:290] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 3 election: Requested vote from peers 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129:42691), c1696a89225944da806cac63f29842e3 (127.25.109.131:46421)
I20260709 13:14:08.372848  3605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4649df7fee7d48ed889e11f2d8d59791"
I20260709 13:14:08.373505  3605 raft_consensus.cc:3055] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:08.373826  3605 raft_consensus.cc:740] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4649df7fee7d48ed889e11f2d8d59791, State: Running, Role: LEADER
I20260709 13:14:08.374671  3605 consensus_queue.cc:260] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:08.375794  3605 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.377660  3754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "718ab7bf3cf843b3a9e755861774850b" candidate_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c1696a89225944da806cac63f29842e3"
I20260709 13:14:08.378290  3754 raft_consensus.cc:3060] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:08.382992  3605 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 3.
I20260709 13:14:08.384263  3643 leader_election.cc:304] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4649df7fee7d48ed889e11f2d8d59791, cd3f645580554e2b8ce5c9c446c93fc8; no voters: 
I20260709 13:14:08.385097  3799 raft_consensus.cc:2804] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:08.385272  3754 raft_consensus.cc:2468] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd3f645580554e2b8ce5c9c446c93fc8 in term 3.
I20260709 13:14:08.385581  3799 raft_consensus.cc:697] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 LEADER]: Becoming Leader. State: Replica: cd3f645580554e2b8ce5c9c446c93fc8, State: Running, Role: LEADER
I20260709 13:14:08.386547  3799 consensus_queue.cc:237] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } }
I20260709 13:14:08.392635  3499 catalog_manager.cc:5697] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 reported cstate change: term changed from 2 to 3, leader changed from 4649df7fee7d48ed889e11f2d8d59791 (127.25.109.129) to cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130). New cstate: current_term: 3 leader_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4649df7fee7d48ed889e11f2d8d59791" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 42691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd3f645580554e2b8ce5c9c446c93fc8" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 34963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1696a89225944da806cac63f29842e3" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46421 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.431605 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
I20260709 13:14:08.453370 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:08.454006 26038 tablet_replica.cc:333] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791: stopping tablet replica
I20260709 13:14:08.454618 26038 raft_consensus.cc:2243] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.455509 26038 raft_consensus.cc:2272] T b6836b18ab07471dafb8e240a47462ca P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.457705 26038 tablet_replica.cc:333] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791: stopping tablet replica
I20260709 13:14:08.458348 26038 raft_consensus.cc:2243] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.458771 26038 raft_consensus.cc:2272] T 718ab7bf3cf843b3a9e755861774850b P 4649df7fee7d48ed889e11f2d8d59791 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.461422 26038 tablet_replica.cc:333] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791: stopping tablet replica
I20260709 13:14:08.461936 26038 raft_consensus.cc:2243] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.462750 26038 raft_consensus.cc:2272] T 4b926ddbc9d047f191216b6ae28face4 P 4649df7fee7d48ed889e11f2d8d59791 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.464840 26038 tablet_replica.cc:333] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791: stopping tablet replica
I20260709 13:14:08.465332 26038 raft_consensus.cc:2243] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.465750 26038 raft_consensus.cc:2272] T 7fd1f793ff0942e381d35a34ebc8320f P 4649df7fee7d48ed889e11f2d8d59791 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.479207 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
I20260709 13:14:08.490952 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
I20260709 13:14:08.508121 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:08.508767 26038 tablet_replica.cc:333] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8: stopping tablet replica
I20260709 13:14:08.509334 26038 raft_consensus.cc:2243] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.509809 26038 raft_consensus.cc:2272] T b6836b18ab07471dafb8e240a47462ca P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.512110 26038 tablet_replica.cc:333] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: stopping tablet replica
I20260709 13:14:08.512660 26038 raft_consensus.cc:2243] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.513276 26038 pending_rounds.cc:70] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Trying to abort 1 pending ops.
I20260709 13:14:08.513474 26038 pending_rounds.cc:77] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637266998767616 op_type: NO_OP noop_request { }
I20260709 13:14:08.513774 26038 raft_consensus.cc:2889] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:14:08.514097 26038 raft_consensus.cc:2272] T 718ab7bf3cf843b3a9e755861774850b P cd3f645580554e2b8ce5c9c446c93fc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.516404 26038 tablet_replica.cc:333] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8: stopping tablet replica
I20260709 13:14:08.516897 26038 raft_consensus.cc:2243] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.517323 26038 raft_consensus.cc:2272] T 7fd1f793ff0942e381d35a34ebc8320f P cd3f645580554e2b8ce5c9c446c93fc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.519340 26038 tablet_replica.cc:333] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8: stopping tablet replica
I20260709 13:14:08.519811 26038 raft_consensus.cc:2243] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.520200 26038 raft_consensus.cc:2272] T 4b926ddbc9d047f191216b6ae28face4 P cd3f645580554e2b8ce5c9c446c93fc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.543316 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
W20260709 13:14:08.551115  3717 consensus_peers.cc:597] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 -> Peer cd3f645580554e2b8ce5c9c446c93fc8 (127.25.109.130:34963): Couldn't send request to peer cd3f645580554e2b8ce5c9c446c93fc8. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:34963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:08.557060 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
I20260709 13:14:08.576010 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:08.576660 26038 tablet_replica.cc:333] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3: stopping tablet replica
I20260709 13:14:08.577224 26038 raft_consensus.cc:2243] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.577716 26038 raft_consensus.cc:2272] T b6836b18ab07471dafb8e240a47462ca P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.580127 26038 tablet_replica.cc:333] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3: stopping tablet replica
I20260709 13:14:08.580659 26038 raft_consensus.cc:2243] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.581087 26038 raft_consensus.cc:2272] T 718ab7bf3cf843b3a9e755861774850b P c1696a89225944da806cac63f29842e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.583422 26038 tablet_replica.cc:333] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3: stopping tablet replica
I20260709 13:14:08.583930 26038 raft_consensus.cc:2243] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.584728 26038 raft_consensus.cc:2272] T 7fd1f793ff0942e381d35a34ebc8320f P c1696a89225944da806cac63f29842e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.587090 26038 tablet_replica.cc:333] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3: stopping tablet replica
I20260709 13:14:08.587565 26038 raft_consensus.cc:2243] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.587955 26038 raft_consensus.cc:2272] T 4b926ddbc9d047f191216b6ae28face4 P c1696a89225944da806cac63f29842e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.600885 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:14:08.612555 26038 master.cc:562] Master@127.25.109.190:43581 shutting down...
I20260709 13:14:08.628826 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:08.629396 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.629734 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P a7a50f94b20a4245a909b10103a6e506: stopping tablet replica
I20260709 13:14:08.648952 26038 master.cc:584] Master@127.25.109.190:43581 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2316 ms)
[----------] 6 tests from LeaderRebalancerTest (282513 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:14:08.683758 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:36929
I20260709 13:14:08.684820 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:08.689653  3849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:08.689774  3850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:08.691174  3852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:08.692577 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:08.693281 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:08.693454 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:08.693567 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602848693556 us; error 0 us; skew 500 ppm
I20260709 13:14:08.694000 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:08.696179 26038 webserver.cc:533] Webserver started at http://127.25.109.190:45363/ using document root <none> and password file <none>
I20260709 13:14:08.696609 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:08.696755 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:08.696955 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:08.698004 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "6bd21b9850e744609812a75dddec70fb"
format_stamp: "Formatted at 2026-07-09 13:14:08 on dist-test-slave-zhdc"
I20260709 13:14:08.702183 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:08.705226  3857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:08.705957 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:08.706297 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "6bd21b9850e744609812a75dddec70fb"
format_stamp: "Formatted at 2026-07-09 13:14:08 on dist-test-slave-zhdc"
I20260709 13:14:08.706591 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:08.736478 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:08.737532 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:08.772130 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:36929
I20260709 13:14:08.772250  3908 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:36929 every 8 connection(s)
I20260709 13:14:08.775866  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:08.786463  3909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: Bootstrap starting.
I20260709 13:14:08.790957  3909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:08.794950  3909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: No bootstrap required, opened a new log
I20260709 13:14:08.796972  3909 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER }
I20260709 13:14:08.797359  3909 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:08.797631  3909 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bd21b9850e744609812a75dddec70fb, State: Initialized, Role: FOLLOWER
I20260709 13:14:08.798256  3909 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER }
I20260709 13:14:08.798708  3909 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:08.798959  3909 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:08.799216  3909 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:08.803723  3909 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER }
I20260709 13:14:08.804235  3909 leader_election.cc:304] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bd21b9850e744609812a75dddec70fb; no voters: 
I20260709 13:14:08.805318  3909 leader_election.cc:290] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:08.805642  3912 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:08.807041  3912 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 1 LEADER]: Becoming Leader. State: Replica: 6bd21b9850e744609812a75dddec70fb, State: Running, Role: LEADER
I20260709 13:14:08.807687  3912 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER }
I20260709 13:14:08.808418  3909 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:08.812286  3914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bd21b9850e744609812a75dddec70fb. Latest consensus state: current_term: 1 leader_uuid: "6bd21b9850e744609812a75dddec70fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER } }
I20260709 13:14:08.812638  3913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bd21b9850e744609812a75dddec70fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd21b9850e744609812a75dddec70fb" member_type: VOTER } }
I20260709 13:14:08.812894  3914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:08.813313  3913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:08.815925  3918 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:08.821398  3918 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:08.824106 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:08.829874  3918 catalog_manager.cc:1383] Generated new cluster ID: 228be0fb39d849cb9955ee5f517d5716
I20260709 13:14:08.830216  3918 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:08.887676  3918 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:08.888942  3918 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:08.900729  3918 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: Generated new TSK 0
I20260709 13:14:08.901293  3918 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:08.955628 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:08.961434  3930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:08.962610  3931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:08.964304 26038 server_base.cc:1061] running on GCE node
W20260709 13:14:08.964373  3933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:08.965538 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:08.965724 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:08.965852 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602848965840 us; error 0 us; skew 500 ppm
I20260709 13:14:08.966385 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:08.968621 26038 webserver.cc:533] Webserver started at http://127.25.109.129:42351/ using document root <none> and password file <none>
I20260709 13:14:08.969086 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:08.969245 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:08.969458 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:08.970574 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
format_stamp: "Formatted at 2026-07-09 13:14:08 on dist-test-slave-zhdc"
I20260709 13:14:08.974916 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:14:08.978125  3938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:08.978891 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:08.979195 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
format_stamp: "Formatted at 2026-07-09 13:14:08 on dist-test-slave-zhdc"
I20260709 13:14:08.979465 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:08.997471 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:08.998687 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.000109 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.002295 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.002511 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.002759 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.002935 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.040486 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:40747
I20260709 13:14:09.040586  4000 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:40747 every 8 connection(s)
I20260709 13:14:09.045552 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.052352  4005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.053537  4006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.057587 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:09.058228  4001 heartbeater.cc:344] Connected to a master server at 127.25.109.190:36929
W20260709 13:14:09.058504  4008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.058696  4001 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.059428 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.059719 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.059693  4001 heartbeater.cc:507] Master 127.25.109.190:36929 requested a full tablet report, sending...
I20260709 13:14:09.060120 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602849060102 us; error 0 us; skew 500 ppm
I20260709 13:14:09.060914 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.062312  3874 ts_manager.cc:194] Registered new tserver with Master: 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
I20260709 13:14:09.063431 26038 webserver.cc:533] Webserver started at http://127.25.109.130:37563/ using document root <none> and password file <none>
I20260709 13:14:09.063964 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.064167 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.064278  3874 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33360
I20260709 13:14:09.064469 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.066000 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "f29b74c47bbe40f58154d9829aea26c5"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-zhdc"
I20260709 13:14:09.070528 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:09.073673  4013 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.074445 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:09.074756 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "f29b74c47bbe40f58154d9829aea26c5"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-zhdc"
I20260709 13:14:09.075043 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.092386 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.093403 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.094872 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.097095 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.097323 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.097563 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.097731 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.136816 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:42181
I20260709 13:14:09.136925  4075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:42181 every 8 connection(s)
I20260709 13:14:09.141712 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.147948  4079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.150286  4080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.150957  4082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.152518 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:09.153692 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:09.153986 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:09.154155  4076 heartbeater.cc:344] Connected to a master server at 127.25.109.190:36929
I20260709 13:14:09.154227 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602849154204 us; error 0 us; skew 500 ppm
I20260709 13:14:09.154654  4076 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.155052 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:09.155457  4076 heartbeater.cc:507] Master 127.25.109.190:36929 requested a full tablet report, sending...
I20260709 13:14:09.157855  3874 ts_manager.cc:194] Registered new tserver with Master: f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:09.157824 26038 webserver.cc:533] Webserver started at http://127.25.109.131:44911/ using document root <none> and password file <none>
I20260709 13:14:09.158957 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:09.159258 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:09.159482  3874 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33374
I20260709 13:14:09.159652 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:09.161442 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "034f0b95d3ba49eaa21942608f6e93d8"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-zhdc"
I20260709 13:14:09.167129 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:09.171370  4087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.172112 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:14:09.172417 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "034f0b95d3ba49eaa21942608f6e93d8"
format_stamp: "Formatted at 2026-07-09 13:14:09 on dist-test-slave-zhdc"
I20260709 13:14:09.172711 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:09.185807 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:09.186841 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:09.188179 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:09.190389 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:09.190610 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.190845 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:09.191030 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:09.228893 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:46085
I20260709 13:14:09.229043  4149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:46085 every 8 connection(s)
I20260709 13:14:09.242341  4150 heartbeater.cc:344] Connected to a master server at 127.25.109.190:36929
I20260709 13:14:09.242785  4150 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:09.243585  4150 heartbeater.cc:507] Master 127.25.109.190:36929 requested a full tablet report, sending...
I20260709 13:14:09.245515  3874 ts_manager.cc:194] Registered new tserver with Master: 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.246572 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014636706s
I20260709 13:14:09.247121  3874 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33378
I20260709 13:14:09.270867  3874 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33382:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:09.273242  3874 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:09.334290  4041 tablet_service.cc:1511] Processing CreateTablet for tablet c1d46236e6f9429c88f10fe145aca950 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:09.336241  4041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d46236e6f9429c88f10fe145aca950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.341672  4115 tablet_service.cc:1511] Processing CreateTablet for tablet c1d46236e6f9429c88f10fe145aca950 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:09.343197  4115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d46236e6f9429c88f10fe145aca950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.352383  4040 tablet_service.cc:1511] Processing CreateTablet for tablet a8d1c32f6a8f4bbaa00e62fef68729bf (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:09.353945  4040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d1c32f6a8f4bbaa00e62fef68729bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.355131  4112 tablet_service.cc:1511] Processing CreateTablet for tablet 52469fa168c8420ab3e845f56dbac083 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:09.356518  4112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52469fa168c8420ab3e845f56dbac083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.358026  3965 tablet_service.cc:1511] Processing CreateTablet for tablet a8d1c32f6a8f4bbaa00e62fef68729bf (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:09.359442  3965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d1c32f6a8f4bbaa00e62fef68729bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.360697  4038 tablet_service.cc:1511] Processing CreateTablet for tablet 52469fa168c8420ab3e845f56dbac083 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:09.359091  4039 tablet_service.cc:1511] Processing CreateTablet for tablet fa54490e4f5e4c92870ec04d807486f7 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:09.353494  4113 tablet_service.cc:1511] Processing CreateTablet for tablet fa54490e4f5e4c92870ec04d807486f7 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:09.352383  4114 tablet_service.cc:1511] Processing CreateTablet for tablet a8d1c32f6a8f4bbaa00e62fef68729bf (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:09.372812  3958 tablet_service.cc:1511] Processing CreateTablet for tablet d15ba6c64bdb445b9046dc9c385bd635 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:09.373361  4113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54490e4f5e4c92870ec04d807486f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.364184  4036 tablet_service.cc:1511] Processing CreateTablet for tablet 72433f25175d4b4bb0185709b4ca3912 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:09.374257  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15ba6c64bdb445b9046dc9c385bd635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.362205  3963 tablet_service.cc:1511] Processing CreateTablet for tablet 52469fa168c8420ab3e845f56dbac083 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:09.362020  4038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52469fa168c8420ab3e845f56dbac083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.367326  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 72433f25175d4b4bb0185709b4ca3912 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:09.375461  3963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52469fa168c8420ab3e845f56dbac083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.376250  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72433f25175d4b4bb0185709b4ca3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.368325  3960 tablet_service.cc:1511] Processing CreateTablet for tablet c318fc62a90947a6a6c6a0c28973c300 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:09.377570  4039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54490e4f5e4c92870ec04d807486f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.377863  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c318fc62a90947a6a6c6a0c28973c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.369350  4035 tablet_service.cc:1511] Processing CreateTablet for tablet c318fc62a90947a6a6c6a0c28973c300 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:09.379398  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c318fc62a90947a6a6c6a0c28973c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.365229  3966 tablet_service.cc:1511] Processing CreateTablet for tablet c1d46236e6f9429c88f10fe145aca950 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:09.382829  3966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d46236e6f9429c88f10fe145aca950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.363265  3964 tablet_service.cc:1511] Processing CreateTablet for tablet fa54490e4f5e4c92870ec04d807486f7 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:09.385442  3964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa54490e4f5e4c92870ec04d807486f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.371121  4034 tablet_service.cc:1511] Processing CreateTablet for tablet 280f007a6e9a48d8bb26cacd34bc6455 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:09.388087  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280f007a6e9a48d8bb26cacd34bc6455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.371475  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 280f007a6e9a48d8bb26cacd34bc6455 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:09.390746  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280f007a6e9a48d8bb26cacd34bc6455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.366299  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 31d47ea6164541779c7cd43f9b5d5d0b (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:09.393374  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d47ea6164541779c7cd43f9b5d5d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.394443  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72433f25175d4b4bb0185709b4ca3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.363149  4037 tablet_service.cc:1511] Processing CreateTablet for tablet 31d47ea6164541779c7cd43f9b5d5d0b (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:09.396145  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d47ea6164541779c7cd43f9b5d5d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.397755  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d1c32f6a8f4bbaa00e62fef68729bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.398267  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 31d47ea6164541779c7cd43f9b5d5d0b (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:09.400218  4109 tablet_service.cc:1511] Processing CreateTablet for tablet c318fc62a90947a6a6c6a0c28973c300 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:09.401093  4033 tablet_service.cc:1511] Processing CreateTablet for tablet d15ba6c64bdb445b9046dc9c385bd635 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:09.402377  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15ba6c64bdb445b9046dc9c385bd635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.402089  4110 tablet_service.cc:1511] Processing CreateTablet for tablet 72433f25175d4b4bb0185709b4ca3912 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:09.404028  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 280f007a6e9a48d8bb26cacd34bc6455 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:09.414819  4107 tablet_service.cc:1511] Processing CreateTablet for tablet d15ba6c64bdb445b9046dc9c385bd635 (DEFAULT_TABLE table=test-workload [id=2dd7b1225bce450fbcfd8dfce87a24c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:09.416042  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d47ea6164541779c7cd43f9b5d5d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.420182  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280f007a6e9a48d8bb26cacd34bc6455. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.426107  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c318fc62a90947a6a6c6a0c28973c300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.426697  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72433f25175d4b4bb0185709b4ca3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.427621  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15ba6c64bdb445b9046dc9c385bd635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:09.465605  4166 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.485261  4166 tablet_bootstrap.cc:654] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.531024  4168 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.532281  4165 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.547454  4166 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.548013  4166 ts_tablet_manager.cc:1403] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.025s
I20260709 13:14:09.550125  4165 tablet_bootstrap.cc:654] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.556340  4168 tablet_bootstrap.cc:654] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.550385  4166 raft_consensus.cc:359] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.560750  4166 raft_consensus.cc:385] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.561107  4166 raft_consensus.cc:740] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.563649  4165 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.564179  4165 ts_tablet_manager.cc:1403] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 13:14:09.566287  4166 consensus_queue.cc:260] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.567600  4165 raft_consensus.cc:359] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.568332  4165 raft_consensus.cc:385] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.568670  4165 raft_consensus.cc:740] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.569097  4150 heartbeater.cc:499] Master 127.25.109.190:36929 was elected leader, sending a full tablet report...
I20260709 13:14:09.569222  4168 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.569412  4166 ts_tablet_manager.cc:1434] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:14:09.569875  4168 ts_tablet_manager.cc:1403] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.013s
I20260709 13:14:09.570482  4166 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.572793  4168 raft_consensus.cc:359] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.572649  4165 consensus_queue.cc:260] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.573627  4168 raft_consensus.cc:385] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.574167  4168 raft_consensus.cc:740] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.575102  4168 consensus_queue.cc:260] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.576920  4166 tablet_bootstrap.cc:654] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.581733  4001 heartbeater.cc:499] Master 127.25.109.190:36929 was elected leader, sending a full tablet report...
I20260709 13:14:09.582799  4165 ts_tablet_manager.cc:1434] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.012s
I20260709 13:14:09.584010  4165 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.591233  4076 heartbeater.cc:499] Master 127.25.109.190:36929 was elected leader, sending a full tablet report...
I20260709 13:14:09.595782  4165 tablet_bootstrap.cc:654] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.601282  4166 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.601805  4166 ts_tablet_manager.cc:1403] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.032s	user 0.003s	sys 0.025s
I20260709 13:14:09.601781  4168 ts_tablet_manager.cc:1434] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 13:14:09.602592  4165 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.603232  4165 ts_tablet_manager.cc:1403] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:14:09.603746  4168 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.605129  4166 raft_consensus.cc:359] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.605948  4166 raft_consensus.cc:385] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.606325  4166 raft_consensus.cc:740] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.606021  4165 raft_consensus.cc:359] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.606926  4165 raft_consensus.cc:385] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.607271  4165 raft_consensus.cc:740] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.607372  4166 consensus_queue.cc:260] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.608068  4165 consensus_queue.cc:260] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.610280  4166 ts_tablet_manager.cc:1434] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:09.610370  4168 tablet_bootstrap.cc:654] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.610535  4165 ts_tablet_manager.cc:1434] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:14:09.611321  4166 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.611519  4165 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.618031  4166 tablet_bootstrap.cc:654] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.618638  4165 tablet_bootstrap.cc:654] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.627871  4168 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.628547  4168 ts_tablet_manager.cc:1403] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:14:09.630775  4166 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.631317  4166 ts_tablet_manager.cc:1403] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:14:09.632689  4168 raft_consensus.cc:359] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.634028  4166 raft_consensus.cc:359] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.634613  4168 raft_consensus.cc:385] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.634852  4166 raft_consensus.cc:385] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.635097  4168 raft_consensus.cc:740] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.635205  4166 raft_consensus.cc:740] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.636031  4165 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.636677  4165 ts_tablet_manager.cc:1403] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.015s
I20260709 13:14:09.636215  4166 consensus_queue.cc:260] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.636139  4168 consensus_queue.cc:260] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.638737  4168 ts_tablet_manager.cc:1434] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.008s
I20260709 13:14:09.639727  4168 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.639562  4165 raft_consensus.cc:359] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.640362  4165 raft_consensus.cc:385] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.640656  4165 raft_consensus.cc:740] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.641373  4165 consensus_queue.cc:260] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.643800  4165 ts_tablet_manager.cc:1434] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:09.644768  4165 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.641813  4166 ts_tablet_manager.cc:1434] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:14:09.647392  4168 tablet_bootstrap.cc:654] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.649545  4166 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.650624  4165 tablet_bootstrap.cc:654] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.667668  4168 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.667668  4165 tablet_bootstrap.cc:492] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.668290  4168 ts_tablet_manager.cc:1403] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.017s
I20260709 13:14:09.668363  4165 ts_tablet_manager.cc:1403] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:14:09.669003  4166 tablet_bootstrap.cc:654] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.671012  4168 raft_consensus.cc:359] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.671620  4168 raft_consensus.cc:385] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.671576  4165 raft_consensus.cc:359] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.672292  4168 raft_consensus.cc:740] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.672420  4165 raft_consensus.cc:385] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.672744  4165 raft_consensus.cc:740] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.673782  4166 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.673138  4168 consensus_queue.cc:260] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.673528  4165 consensus_queue.cc:260] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.675727  4168 ts_tablet_manager.cc:1434] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:09.676067  4165 ts_tablet_manager.cc:1434] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:14:09.676937  4168 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.677068  4165 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.684044  4165 tablet_bootstrap.cc:654] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.684072  4168 tablet_bootstrap.cc:654] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.674381  4166 ts_tablet_manager.cc:1403] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 13:14:09.690268  4166 raft_consensus.cc:359] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.691314  4166 raft_consensus.cc:385] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.691694  4166 raft_consensus.cc:740] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.692683  4166 consensus_queue.cc:260] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.695539  4165 tablet_bootstrap.cc:492] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.696034  4165 ts_tablet_manager.cc:1403] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:14:09.698614  4165 raft_consensus.cc:359] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.699425  4166 ts_tablet_manager.cc:1434] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:14:09.699316  4165 raft_consensus.cc:385] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.699846  4165 raft_consensus.cc:740] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.700466  4168 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.700572  4166 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.701077  4168 ts_tablet_manager.cc:1403] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:14:09.700771  4165 consensus_queue.cc:260] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:09.703117  4165 ts_tablet_manager.cc:1434] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:14:09.704111  4165 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.704185  4168 raft_consensus.cc:359] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.704950  4168 raft_consensus.cc:385] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.705232  4168 raft_consensus.cc:740] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.706110  4168 consensus_queue.cc:260] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.708371  4168 ts_tablet_manager.cc:1434] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:09.710700  4168 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.711515  4165 tablet_bootstrap.cc:654] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.715889  4172 raft_consensus.cc:493] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.716390  4172 raft_consensus.cc:515] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.717046  4168 tablet_bootstrap.cc:654] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.717046  4166 tablet_bootstrap.cc:654] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.728384  4172 leader_election.cc:290] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.730618  4166 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.730620  4168 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.731467  4166 ts_tablet_manager.cc:1403] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.013s
I20260709 13:14:09.731467  4168 ts_tablet_manager.cc:1403] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:14:09.734833  4168 raft_consensus.cc:359] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.735648  4168 raft_consensus.cc:385] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.735986  4168 raft_consensus.cc:740] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.736862  4168 consensus_queue.cc:260] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.736958  4166 raft_consensus.cc:359] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.737808  4166 raft_consensus.cc:385] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.738204  4166 raft_consensus.cc:740] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.739114  4166 consensus_queue.cc:260] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.741533  4168 ts_tablet_manager.cc:1434] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:09.743279  4168 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.745971  4173 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.746542  4173 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.749616  4166 ts_tablet_manager.cc:1434] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:14:09.756541  4166 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.750222  4168 tablet_bootstrap.cc:654] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.756948  4173 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.764696  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:09.765450  4125 raft_consensus.cc:2468] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:09.766014  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:09.766952  3941 leader_election.cc:304] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:09.768250  4166 tablet_bootstrap.cc:654] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:09.768050  3939 leader_election.cc:343] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.768641  4172 raft_consensus.cc:2804] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:09.769155  4172 raft_consensus.cc:493] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.769562  4172 raft_consensus.cc:3060] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.777163  4165 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.777935  4165 ts_tablet_manager.cc:1403] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.000s
I20260709 13:14:09.780385  4172 raft_consensus.cc:515] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.784322  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
W20260709 13:14:09.786145  3939 leader_election.cc:343] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.788743  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:09.789324  4125 raft_consensus.cc:3060] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.797557  4125 raft_consensus.cc:2468] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:09.798974  3941 leader_election.cc:304] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:09.802616  4194 raft_consensus.cc:2804] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:09.793496  4165 raft_consensus.cc:359] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.803640  4165 raft_consensus.cc:385] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.804106  4165 raft_consensus.cc:740] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.804651  4168 tablet_bootstrap.cc:492] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.806613  4168 ts_tablet_manager.cc:1403] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.003s
I20260709 13:14:09.805960  4165 consensus_queue.cc:260] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.809530  4172 leader_election.cc:290] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.810324  4168 raft_consensus.cc:359] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.812992  4168 raft_consensus.cc:385] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.812840  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:09.814335  4196 raft_consensus.cc:493] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:09.814555  4014 leader_election.cc:343] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.815104  4165 ts_tablet_manager.cc:1434] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:14:09.815430  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:09.816576  4165 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
W20260709 13:14:09.816783  4016 leader_election.cc:343] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.817194  4168 raft_consensus.cc:740] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.817312  4016 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f29b74c47bbe40f58154d9829aea26c5; no voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:09.818811  4173 raft_consensus.cc:2749] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:09.818598  4168 consensus_queue.cc:260] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.818966  4166 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
W20260709 13:14:09.819588  3922 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:09.819742  4166 ts_tablet_manager.cc:1403] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.035s
I20260709 13:14:09.820888  4168 ts_tablet_manager.cc:1434] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:14:09.822070  4168 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.822922  4166 raft_consensus.cc:359] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.823721  4166 raft_consensus.cc:385] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.824074  4166 raft_consensus.cc:740] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.824963  4166 consensus_queue.cc:260] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.825588  4165 tablet_bootstrap.cc:654] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.829092  4168 tablet_bootstrap.cc:654] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.829957  4166 ts_tablet_manager.cc:1434] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:14:09.831914  4166 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.833285  4173 raft_consensus.cc:493] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.833961  4173 raft_consensus.cc:515] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.836591  4173 leader_election.cc:290] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.837306  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:09.837961  3976 raft_consensus.cc:2468] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:09.839718  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:09.814900  4196 raft_consensus.cc:515] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.841714  4014 leader_election.cc:304] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:09.842882  4173 raft_consensus.cc:2804] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:09.843354  4173 raft_consensus.cc:493] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.843755  4173 raft_consensus.cc:3060] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.840497  4194 raft_consensus.cc:697] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
W20260709 13:14:09.847950  4016 leader_election.cc:343] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.861249  4168 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.862092  4168 ts_tablet_manager.cc:1403] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.024s
I20260709 13:14:09.863448  4196 leader_election.cc:290] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.845909  4194 consensus_queue.cc:237] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.864168  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:09.864569  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:09.864831  4051 raft_consensus.cc:2468] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:09.866133  3939 leader_election.cc:304] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
W20260709 13:14:09.867002  3941 leader_election.cc:343] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.867534  4166 tablet_bootstrap.cc:654] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.867936  4196 raft_consensus.cc:2804] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:09.868342  4196 raft_consensus.cc:493] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.868708  4196 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.869566  4165 tablet_bootstrap.cc:492] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.862967  4173 raft_consensus.cc:515] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.875929  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:09.876739  3976 raft_consensus.cc:3060] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.876624  4168 raft_consensus.cc:359] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.878046  4168 raft_consensus.cc:385] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.878420  4168 raft_consensus.cc:740] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.879429  4168 consensus_queue.cc:260] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.876194  4165 ts_tablet_manager.cc:1403] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.014s
I20260709 13:14:09.884440  4165 raft_consensus.cc:359] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.885308  4165 raft_consensus.cc:385] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.885658  4165 raft_consensus.cc:740] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.886762  4165 consensus_queue.cc:260] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.892288  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:09.892401  4173 leader_election.cc:290] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
W20260709 13:14:09.900307  4016 leader_election.cc:343] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:09.890033  3976 raft_consensus.cc:2468] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:09.902509  4014 leader_election.cc:304] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:09.903990  4173 raft_consensus.cc:2804] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:09.904699  4173 raft_consensus.cc:697] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:09.905843  4173 consensus_queue.cc:237] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.908836  4168 ts_tablet_manager.cc:1434] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.014s
I20260709 13:14:09.910211  4168 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.894446  3874 catalog_manager.cc:5697] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.911378  4196 raft_consensus.cc:515] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.914947  4166 tablet_bootstrap.cc:492] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:09.892455  4165 ts_tablet_manager.cc:1434] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:14:09.915750  4166 ts_tablet_manager.cc:1403] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.015s
I20260709 13:14:09.915642  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:09.916431  4051 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.916528  4165 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:09.917403  4168 tablet_bootstrap.cc:654] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.919203  4166 raft_consensus.cc:359] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.920003  4166 raft_consensus.cc:385] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.920356  4166 raft_consensus.cc:740] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.921298  4166 consensus_queue.cc:260] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.924212  4051 raft_consensus.cc:2468] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:09.924727  4165 tablet_bootstrap.cc:654] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.925428  3939 leader_election.cc:304] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:09.926375  4194 raft_consensus.cc:2804] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:09.926824  4194 raft_consensus.cc:697] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:09.927381  4166 ts_tablet_manager.cc:1434] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:09.927634  4194 consensus_queue.cc:237] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.928593  4166 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:09.937546  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:09.937928  4196 leader_election.cc:290] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.938285  4125 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:09.948356  4125 raft_consensus.cc:2468] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:09.955715  3871 catalog_manager.cc:5697] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.960256  4168 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:09.960790  4168 ts_tablet_manager.cc:1403] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.004s
I20260709 13:14:09.936594  4166 tablet_bootstrap.cc:654] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:09.964221  4168 raft_consensus.cc:359] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.964998  4168 raft_consensus.cc:385] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.965301  4168 raft_consensus.cc:740] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.965735  4194 raft_consensus.cc:493] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.966300  4194 raft_consensus.cc:515] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.966203  4168 consensus_queue.cc:260] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.969252  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:09.969431  4171 raft_consensus.cc:493] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.968807  4168 ts_tablet_manager.cc:1434] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:09.976676  3872 catalog_manager.cc:5697] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:09.983770  4171 raft_consensus.cc:515] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.986763  4165 tablet_bootstrap.cc:492] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:09.975291  4194 leader_election.cc:290] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:09.993450  4165 ts_tablet_manager.cc:1403] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.016s
I20260709 13:14:09.975474  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:09.987905  4051 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:09.997430  4165 raft_consensus.cc:359] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:09.998378  4165 raft_consensus.cc:385] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:09.998039  4125 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:09.998769  4165 raft_consensus.cc:740] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:09.998899  3939 leader_election.cc:304] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:09.983402  4168 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:09.999779  4165 consensus_queue.cc:260] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.000478  4194 raft_consensus.cc:2804] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.001331  4194 raft_consensus.cc:493] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.001741  4194 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.006618  4165 ts_tablet_manager.cc:1434] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:14:10.007658  4165 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:10.010507  4166 tablet_bootstrap.cc:492] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:10.011119  4166 ts_tablet_manager.cc:1403] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.013s
I20260709 13:14:10.014097  4165 tablet_bootstrap.cc:654] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.019157  4171 leader_election.cc:290] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.023281  4166 raft_consensus.cc:359] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.020138  4210 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.024318  4166 raft_consensus.cc:385] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.024787  4166 raft_consensus.cc:740] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.024766  4210 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.025436  4165 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:10.026173  4165 ts_tablet_manager.cc:1403] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:14:10.025811  4166 consensus_queue.cc:260] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.027436  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.027978  4166 ts_tablet_manager.cc:1434] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:10.028071  3976 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.028873  4166 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:10.028944  4165 raft_consensus.cc:359] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.029436  4173 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.029729  4165 raft_consensus.cc:385] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.029778  4088 leader_election.cc:304] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:10.030234  4165 raft_consensus.cc:740] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.031032  4165 consensus_queue.cc:260] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.034358  4173 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.017997  4194 raft_consensus.cc:515] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.035161  4166 tablet_bootstrap.cc:654] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.036580  4173 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085), 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
I20260709 13:14:10.037372  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.037935  4051 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.039059  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:10.039662  4125 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:10.040759  4016 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.040875  4165 ts_tablet_manager.cc:1434] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:14:10.041560  4173 raft_consensus.cc:2804] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.041940  4173 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.042326  4173 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.043408  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.044029  3976 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:10.046567  4166 tablet_bootstrap.cc:492] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:10.047101  4166 ts_tablet_manager.cc:1403] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:14:10.048442  4171 raft_consensus.cc:2804] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.048859  4171 raft_consensus.cc:493] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.048902  4051 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:10.049273  4171 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.050132  3939 leader_election.cc:304] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.051021  4196 raft_consensus.cc:2804] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.051474  4196 raft_consensus.cc:697] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.052270  4196 consensus_queue.cc:237] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.052276  4166 raft_consensus.cc:359] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.054962  4166 raft_consensus.cc:385] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.055267  4166 raft_consensus.cc:740] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.056140  4166 consensus_queue.cc:260] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.058738  4194 leader_election.cc:290] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.058960  4166 ts_tablet_manager.cc:1434] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:14:10.062517  4194 raft_consensus.cc:493] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.063025  4194 raft_consensus.cc:515] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.066182  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.067014  4051 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:10.068629  3939 leader_election.cc:304] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.069235  4194 leader_election.cc:290] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.067142  4214 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.070410  4214 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.072289  4210 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
I20260709 13:14:10.020831  4168 tablet_bootstrap.cc:654] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:10.073182  4214 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.069829  4194 raft_consensus.cc:2804] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.078291  4214 raft_consensus.cc:493] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.076375  4194 raft_consensus.cc:493] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.082724  4210 raft_consensus.cc:493] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.083925  4214 raft_consensus.cc:515] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.083938  4194 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.092986  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.093845  4049 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.086933  4210 raft_consensus.cc:515] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.095642  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.093045  4168 tablet_bootstrap.cc:492] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:10.087688  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.096280  4049 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.096658  4125 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.098369  4088 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.098805  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.099401  4088 leader_election.cc:304] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.089691  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.099946  4216 raft_consensus.cc:2804] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.090386  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.100267  3976 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.100697  4216 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.088832  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:10.101046  4216 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.101697  4219 raft_consensus.cc:2804] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.102142  4219 raft_consensus.cc:493] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.102571  4219 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.102727  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "280f007a6e9a48d8bb26cacd34bc6455" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.103574  3976 raft_consensus.cc:2393] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 034f0b95d3ba49eaa21942608f6e93d8 in current term 1: Already voted for candidate f29b74c47bbe40f58154d9829aea26c5 in this term.
I20260709 13:14:10.104755  4051 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.095841  4210 leader_election.cc:290] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.106443  4168 ts_tablet_manager.cc:1403] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.004s
I20260709 13:14:10.096359  4218 raft_consensus.cc:493] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.107252  4218 raft_consensus.cc:515] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.108274  4124 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:10.092500  4214 leader_election.cc:290] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.095772  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.109207  3974 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.109560  4196 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.110276  4196 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.111186  4218 leader_election.cc:290] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.111647  4168 raft_consensus.cc:359] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.112332  4168 raft_consensus.cc:385] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:10.112609  4168 raft_consensus.cc:740] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:10.112345  4196 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.086498  4173 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.113366  4168 consensus_queue.cc:260] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.090632  3975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.088732  4171 raft_consensus.cc:515] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.113545  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.122320  4051 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:10.092079  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.122527  4219 raft_consensus.cc:515] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.123461  4050 raft_consensus.cc:2393] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 034f0b95d3ba49eaa21942608f6e93d8 in current term 1: Already voted for candidate f29b74c47bbe40f58154d9829aea26c5 in this term.
I20260709 13:14:10.123466  4171 leader_election.cc:290] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.096307  3872 catalog_manager.cc:5697] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.124742  3939 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.125242  4125 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:10.116732  4168 ts_tablet_manager.cc:1434] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:14:10.118080  4173 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Requested vote from peers 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085), 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
I20260709 13:14:10.118880  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.126523  4124 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.119808  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.130446  3974 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.114370  3975 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:10.131105  4201 raft_consensus.cc:493] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.131623  4201 raft_consensus.cc:515] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.121150  4216 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.134644  3975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.135334  4216 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.135462  4196 raft_consensus.cc:2804] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:10.135341  4201 leader_election.cc:290] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.137120  4196 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.137493  4196 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.137514  3974 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:10.138783  4014 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.139647  4201 raft_consensus.cc:2804] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.140285  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa54490e4f5e4c92870ec04d807486f7" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:10.141062  4125 raft_consensus.cc:2393] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f29b74c47bbe40f58154d9829aea26c5 in current term 1: Already voted for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in this term.
I20260709 13:14:10.141506  4124 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:10.115720  4194 raft_consensus.cc:515] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.124444  4219 leader_election.cc:290] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.142239  4016 leader_election.cc:304] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f29b74c47bbe40f58154d9829aea26c5; no voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:10.102113  4088 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:10.144296  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.144881  4050 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.145668  3975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.146093  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:10.146319  3975 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.147449  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.148180  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.148862  3976 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.149314  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.149899  4051 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.147984  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.152494  4050 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:10.152616  4219 raft_consensus.cc:2764] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:10.144837  4173 raft_consensus.cc:3060] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.153785  3939 leader_election.cc:304] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.154666  4172 raft_consensus.cc:2804] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.155157  4172 raft_consensus.cc:697] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.155957  4172 consensus_queue.cc:237] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.156179  4088 leader_election.cc:304] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.158464  4219 raft_consensus.cc:3060] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.148073  4049 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.160079  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.160790  4050 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.162258  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.162853  4125 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:10.165518  4219 raft_consensus.cc:2749] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.166500  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:10.156255  3976 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:10.167395  4124 raft_consensus.cc:2393] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b15bb7c45f245d58b871b3c18efd0f0 in current term 1: Already voted for candidate 034f0b95d3ba49eaa21942608f6e93d8 in this term.
I20260709 13:14:10.169072  4049 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:10.169199  3975 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:10.144902  4194 leader_election.cc:290] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.168059  4173 raft_consensus.cc:2749] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.170105  4196 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.172431  4201 raft_consensus.cc:697] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:10.172631  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:10.176101  3973 raft_consensus.cc:2393] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 034f0b95d3ba49eaa21942608f6e93d8 in current term 1: Already voted for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in this term.
I20260709 13:14:10.177783  4196 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.178756  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.181134  3871 catalog_manager.cc:5697] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.182246  4051 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:10.183537  4125 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:10.172477  4088 leader_election.cc:304] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:10.184417  4219 raft_consensus.cc:2804] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.185643  4050 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:10.186591  4088 leader_election.cc:304] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.184439  4201 consensus_queue.cc:237] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.187628  4216 raft_consensus.cc:2804] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.188108  4216 raft_consensus.cc:697] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.188135  4088 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.189195  4218 raft_consensus.cc:2804] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:10.189060  4216 consensus_queue.cc:237] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.189688  4218 raft_consensus.cc:697] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.189702  4088 leader_election.cc:304] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.190634  4218 consensus_queue.cc:237] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.186684  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.191015  4171 raft_consensus.cc:2749] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.185717  4219 raft_consensus.cc:697] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.196520  4219 consensus_queue.cc:237] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.198607  3941 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.199757  4196 raft_consensus.cc:2749] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:10.205186  3871 catalog_manager.cc:5697] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.207094  3872 catalog_manager.cc:5697] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.219990  3872 catalog_manager.cc:5697] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.221293  3872 catalog_manager.cc:5697] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.399654  4196 consensus_queue.cc:1048] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.415576  4172 consensus_queue.cc:1048] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.436357  4172 consensus_queue.cc:1048] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.445699  4194 consensus_queue.cc:1048] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.466593  4050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49762
I20260709 13:14:10.467068  4050 raft_consensus.cc:606] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:10.470391  4201 consensus_queue.cc:1048] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.483887  4124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:10.484540  4124 raft_consensus.cc:606] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:10.484218  4201 consensus_queue.cc:1048] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.494781  4124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:10.495342  4124 raft_consensus.cc:606] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:10.501153  4124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:10.501636  4124 raft_consensus.cc:606] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.513713  3974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:14:10.514283  3974 raft_consensus.cc:606] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Received request to transfer leadership to TS f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.519080  3974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:14:10.519501  3974 raft_consensus.cc:606] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Received request to transfer leadership to TS f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.526907  3974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:14:10.527390  3974 raft_consensus.cc:606] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Received request to transfer leadership to TS 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:10.529835  4194 consensus_queue.cc:1048] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.540294  4196 consensus_queue.cc:1048] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.547889  4172 raft_consensus.cc:993] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.548380  4196 raft_consensus.cc:1081] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Signalling peer f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.549825  4050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49746
I20260709 13:14:10.550420  4050 raft_consensus.cc:493] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.550823  4050 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.556005  4050 raft_consensus.cc:515] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.558002  4050 leader_election.cc:290] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.558816  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.559491  3974 raft_consensus.cc:3055] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.559823  3974 raft_consensus.cc:740] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.559698  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72433f25175d4b4bb0185709b4ca3912" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.560640  4124 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.560902  3974 consensus_queue.cc:260] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.562453  3974 raft_consensus.cc:3060] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.566025  4124 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.567179  4016 leader_election.cc:304] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.567864  4201 raft_consensus.cc:2804] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.568527  4201 raft_consensus.cc:697] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:10.568727  3974 raft_consensus.cc:2468] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.569345  4201 consensus_queue.cc:237] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.575640  3872 catalog_manager.cc:5697] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 1 to 2, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.660844  4201 consensus_queue.cc:1048] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.664978  4201 consensus_queue.cc:1048] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.668176  4173 raft_consensus.cc:993] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.668679  4221 raft_consensus.cc:1081] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.671947  3974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49672
I20260709 13:14:10.672555  3974 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.672974  3974 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.675792  4196 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:10.683528  3974 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.684897  3973 raft_consensus.cc:1240] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Rejecting Update request from peer f29b74c47bbe40f58154d9829aea26c5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:10.687493  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.688192  4050 raft_consensus.cc:3055] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.688545  4050 raft_consensus.cc:740] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:10.689245  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d46236e6f9429c88f10fe145aca950" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.689495  4050 consensus_queue.cc:260] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.690173  4124 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.690413  4173 consensus_queue.cc:1059] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.691834  4050 raft_consensus.cc:3060] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.695580  4172 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.687693  3974 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.701686  4050 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:10.705837  3939 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.706686  4196 raft_consensus.cc:2804] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.707271  4196 raft_consensus.cc:697] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.708257  4194 raft_consensus.cc:993] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.708284  4196 consensus_queue.cc:237] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:10.709187  4124 raft_consensus.cc:2468] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:10.710001  4194 raft_consensus.cc:1081] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Signalling peer f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.711918  4050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49746
I20260709 13:14:10.712440  4050 raft_consensus.cc:493] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.712803  4050 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.713745  4219 consensus_queue.cc:1048] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.719774  3872 catalog_manager.cc:5697] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.720669  4050 raft_consensus.cc:515] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.723193  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.723392  4050 leader_election.cc:290] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.723783  3974 raft_consensus.cc:3055] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.724108  3974 raft_consensus.cc:740] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.724871  3974 consensus_queue.cc:260] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.725874  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.726225  3974 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.726526  4124 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.725257  4219 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:10.733965  4124 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.735389  4016 leader_election.cc:304] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.736963  4221 raft_consensus.cc:2804] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.737509  4221 raft_consensus.cc:697] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:10.737933  3974 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.738440  4221 consensus_queue.cc:237] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.745733  4219 consensus_queue.cc:1048] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.751464  4219 raft_consensus.cc:993] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.751884  4219 raft_consensus.cc:1081] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.759653  3974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49688
I20260709 13:14:10.760257  3974 raft_consensus.cc:493] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.760624  3974 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.763238  4219 raft_consensus.cc:993] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.763748  4219 raft_consensus.cc:1081] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:10.765066  3874 catalog_manager.cc:5697] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 1 to 2, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.766628  4214 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.767853  3974 raft_consensus.cc:515] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.766830  3973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49688
I20260709 13:14:10.769519  3973 raft_consensus.cc:493] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.769923  3973 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.770674  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.773649  3974 leader_election.cc:290] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.775218  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.775758  4124 raft_consensus.cc:3055] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.776087  4124 raft_consensus.cc:740] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.776852  4124 consensus_queue.cc:260] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.777788  4124 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.785106  4124 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:10.786725  3973 raft_consensus.cc:515] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.789034  3973 leader_election.cc:290] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.786988  3941 leader_election.cc:304] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:10.790243  4196 raft_consensus.cc:2804] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.790547  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.790717  4196 raft_consensus.cc:697] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.791173  4050 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.791595  4196 consensus_queue.cc:237] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.798169  4050 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:10.799358  3939 leader_election.cc:304] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.799324  4214 consensus_queue.cc:1048] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.800681  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d1c32f6a8f4bbaa00e62fef68729bf" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.801312  4124 raft_consensus.cc:3055] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.801668  4124 raft_consensus.cc:740] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.802537  4124 consensus_queue.cc:260] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.803874  4124 raft_consensus.cc:3060] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.804494  4248 consensus_queue.cc:1048] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:10.803831  4196 raft_consensus.cc:2804] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.805572  4196 raft_consensus.cc:697] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.806419  4196 consensus_queue.cc:237] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.811932  3872 catalog_manager.cc:5697] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.822463  4124 raft_consensus.cc:2468] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:10.833917  3872 catalog_manager.cc:5697] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.836112  4249 raft_consensus.cc:993] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.836611  4248 raft_consensus.cc:1081] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:10.838230  4051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49760
I20260709 13:14:10.839073  4051 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.839468  4051 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.846124  4051 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.849234  4051 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:10.849506  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.849817  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d47ea6164541779c7cd43f9b5d5d0b" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:10.850203  3973 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.850433  4124 raft_consensus.cc:3055] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.850772  4124 raft_consensus.cc:740] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.851608  4124 consensus_queue.cc:260] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.852846  4124 raft_consensus.cc:3060] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.857229  3973 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.860442  4124 raft_consensus.cc:2468] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:10.860992  4014 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.861871  4221 raft_consensus.cc:2804] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.862352  4221 raft_consensus.cc:697] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:10.863122  4221 consensus_queue.cc:237] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.868906  3871 catalog_manager.cc:5697] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.948169  4196 raft_consensus.cc:993] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:10.948633  4194 raft_consensus.cc:1081] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Signalling peer 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:10.950009  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:14:10.950460  4124 raft_consensus.cc:493] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:10.950711  4124 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.955528  4124 raft_consensus.cc:515] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.957314  4124 leader_election.cc:290] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:10.958508  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:10.959224  4051 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.959280  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15ba6c64bdb445b9046dc9c385bd635" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:10.960675  3973 raft_consensus.cc:3055] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:10.961284  3973 raft_consensus.cc:740] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:10.963241  3973 consensus_queue.cc:260] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.964594  3973 raft_consensus.cc:3060] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:10.966799  4051 raft_consensus.cc:2468] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 2.
I20260709 13:14:10.967909  4088 leader_election.cc:304] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:10.968653  4248 raft_consensus.cc:2804] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:10.969226  4248 raft_consensus.cc:697] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:10.970000  4248 consensus_queue.cc:237] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:10.972841  3973 raft_consensus.cc:2468] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 2.
I20260709 13:14:10.978866  3871 catalog_manager.cc:5697] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 1 to 2, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.993101  3973 raft_consensus.cc:1275] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:10.994410  4221 consensus_queue.cc:1048] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.995304  4124 raft_consensus.cc:1275] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:10.996626  4221 consensus_queue.cc:1048] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.132261  4124 raft_consensus.cc:1275] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.133481  4196 consensus_queue.cc:1048] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.141343  4051 raft_consensus.cc:1275] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.142923  4172 consensus_queue.cc:1048] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.191490  4124 raft_consensus.cc:1275] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.192885  4172 consensus_queue.cc:1048] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.193555  4051 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:11.200875  4050 raft_consensus.cc:1275] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.201241  4051 raft_consensus.cc:1275] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.203287  4194 consensus_queue.cc:1048] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.203369  4196 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.207768  3973 raft_consensus.cc:1275] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.209524  4201 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.215226  4124 raft_consensus.cc:1275] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.217317  4196 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.221365  4124 raft_consensus.cc:1275] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.223042  4221 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.367455  3973 raft_consensus.cc:1275] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.368736  4249 consensus_queue.cc:1048] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.377597  4050 raft_consensus.cc:1275] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.379379  4254 consensus_queue.cc:1048] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.449105  3973 raft_consensus.cc:1275] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.450521  4221 consensus_queue.cc:1048] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:11.458891  4125 raft_consensus.cc:1275] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:11.460471  4221 consensus_queue.cc:1048] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:13.557260  3874 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33384:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:13.559733  3874 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:13.611090  3963 tablet_service.cc:1511] Processing CreateTablet for tablet 228e971277ae44eaa6e831fe3976cbbf (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:13.612308  3963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228e971277ae44eaa6e831fe3976cbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.612406  4039 tablet_service.cc:1511] Processing CreateTablet for tablet 228e971277ae44eaa6e831fe3976cbbf (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:13.613660  4039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228e971277ae44eaa6e831fe3976cbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.614485  3960 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdb3999028444bbb578ba2a94b39c83 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:13.615473  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdb3999028444bbb578ba2a94b39c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.619421  4112 tablet_service.cc:1511] Processing CreateTablet for tablet 228e971277ae44eaa6e831fe3976cbbf (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:13.620684  4112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 228e971277ae44eaa6e831fe3976cbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.628059  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdb3999028444bbb578ba2a94b39c83 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:13.629315  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdb3999028444bbb578ba2a94b39c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.629698  4270 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:13.635943  4270 tablet_bootstrap.cc:654] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.641597  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdb3999028444bbb578ba2a94b39c83 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:13.643481  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdb3999028444bbb578ba2a94b39c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.651083  4272 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:13.655256  4273 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:13.658850  4272 tablet_bootstrap.cc:654] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.662077  4273 tablet_bootstrap.cc:654] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.664088  3963 tablet_service.cc:1511] Processing CreateTablet for tablet 07b504be7c994e749542d9c7e1b722f3 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:13.665638  3963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b504be7c994e749542d9c7e1b722f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.671345  4272 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:13.671999  4272 ts_tablet_manager.cc:1403] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.015s
I20260709 13:14:13.672502  4273 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:13.673072  4273 ts_tablet_manager.cc:1403] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:14:13.675415  4272 raft_consensus.cc:359] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.676277  4272 raft_consensus.cc:385] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.676451  4273 raft_consensus.cc:359] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.676874  4272 raft_consensus.cc:740] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.677202  4273 raft_consensus.cc:385] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.677539  4273 raft_consensus.cc:740] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.678076  4272 consensus_queue.cc:260] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.678332  4273 consensus_queue.cc:260] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.680627  4273 ts_tablet_manager.cc:1434] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:13.683385  4039 tablet_service.cc:1511] Processing CreateTablet for tablet 07b504be7c994e749542d9c7e1b722f3 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:13.684720  4039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b504be7c994e749542d9c7e1b722f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.685817  4272 ts_tablet_manager.cc:1434] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:13.690425  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb9e81d8664c878f152efb55a71145 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:13.692251  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb9e81d8664c878f152efb55a71145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.698537  4254 raft_consensus.cc:493] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.699071  4254 raft_consensus.cc:515] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.701165  4038 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb9e81d8664c878f152efb55a71145 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:13.702105  4112 tablet_service.cc:1511] Processing CreateTablet for tablet 07b504be7c994e749542d9c7e1b722f3 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:13.702570  4038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb9e81d8664c878f152efb55a71145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.703483  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:13.704267  4050 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:13.705624  4088 leader_election.cc:304] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:13.703352  4112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b504be7c994e749542d9c7e1b722f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.702674  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:13.701232  4254 leader_election.cc:290] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:13.709127  4254 raft_consensus.cc:2804] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.709476  4254 raft_consensus.cc:493] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.709797  4254 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.722885  4254 raft_consensus.cc:515] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.723573  4273 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:13.727077  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 63fb9e81d8664c878f152efb55a71145 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:13.728538  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fb9e81d8664c878f152efb55a71145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.732621  4273 tablet_bootstrap.cc:654] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.741971  3960 tablet_service.cc:1511] Processing CreateTablet for tablet f98fe1776e9b46f6a1d9b724a4275cdb (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:13.743409  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98fe1776e9b46f6a1d9b724a4275cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.749557  4272 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:13.751474  4040 tablet_service.cc:1511] Processing CreateTablet for tablet f98fe1776e9b46f6a1d9b724a4275cdb (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:13.752830  4040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98fe1776e9b46f6a1d9b724a4275cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.754379  4254 leader_election.cc:290] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:13.761454  4112 tablet_service.cc:1511] Processing CreateTablet for tablet f98fe1776e9b46f6a1d9b724a4275cdb (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:13.762815  4112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98fe1776e9b46f6a1d9b724a4275cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.763827  4272 tablet_bootstrap.cc:654] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.764135  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 16a929a2879c456db879b17ec7d79a41 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:13.765082  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 16a929a2879c456db879b17ec7d79a41 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:13.765537  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a929a2879c456db879b17ec7d79a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.766371  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a929a2879c456db879b17ec7d79a41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.766480  4088 leader_election.cc:343] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.770099  4270 tablet_bootstrap.cc:492] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:13.770625  4270 ts_tablet_manager.cc:1403] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.141s	user 0.043s	sys 0.045s
I20260709 13:14:13.772329  3963 tablet_service.cc:1511] Processing CreateTablet for tablet 16a929a2879c456db879b17ec7d79a41 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:13.772606  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96b86b572a4b7b94a8afc282b1f572 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:13.773696  3963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a929a2879c456db879b17ec7d79a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.775301  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96b86b572a4b7b94a8afc282b1f572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.777029  4270 raft_consensus.cc:359] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.782699  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:13.784440  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:13.785050  4050 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.777832  4270 raft_consensus.cc:385] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.789768  4270 raft_consensus.cc:740] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.804467  4038 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96b86b572a4b7b94a8afc282b1f572 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:13.802639  4270 consensus_queue.cc:260] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.805847  4038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96b86b572a4b7b94a8afc282b1f572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.806100  3973 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.807561  4270 ts_tablet_manager.cc:1434] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 13:14:13.808632  4270 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:13.819463  4273 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:13.819903  4270 tablet_bootstrap.cc:654] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.820061  4273 ts_tablet_manager.cc:1403] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.009s
I20260709 13:14:13.826344  4112 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96b86b572a4b7b94a8afc282b1f572 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:13.827214  4050 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:13.827718  4112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96b86b572a4b7b94a8afc282b1f572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.827479  3960 tablet_service.cc:1511] Processing CreateTablet for tablet 7fccaf2806dc4b22b0eb9de839adc447 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:13.837514  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fccaf2806dc4b22b0eb9de839adc447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.837714  4088 leader_election.cc:304] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:13.838954  4276 raft_consensus.cc:2804] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.836254  3973 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:13.840149  4276 raft_consensus.cc:697] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:13.840975  4276 consensus_queue.cc:237] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.858961  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 7fccaf2806dc4b22b0eb9de839adc447 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:13.860337  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fccaf2806dc4b22b0eb9de839adc447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.865368  4270 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:13.865919  4270 ts_tablet_manager.cc:1403] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.006s
I20260709 13:14:13.867226  4035 tablet_service.cc:1511] Processing CreateTablet for tablet e9655bf75d6a4ac7b72a308be220726f (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:13.868484  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9655bf75d6a4ac7b72a308be220726f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.869177  3922 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:13.877621  4272 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:13.878185  4272 ts_tablet_manager.cc:1403] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.129s	user 0.031s	sys 0.022s
I20260709 13:14:13.880681  3871 catalog_manager.cc:5697] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.881238  4272 raft_consensus.cc:359] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.882025  4272 raft_consensus.cc:385] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.882598  4272 raft_consensus.cc:740] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.883497  4272 consensus_queue.cc:260] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.890663  4272 ts_tablet_manager.cc:1434] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:14:13.893877  3959 tablet_service.cc:1511] Processing CreateTablet for tablet e9655bf75d6a4ac7b72a308be220726f (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:13.854542  4040 tablet_service.cc:1511] Processing CreateTablet for tablet 7fccaf2806dc4b22b0eb9de839adc447 (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:13.895231  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9655bf75d6a4ac7b72a308be220726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.895231  4040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fccaf2806dc4b22b0eb9de839adc447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.862424  4273 raft_consensus.cc:359] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.892925  4270 raft_consensus.cc:359] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.898370  4273 raft_consensus.cc:385] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.898766  4273 raft_consensus.cc:740] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.898485  4270 raft_consensus.cc:385] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.899446  4270 raft_consensus.cc:740] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.902216  4273 consensus_queue.cc:260] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.898929  4272 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:13.901330  4108 tablet_service.cc:1511] Processing CreateTablet for tablet e9655bf75d6a4ac7b72a308be220726f (DEFAULT_TABLE table=soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:13.904089  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9655bf75d6a4ac7b72a308be220726f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.904507  4273 ts_tablet_manager.cc:1434] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:14:13.906750  4270 consensus_queue.cc:260] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.910355  4270 ts_tablet_manager.cc:1434] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:14:13.911620  4270 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:13.912948  4272 tablet_bootstrap.cc:654] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.918152  4273 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:13.926676  4273 tablet_bootstrap.cc:654] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.930553  4270 tablet_bootstrap.cc:654] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.941733  4272 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:13.942298  4272 ts_tablet_manager.cc:1403] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.003s
I20260709 13:14:13.944034  4270 tablet_bootstrap.cc:492] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:13.944546  4270 ts_tablet_manager.cc:1403] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:14:13.947556  4270 raft_consensus.cc:359] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.948268  4270 raft_consensus.cc:385] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.948562  4270 raft_consensus.cc:740] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.949245  4270 consensus_queue.cc:260] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.950174  4272 raft_consensus.cc:359] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.950992  4272 raft_consensus.cc:385] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.951327  4272 raft_consensus.cc:740] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.951617  4270 ts_tablet_manager.cc:1434] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:13.952672  4270 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:13.952955  4272 consensus_queue.cc:260] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.958325  4273 tablet_bootstrap.cc:492] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:13.958873  4273 ts_tablet_manager.cc:1403] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.022s
I20260709 13:14:13.961740  4273 raft_consensus.cc:359] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.962384  4273 raft_consensus.cc:385] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.962669  4273 raft_consensus.cc:740] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.963394  4273 consensus_queue.cc:260] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.965675  4273 ts_tablet_manager.cc:1434] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:13.966622  4273 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:13.972668  4272 ts_tablet_manager.cc:1434] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:14:13.977885  4272 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:13.972998  4273 tablet_bootstrap.cc:654] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.976725  4270 tablet_bootstrap.cc:654] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.984861  4272 tablet_bootstrap.cc:654] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.986899  4273 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:13.987932  4273 ts_tablet_manager.cc:1403] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 13:14:13.992177  4273 raft_consensus.cc:359] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.993196  4272 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:13.994069  4273 raft_consensus.cc:385] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.994330  4272 ts_tablet_manager.cc:1403] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:14:13.994500  4273 raft_consensus.cc:740] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.995369  4270 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:13.995915  4270 ts_tablet_manager.cc:1403] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.008s
I20260709 13:14:13.995674  4273 consensus_queue.cc:260] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.997567  4272 raft_consensus.cc:359] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.998353  4272 raft_consensus.cc:385] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.998659  4272 raft_consensus.cc:740] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.998880  4273 ts_tablet_manager.cc:1434] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:13.998926  4270 raft_consensus.cc:359] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.999496  4272 consensus_queue.cc:260] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:13.999943  4270 raft_consensus.cc:385] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.000403  4270 raft_consensus.cc:740] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.001283  4270 consensus_queue.cc:260] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.007232  4276 raft_consensus.cc:493] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.007818  4276 raft_consensus.cc:515] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.000240  4273 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:14.025540  4272 ts_tablet_manager.cc:1434] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.009s
I20260709 13:14:14.026717  4272 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:14.027187  4270 ts_tablet_manager.cc:1434] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 13:14:14.028288  4270 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:14.034590  4273 tablet_bootstrap.cc:654] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.034912  4272 tablet_bootstrap.cc:654] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.035591  4270 tablet_bootstrap.cc:654] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.044099  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.044840  3973 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.046079  4273 tablet_bootstrap.cc:492] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:14.046686  4273 ts_tablet_manager.cc:1403] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.007s
I20260709 13:14:14.048206  4088 leader_election.cc:304] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:14.049152  4254 raft_consensus.cc:2804] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.049551  4254 raft_consensus.cc:493] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.049981  4254 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.051725  4276 leader_election.cc:290] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.053242  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.054630  4050 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.054317  4273 raft_consensus.cc:359] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.055136  4273 raft_consensus.cc:385] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.055440  4273 raft_consensus.cc:740] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.055647  4272 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:14.048255  4270 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:14.056185  4272 ts_tablet_manager.cc:1403] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 13:14:14.056715  4270 ts_tablet_manager.cc:1403] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 13:14:14.059011  4272 raft_consensus.cc:359] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.059744  4272 raft_consensus.cc:385] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.060036  4272 raft_consensus.cc:740] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.060719  4257 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.060901  4270 raft_consensus.cc:359] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.060781  4272 consensus_queue.cc:260] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.061360  4257 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.061798  4270 raft_consensus.cc:385] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.062175  4270 raft_consensus.cc:740] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.063014  4254 raft_consensus.cc:515] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.063735  4272 ts_tablet_manager.cc:1434] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:14.064851  4272 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:14.065811  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.066461  3973 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.067505  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.068120  4050 raft_consensus.cc:2468] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:14.056226  4273 consensus_queue.cc:260] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.069351  3939 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.062911  4270 consensus_queue.cc:260] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.070303  4287 raft_consensus.cc:2804] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.070660  4287 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.070995  4287 raft_consensus.cc:3060] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.071818  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.072284  4272 tablet_bootstrap.cc:654] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.072484  4124 raft_consensus.cc:2468] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:14.074265  4276 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.076382  4276 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.079430  4276 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.083072  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.084095  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.090541  4050 raft_consensus.cc:2468] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.091737  4088 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.097368  4257 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.097528  4276 raft_consensus.cc:493] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.098160  4276 raft_consensus.cc:515] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.085970  4287 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.089468  3973 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.103456  3974 raft_consensus.cc:2393] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 034f0b95d3ba49eaa21942608f6e93d8 in current term 1: Already voted for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in this term.
I20260709 13:14:14.107007  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.107597  4050 raft_consensus.cc:3060] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.107991  4254 leader_election.cc:290] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.114691  4254 raft_consensus.cc:2804] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.117393  4254 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.117964  4254 raft_consensus.cc:3060] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.120110  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.116878  4287 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.120860  3974 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.100381  4276 leader_election.cc:290] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.116866  4270 ts_tablet_manager.cc:1434] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:14:14.122411  4270 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:14.123304  4051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.130443  4051 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.124976  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.131404  4049 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.125716  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:14.129663  4254 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.140503  4124 raft_consensus.cc:2393] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1b15bb7c45f245d58b871b3c18efd0f0 in current term 1: Already voted for candidate 034f0b95d3ba49eaa21942608f6e93d8 in this term.
I20260709 13:14:14.129408  4050 raft_consensus.cc:2468] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:14.142740  3939 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.143497  4254 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.139741  4270 tablet_bootstrap.cc:654] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.145670  4287 raft_consensus.cc:2804] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.146175  4287 raft_consensus.cc:697] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:14.146997  4287 consensus_queue.cc:237] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.126446  4088 leader_election.cc:304] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:14.152060  4254 raft_consensus.cc:2804] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.152511  4254 raft_consensus.cc:697] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:14.152799  4088 leader_election.cc:304] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:14.153332  4254 consensus_queue.cc:237] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.156440  4049 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.154583  4276 raft_consensus.cc:2804] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.157018  4276 raft_consensus.cc:493] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.157366  4276 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.169036  4276 raft_consensus.cc:515] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.177647  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.182945  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b504be7c994e749542d9c7e1b722f3" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.183676  4050 raft_consensus.cc:2393] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 034f0b95d3ba49eaa21942608f6e93d8 in current term 1: Already voted for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in this term.
I20260709 13:14:14.188974  4088 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:14.191993  4273 ts_tablet_manager.cc:1434] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.145s	user 0.049s	sys 0.074s
I20260709 13:14:14.202279  4270 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:14.207003  4270 ts_tablet_manager.cc:1403] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.003s
I20260709 13:14:14.207501  4273 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:14.208804  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.209825  4272 tablet_bootstrap.cc:492] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:14.210500  4272 ts_tablet_manager.cc:1403] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.146s	user 0.058s	sys 0.083s
I20260709 13:14:14.210233  4050 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.210383  4270 raft_consensus.cc:359] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.211318  4270 raft_consensus.cc:385] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.211627  4270 raft_consensus.cc:740] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.204885  3871 catalog_manager.cc:5697] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.212373  4270 consensus_queue.cc:260] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.209725  4254 raft_consensus.cc:2749] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.214932  4273 tablet_bootstrap.cc:654] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.215736  4272 raft_consensus.cc:359] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.216475  4272 raft_consensus.cc:385] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.216753  4272 raft_consensus.cc:740] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.217468  4272 consensus_queue.cc:260] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.204150  4276 leader_election.cc:290] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.222026  4050 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.223811  4088 leader_election.cc:304] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.225399  4276 raft_consensus.cc:2804] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.226013  4276 raft_consensus.cc:697] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:14.227638  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.228251  3974 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.227114  4276 consensus_queue.cc:237] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.235930  3974 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.237092  4272 ts_tablet_manager.cc:1434] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:14:14.238201  4272 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:14.243032  4270 ts_tablet_manager.cc:1434] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 13:14:14.244590  4273 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:14.245276  4273 ts_tablet_manager.cc:1403] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.016s
I20260709 13:14:14.249866  4270 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:14.250891  4273 raft_consensus.cc:359] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.251744  4273 raft_consensus.cc:385] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.251199  3872 catalog_manager.cc:5697] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.252060  4273 raft_consensus.cc:740] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.253384  4272 tablet_bootstrap.cc:654] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.252918  4273 consensus_queue.cc:260] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.255486  4273 ts_tablet_manager.cc:1434] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:14:14.256536  4273 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:14.257774  4270 tablet_bootstrap.cc:654] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.258327  4259 raft_consensus.cc:493] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.258850  4259 raft_consensus.cc:515] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.262976  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98fe1776e9b46f6a1d9b724a4275cdb" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.263900  4125 raft_consensus.cc:2468] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:14.264854  4273 tablet_bootstrap.cc:654] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.266721  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98fe1776e9b46f6a1d9b724a4275cdb" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.267524  3974 raft_consensus.cc:2468] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:14.268661  4259 leader_election.cc:290] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.269985  4016 leader_election.cc:304] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.270304  4270 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:14.270907  4270 ts_tablet_manager.cc:1403] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:14:14.273849  4270 raft_consensus.cc:359] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.274755  4270 raft_consensus.cc:385] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.275084  4270 raft_consensus.cc:740] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.275810  4270 consensus_queue.cc:260] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.278486  4270 ts_tablet_manager.cc:1434] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:14.279475  4270 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:14.280468  4259 raft_consensus.cc:2804] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.281080  4259 raft_consensus.cc:493] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.281415  4259 raft_consensus.cc:3060] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.286196  4270 tablet_bootstrap.cc:654] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.297690  4270 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:14.298235  4270 ts_tablet_manager.cc:1403] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:14:14.300845  4270 raft_consensus.cc:359] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.301625  4270 raft_consensus.cc:385] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.301945  4270 raft_consensus.cc:740] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.302793  4270 consensus_queue.cc:260] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.305058  4270 ts_tablet_manager.cc:1434] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:14.305944  4270 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: Bootstrap starting.
I20260709 13:14:14.305547  3874 catalog_manager.cc:5697] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.313186  4270 tablet_bootstrap.cc:654] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.324782  4270 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: No bootstrap required, opened a new log
I20260709 13:14:14.325302  4270 ts_tablet_manager.cc:1403] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 13:14:14.327998  4270 raft_consensus.cc:359] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.328747  4270 raft_consensus.cc:385] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.329087  4270 raft_consensus.cc:740] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.329779  4270 consensus_queue.cc:260] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.332244  4270 ts_tablet_manager.cc:1434] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:14.347285  4259 raft_consensus.cc:515] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.350607  4273 tablet_bootstrap.cc:492] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:14.350510  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98fe1776e9b46f6a1d9b724a4275cdb" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.351174  3974 raft_consensus.cc:3060] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.351172  4273 ts_tablet_manager.cc:1403] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.095s	user 0.023s	sys 0.067s
I20260709 13:14:14.352758  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98fe1776e9b46f6a1d9b724a4275cdb" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:14.353400  4125 raft_consensus.cc:3060] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.354899  4273 raft_consensus.cc:359] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.355682  4273 raft_consensus.cc:385] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.355974  4273 raft_consensus.cc:740] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.356817  4273 consensus_queue.cc:260] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.360364  4125 raft_consensus.cc:2468] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:14.361588  4016 leader_election.cc:304] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.362485  4304 raft_consensus.cc:2804] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.362942  4304 raft_consensus.cc:697] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:14.365545  4304 consensus_queue.cc:237] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.366438  4273 ts_tablet_manager.cc:1434] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:14:14.366638  3974 raft_consensus.cc:2468] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:14.351182  4272 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:14.368687  4272 ts_tablet_manager.cc:1403] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.131s	user 0.049s	sys 0.047s
I20260709 13:14:14.370393  4273 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
I20260709 13:14:14.371881  4272 raft_consensus.cc:359] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.372620  4272 raft_consensus.cc:385] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.372901  4272 raft_consensus.cc:740] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.372960  4259 leader_election.cc:290] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.373688  4272 consensus_queue.cc:260] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.376314  4272 ts_tablet_manager.cc:1434] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:14.377539  4272 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
I20260709 13:14:14.377969  4273 tablet_bootstrap.cc:654] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.381446  4287 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.381137  3871 catalog_manager.cc:5697] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.382510  4273 tablet_bootstrap.cc:492] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:14.382963  4273 ts_tablet_manager.cc:1403] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:14:14.381975  4287 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.385619  4273 raft_consensus.cc:359] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.386170  4272 tablet_bootstrap.cc:654] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.386266  4273 raft_consensus.cc:385] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.386693  4273 raft_consensus.cc:740] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.387346  4273 consensus_queue.cc:260] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.388582  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.389560  4273 ts_tablet_manager.cc:1434] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:14.390444  4273 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: Bootstrap starting.
W20260709 13:14:14.394874  3939 leader_election.cc:343] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.395506  4257 raft_consensus.cc:493] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.396096  4273 tablet_bootstrap.cc:654] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.395980  4257 raft_consensus.cc:515] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.400461  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.401302  4050 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:14.402972  3939 leader_election.cc:304] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.404165  4297 raft_consensus.cc:2804] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.404597  4297 raft_consensus.cc:493] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.404953  4297 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.413710  4287 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.415897  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.416815  4125 raft_consensus.cc:2468] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:14.418452  3941 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:14.425118  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.425318  4254 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.426013  4125 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 0.
I20260709 13:14:14.421917  4257 leader_election.cc:290] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.428952  4257 raft_consensus.cc:2804] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.429374  4257 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.429788  4257 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.435616  4287 raft_consensus.cc:493] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.436358  4287 raft_consensus.cc:515] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.440008  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
W20260709 13:14:14.441485  3939 leader_election.cc:343] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.447028  4297 raft_consensus.cc:515] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.448527  4287 leader_election.cc:290] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.449972  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
W20260709 13:14:14.451937  3941 leader_election.cc:343] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.452654  4297 leader_election.cc:290] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.451936  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.454267  4050 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.452596  3941 leader_election.cc:304] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:14.456962  4272 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:14.457696  4273 tablet_bootstrap.cc:492] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: No bootstrap required, opened a new log
I20260709 13:14:14.457904  4272 ts_tablet_manager.cc:1403] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.081s	user 0.024s	sys 0.051s
I20260709 13:14:14.458235  4273 ts_tablet_manager.cc:1403] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.032s
I20260709 13:14:14.458554  4297 raft_consensus.cc:2749] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.460915  4254 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.461773  4257 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.460996  4272 raft_consensus.cc:359] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.462587  4273 raft_consensus.cc:359] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.463219  4272 raft_consensus.cc:385] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.463423  4273 raft_consensus.cc:385] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.463541  4272 raft_consensus.cc:740] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.463914  4273 raft_consensus.cc:740] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.464995  4257 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.464479  4272 consensus_queue.cc:260] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.464949  4273 consensus_queue.cc:260] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.465955  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.467154  4272 ts_tablet_manager.cc:1434] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:14:14.467350  4273 ts_tablet_manager.cc:1434] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:14:14.468134  4272 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: Bootstrap starting.
W20260709 13:14:14.467393  3939 leader_election.cc:343] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:14.473568  4304 raft_consensus.cc:493] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.474082  4304 raft_consensus.cc:515] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.474601  4272 tablet_bootstrap.cc:654] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:14.477085  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:14.477305  4123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.477779  4124 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.478004  4123 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:14.480870  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.482647  3973 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 0.
I20260709 13:14:14.483904  4016 leader_election.cc:304] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.484638  4307 raft_consensus.cc:2804] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.484999  4307 raft_consensus.cc:493] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.485316  4307 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.486011  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:14.486621  4125 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.492430  4307 raft_consensus.cc:515] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.493541  4125 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:14.495898  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.498502  3973 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.496165  4307 leader_election.cc:290] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.497319  4123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:14.502799  4123 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.504356  3941 leader_election.cc:304] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:14.506497  4297 raft_consensus.cc:2804] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.496810  4304 leader_election.cc:290] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.506964  4297 raft_consensus.cc:697] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:14.507804  4297 consensus_queue.cc:237] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.509785  4124 raft_consensus.cc:2468] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:14.511475  4050 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 1.
I20260709 13:14:14.515647  3941 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:14.518275  3973 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:14.518503  4287 raft_consensus.cc:2804] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.518940  4272 tablet_bootstrap.cc:492] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: No bootstrap required, opened a new log
I20260709 13:14:14.519047  4287 raft_consensus.cc:697] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:14.519479  4272 ts_tablet_manager.cc:1403] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.016s
I20260709 13:14:14.519599  4014 leader_election.cc:304] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.519961  4287 consensus_queue.cc:237] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.520561  4304 raft_consensus.cc:2804] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.521238  4304 raft_consensus.cc:697] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:14.522394  4272 raft_consensus.cc:359] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.523201  4272 raft_consensus.cc:385] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:14.523478  4272 raft_consensus.cc:740] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Initialized, Role: FOLLOWER
I20260709 13:14:14.524114  4272 consensus_queue.cc:260] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.522722  4304 consensus_queue.cc:237] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.526288  4272 ts_tablet_manager.cc:1434] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:14.532308  4123 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 1.
I20260709 13:14:14.533008  3872 catalog_manager.cc:5697] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.550549  3871 catalog_manager.cc:5697] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 1 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.560043  3874 catalog_manager.cc:5697] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.579764  4287 consensus_queue.cc:1048] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.589761  4257 consensus_queue.cc:1048] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.621405  4254 consensus_queue.cc:1048] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.631700  4291 consensus_queue.cc:1048] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.706938  4304 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.707471  4304 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.709335  4304 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:14.710234  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.710471  4123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8" is_pre_election: true
I20260709 13:14:14.711234  4123 raft_consensus.cc:2393] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f29b74c47bbe40f58154d9829aea26c5 in current term 1: Already voted for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in this term.
I20260709 13:14:14.712143  4016 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f29b74c47bbe40f58154d9829aea26c5; no voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:14.712793  4304 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.718358  4304 raft_consensus.cc:2749] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:14.757817  4291 raft_consensus.cc:493] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.758502  4291 raft_consensus.cc:515] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.760838  4291 leader_election.cc:290] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.761404  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" is_pre_election: true
I20260709 13:14:14.761862  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5" is_pre_election: true
I20260709 13:14:14.762168  3974 raft_consensus.cc:2468] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.762538  4049 raft_consensus.cc:2468] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 0.
I20260709 13:14:14.763291  4088 leader_election.cc:304] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:14.763989  4291 raft_consensus.cc:2804] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:14.764344  4291 raft_consensus.cc:493] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.764639  4291 raft_consensus.cc:3060] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.769773  4291 raft_consensus.cc:515] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.771435  4291 leader_election.cc:290] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:14.772154  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:14.772439  4049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9655bf75d6a4ac7b72a308be220726f" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:14.772823  3974 raft_consensus.cc:3060] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.773018  4049 raft_consensus.cc:3060] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:14.777716  4291 consensus_queue.cc:1048] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.779824  3974 raft_consensus.cc:2468] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.779824  4049 raft_consensus.cc:2468] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 1.
I20260709 13:14:14.781373  4088 leader_election.cc:304] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:14.782234  4291 raft_consensus.cc:2804] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:14.783392  4291 raft_consensus.cc:697] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:14.784251  4291 consensus_queue.cc:237] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:14.792518  4293 consensus_queue.cc:1048] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.799882  3874 catalog_manager.cc:5697] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 1 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.819958  4304 consensus_queue.cc:1048] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.829936  4306 consensus_queue.cc:1048] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.903159  4257 consensus_queue.cc:1048] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:14.913373  4297 consensus_queue.cc:1048] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.936070  4259 consensus_queue.cc:1048] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.945694  4307 consensus_queue.cc:1048] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.998545  4123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:14.999024  4123 raft_consensus.cc:606] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:15.003584  4123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:15.004027  4123 raft_consensus.cc:606] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:15.011550  4123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
mode: GRACEFUL
new_leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:48730
I20260709 13:14:15.012187  4123 raft_consensus.cc:606] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Received request to transfer leadership to TS 1b15bb7c45f245d58b871b3c18efd0f0
I20260709 13:14:15.021355  3974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:14:15.021802  3974 raft_consensus.cc:606] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Received request to transfer leadership to TS f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:15.026616  3973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49694
I20260709 13:14:15.027174  3973 raft_consensus.cc:606] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Received request to transfer leadership to TS f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:15.088685  4291 raft_consensus.cc:993] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.089221  4254 raft_consensus.cc:1081] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.090705  3973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49688
I20260709 13:14:15.091192  3973 raft_consensus.cc:493] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.091511  3973 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.096846  3973 raft_consensus.cc:515] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.099404  3973 leader_election.cc:290] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:15.099566  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:15.099920  4123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdb3999028444bbb578ba2a94b39c83" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:15.100208  4050 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.100521  4123 raft_consensus.cc:3055] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.100842  4123 raft_consensus.cc:740] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:15.101656  4123 consensus_queue.cc:260] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.102713  4123 raft_consensus.cc:3060] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.106679  4050 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.107323  4049 raft_consensus.cc:1240] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Rejecting Update request from peer 034f0b95d3ba49eaa21942608f6e93d8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:15.107851  3939 leader_election.cc:304] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:15.108783  4287 raft_consensus.cc:2804] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.109259  4287 raft_consensus.cc:697] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:15.109628  4123 raft_consensus.cc:2468] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.110147  4287 consensus_queue.cc:237] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.117111  3872 catalog_manager.cc:5697] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.142724  4257 consensus_queue.cc:1048] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.143353  4287 consensus_queue.cc:1048] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.154817  4287 raft_consensus.cc:993] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:15.156175  4287 raft_consensus.cc:1081] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Signalling peer f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:15.158217  4048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49746
I20260709 13:14:15.161463  4048 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.161864  4048 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.169054  4048 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.172190  4048 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:15.172950  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:15.173380  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fccaf2806dc4b22b0eb9de839adc447" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:15.173652  3973 raft_consensus.cc:3055] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.173870  4124 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.174214  3973 raft_consensus.cc:740] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:15.175096  3973 consensus_queue.cc:260] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.176359  3973 raft_consensus.cc:3060] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.179128  4124 raft_consensus.cc:2468] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:15.180173  4016 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:15.180845  4307 raft_consensus.cc:2804] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.181311  4307 raft_consensus.cc:697] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:15.181634  3973 raft_consensus.cc:2468] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:15.182094  4307 consensus_queue.cc:237] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.188473  3874 catalog_manager.cc:5697] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 1 to 2, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.212862  4293 consensus_queue.cc:1048] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.213657  4254 raft_consensus.cc:993] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.214165  4254 raft_consensus.cc:1081] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.218011  3974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49688
I20260709 13:14:15.218598  3974 raft_consensus.cc:493] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.219038  3974 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.226814  3974 raft_consensus.cc:515] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.227721  4276 consensus_queue.cc:1048] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:15.229532  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:15.230160  4050 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.231832  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fb9e81d8664c878f152efb55a71145" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:15.232446  4124 raft_consensus.cc:3055] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.232709  4124 raft_consensus.cc:740] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:15.233410  4124 consensus_queue.cc:260] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.234424  4124 raft_consensus.cc:3060] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.235594  3974 leader_election.cc:290] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:15.237934  4050 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.239079  3939 leader_election.cc:304] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:15.239878  4257 raft_consensus.cc:2804] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.240326  4257 raft_consensus.cc:697] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:15.241096  4257 consensus_queue.cc:237] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.244059  4124 raft_consensus.cc:2468] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.249058  3871 catalog_manager.cc:5697] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.414919  4254 raft_consensus.cc:993] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: : Instructing follower 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.415400  4276 raft_consensus.cc:1081] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Signalling peer 1b15bb7c45f245d58b871b3c18efd0f0 to start an election
I20260709 13:14:15.416791  3974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
 from {username='slave'} at 127.0.0.1:49688
I20260709 13:14:15.417280  3974 raft_consensus.cc:493] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.417588  3974 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.422757  3974 raft_consensus.cc:515] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.424132  3974 leader_election.cc:290] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Requested vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:15.424983  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:15.425201  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:15.425585  4050 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.425714  4124 raft_consensus.cc:3055] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.426116  4124 raft_consensus.cc:740] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:15.426890  4124 consensus_queue.cc:260] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.428035  4124 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.431851  4050 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.432938  3939 leader_election.cc:304] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:15.433665  4257 raft_consensus.cc:2804] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.434088  4257 raft_consensus.cc:697] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Leader. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:15.434484  4124 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b15bb7c45f245d58b871b3c18efd0f0 in term 2.
I20260709 13:14:15.434903  4257 consensus_queue.cc:237] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.441747  3871 catalog_manager.cc:5697] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 reported cstate change: term changed from 1 to 2, leader changed from 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131) to 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.511358  4297 raft_consensus.cc:993] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:15.511888  4257 raft_consensus.cc:1081] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Signalling peer f29b74c47bbe40f58154d9829aea26c5 to start an election
I20260709 13:14:15.513414  4050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
 from {username='slave'} at 127.0.0.1:49746
I20260709 13:14:15.513921  4050 raft_consensus.cc:493] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:15.514261  4050 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.521602  4050 raft_consensus.cc:515] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.523128  4050 leader_election.cc:290] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131:46085)
I20260709 13:14:15.523945  3974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:15.524132  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96b86b572a4b7b94a8afc282b1f572" candidate_uuid: "f29b74c47bbe40f58154d9829aea26c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
I20260709 13:14:15.524467  3974 raft_consensus.cc:3055] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:15.524700  4124 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.524806  3974 raft_consensus.cc:740] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:15.525508  3974 consensus_queue.cc:260] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.526436  3974 raft_consensus.cc:3060] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:15.529282  4124 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:15.530328  4016 leader_election.cc:304] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:15.530717  3974 raft_consensus.cc:2468] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f29b74c47bbe40f58154d9829aea26c5 in term 2.
I20260709 13:14:15.531081  4307 raft_consensus.cc:2804] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:15.531749  4307 raft_consensus.cc:697] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Leader. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:15.532475  4307 consensus_queue.cc:237] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:15.538331  3871 catalog_manager.cc:5697] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 reported cstate change: term changed from 1 to 2, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130). New cstate: current_term: 2 leader_uuid: "f29b74c47bbe40f58154d9829aea26c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:15.562520  4124 raft_consensus.cc:1275] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.563820  4287 consensus_queue.cc:1048] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.570700  4050 raft_consensus.cc:1275] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.572620  4257 consensus_queue.cc:1048] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.699290  3974 raft_consensus.cc:1275] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.700492  4307 consensus_queue.cc:1048] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.707567  4124 raft_consensus.cc:1275] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.709306  4306 consensus_queue.cc:1048] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.789486  4123 raft_consensus.cc:1275] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.790741  4257 consensus_queue.cc:1048] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.798626  4050 raft_consensus.cc:1275] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.800129  4287 consensus_queue.cc:1048] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:15.918241  4049 raft_consensus.cc:1275] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.921110  4341 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:15.956256  4123 raft_consensus.cc:1275] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer 1b15bb7c45f245d58b871b3c18efd0f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:15.958359  4287 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:16.028307  3975 raft_consensus.cc:1275] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.029896  4304 consensus_queue.cc:1048] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:16.046676  4123 raft_consensus.cc:1275] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Refusing update from remote peer f29b74c47bbe40f58154d9829aea26c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:16.048141  4307 consensus_queue.cc:1048] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:18.033123  3874 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33384:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:18.056120  3874 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33384:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:18.202553 26038 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:18.350821  4397 tablet.cc:1724] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.386940  4399 tablet.cc:1724] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.400098  4394 log.cc:927] Time spent T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:14:18.442179  4405 tablet.cc:1724] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.444164  3939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.130:42181, user_credentials={real_user=slave}} blocked reactor thread for 86807.4us
I20260709 13:14:18.450037  4402 tablet.cc:1724] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.451761  3941 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:46085, user_credentials={real_user=slave}} blocked reactor thread for 90657us
W20260709 13:14:18.490149  4014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:40747, user_credentials={real_user=slave}} blocked reactor thread for 104332us
I20260709 13:14:18.513103  4417 tablet.cc:1724] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.502594  4413 tablet.cc:1724] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.537102  4415 tablet.cc:1724] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.553474  4418 tablet.cc:1724] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.481300  4414 tablet.cc:1724] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.555975  4002 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:07b504be7c994e749542d9c7e1b722f3)
I20260709 13:14:18.556918  4397 tablet.cc:1724] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.569540  4418 tablet.cc:1724] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.574738  4002 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:07b504be7c994e749542d9c7e1b722f3)
I20260709 13:14:18.544739  4412 tablet.cc:1724] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.576704  4002 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:07b504be7c994e749542d9c7e1b722f3)
I20260709 13:14:18.553563  4419 tablet.cc:1724] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.505527  4404 tablet.cc:1724] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.597213  4405 tablet.cc:1724] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.597757  4399 tablet.cc:1724] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.628412  4050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
mode: GRACEFUL
new_leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:36182
I20260709 13:14:18.629140  4050 raft_consensus.cc:606] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Received request to transfer leadership to TS 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:18.640128  4417 tablet.cc:1724] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.642712  4398 raft_consensus.cc:993] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: : Instructing follower 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:18.643234  4398 raft_consensus.cc:1081] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Signalling peer 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:18.646914  4404 tablet.cc:1724] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.650271  4419 tablet.cc:1724] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.654850  4414 tablet.cc:1724] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:18.658572  4014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:40747, user_credentials={real_user=slave}} blocked reactor thread for 147431us
I20260709 13:14:18.660040  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:48724
I20260709 13:14:18.660703  4124 raft_consensus.cc:493] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.661106  4124 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.660770  4418 tablet.cc:1724] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.675766  4415 tablet.cc:1724] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.681833  4419 tablet.cc:1724] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.605718  4413 tablet.cc:1724] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.679383  4399 tablet.cc:1724] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.685842  4124 raft_consensus.cc:515] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:18.691023  4405 tablet.cc:1724] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.703707  4124 leader_election.cc:290] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:18.708384  3973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:18.709064  3973 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.708716  4402 tablet.cc:1724] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:18.718442  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a929a2879c456db879b17ec7d79a41" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:18.719156  4050 raft_consensus.cc:3055] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.719511  4050 raft_consensus.cc:740] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:18.720397  4050 consensus_queue.cc:260] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:18.721823  4050 raft_consensus.cc:3060] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.724642  3976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:35260
I20260709 13:14:18.725294  3976 raft_consensus.cc:606] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Received request to transfer leadership to TS 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:18.726811 26038 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:14:18.727510 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:18.723666  3973 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 2.
I20260709 13:14:18.731953  4088 leader_election.cc:304] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:18.732931  4393 raft_consensus.cc:2804] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.733385  4393 raft_consensus.cc:697] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:18.734330  4393 consensus_queue.cc:237] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:18.738497  3976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083"
dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
mode: GRACEFUL
new_leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:35260
I20260709 13:14:18.739126  3976 raft_consensus.cc:606] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Received request to transfer leadership to TS 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:18.739271  4050 raft_consensus.cc:2468] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 2.
I20260709 13:14:18.742480  4050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300"
dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
mode: GRACEFUL
new_leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:36182
I20260709 13:14:18.743115  4050 raft_consensus.cc:606] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Received request to transfer leadership to TS 034f0b95d3ba49eaa21942608f6e93d8
I20260709 13:14:18.745237 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:18.745976 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:18.749146  3873 catalog_manager.cc:5697] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 1 to 2, leader changed from f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130) to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 2 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.758699  3871 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: soft_deleted_table [id=4f78389cc1bd4448a862f601997b5212] alter complete (version 1)
I20260709 13:14:19.029033  4407 raft_consensus.cc:993] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.029590  4351 raft_consensus.cc:1081] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Signalling peer 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.031183  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:14:19.031631  4124 raft_consensus.cc:493] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.031867  4124 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.036369  4124 raft_consensus.cc:515] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.037663  4124 leader_election.cc:290] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:19.038405  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:19.038714  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "228e971277ae44eaa6e831fe3976cbbf" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:19.039029  3976 raft_consensus.cc:3055] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:19.039317  4050 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.039422  3976 raft_consensus.cc:740] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:19.040230  3976 consensus_queue.cc:260] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.041178  3976 raft_consensus.cc:3060] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.044037  4050 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.045109  4088 leader_election.cc:304] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:19.045846  4393 raft_consensus.cc:2804] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:19.046252  4393 raft_consensus.cc:697] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:19.047351  3976 raft_consensus.cc:2468] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.047116  4393 consensus_queue.cc:237] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.054311  3871 catalog_manager.cc:5697] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 2 to 3, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.075263  4387 raft_consensus.cc:993] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: : Instructing follower 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.075847  4424 raft_consensus.cc:1081] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Signalling peer 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.077095  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:48724
I20260709 13:14:19.077472  4124 raft_consensus.cc:493] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.077684  4124 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.082147  4124 raft_consensus.cc:515] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.083442  4124 leader_election.cc:290] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:19.084141  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:19.084842  3976 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.086258  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c318fc62a90947a6a6c6a0c28973c300" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:19.086908  4050 raft_consensus.cc:3055] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:19.087713  4050 raft_consensus.cc:740] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f29b74c47bbe40f58154d9829aea26c5, State: Running, Role: LEADER
I20260709 13:14:19.088536  4050 consensus_queue.cc:260] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.089772  4050 raft_consensus.cc:3060] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.092157  3976 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.093385  4088 leader_election.cc:304] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, 1b15bb7c45f245d58b871b3c18efd0f0; no voters: 
I20260709 13:14:19.094135  4393 raft_consensus.cc:2804] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:19.094527  4393 raft_consensus.cc:697] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:19.095366  4393 consensus_queue.cc:237] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.095726  4050 raft_consensus.cc:2468] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.102869  3871 catalog_manager.cc:5697] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 2 to 3, leader changed from f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130) to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.135746  3976 raft_consensus.cc:1275] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.136916  4393 consensus_queue.cc:1048] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.145407  4050 raft_consensus.cc:1275] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:19.147487  4393 consensus_queue.cc:1048] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.153093  4407 raft_consensus.cc:993] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: : Instructing follower 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.153594  4407 raft_consensus.cc:1081] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Signalling peer 034f0b95d3ba49eaa21942608f6e93d8 to start an election
I20260709 13:14:19.155310  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083"
dest_uuid: "034f0b95d3ba49eaa21942608f6e93d8"
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:14:19.155808  4124 raft_consensus.cc:493] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:19.156134  4124 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.162756  4124 raft_consensus.cc:515] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.165061  4124 leader_election.cc:290] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Requested vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:19.165226  3976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b15bb7c45f245d58b871b3c18efd0f0"
I20260709 13:14:19.165907  3976 raft_consensus.cc:3055] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:19.166131  4050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52469fa168c8420ab3e845f56dbac083" candidate_uuid: "034f0b95d3ba49eaa21942608f6e93d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f29b74c47bbe40f58154d9829aea26c5"
I20260709 13:14:19.166311  3976 raft_consensus.cc:740] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b15bb7c45f245d58b871b3c18efd0f0, State: Running, Role: LEADER
I20260709 13:14:19.166751  4050 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.167202  3976 consensus_queue.cc:260] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.168653  3976 raft_consensus.cc:3060] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:19.173650  4050 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.174868  4088 leader_election.cc:304] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8, f29b74c47bbe40f58154d9829aea26c5; no voters: 
I20260709 13:14:19.175335  3976 raft_consensus.cc:2468] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034f0b95d3ba49eaa21942608f6e93d8 in term 3.
I20260709 13:14:19.175527  4393 raft_consensus.cc:2804] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:19.176112  4393 raft_consensus.cc:697] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Becoming Leader. State: Replica: 034f0b95d3ba49eaa21942608f6e93d8, State: Running, Role: LEADER
I20260709 13:14:19.176975  4393 consensus_queue.cc:237] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:19.184470  3873 catalog_manager.cc:5697] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 reported cstate change: term changed from 2 to 3, leader changed from 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129) to 034f0b95d3ba49eaa21942608f6e93d8 (127.25.109.131). New cstate: current_term: 3 leader_uuid: "034f0b95d3ba49eaa21942608f6e93d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:19.436599  4048 raft_consensus.cc:1275] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:19.437815  4393 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:19.446616  3976 raft_consensus.cc:1275] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:19.448156  4435 consensus_queue.cc:1048] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:19.480352  3976 raft_consensus.cc:1275] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.481494  4393 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.490001  4050 raft_consensus.cc:1275] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.492075  4393 consensus_queue.cc:1048] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.618693  3973 raft_consensus.cc:1275] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.619782  4431 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.628259  4050 raft_consensus.cc:1275] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Refusing update from remote peer 034f0b95d3ba49eaa21942608f6e93d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.630297  4343 consensus_queue.cc:1048] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.800638 26038 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:19.805639 26038 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:14:19.806063 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:19.811820 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:14:19.812188 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:20.838999 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
W20260709 13:14:20.851840  4088 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:14:20.859411  4088 consensus_peers.cc:597] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.871589 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:20.872427 26038 tablet_replica.cc:333] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.873268 26038 raft_consensus.cc:2243] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.873775 26038 raft_consensus.cc:2272] T e9655bf75d6a4ac7b72a308be220726f P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.875975 26038 tablet_replica.cc:333] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.876559 26038 raft_consensus.cc:2243] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.877017 26038 raft_consensus.cc:2272] T 16a929a2879c456db879b17ec7d79a41 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.879098 26038 tablet_replica.cc:333] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.879608 26038 raft_consensus.cc:2243] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.880038 26038 raft_consensus.cc:2272] T f98fe1776e9b46f6a1d9b724a4275cdb P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.882148 26038 tablet_replica.cc:333] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.882658 26038 raft_consensus.cc:2243] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.883417 26038 raft_consensus.cc:2272] T 07b504be7c994e749542d9c7e1b722f3 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.885427 26038 tablet_replica.cc:333] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.885994 26038 raft_consensus.cc:2243] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.886498 26038 raft_consensus.cc:2272] T c318fc62a90947a6a6c6a0c28973c300 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.888429 26038 tablet_replica.cc:333] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.888984 26038 raft_consensus.cc:2243] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.889763 26038 raft_consensus.cc:2272] T 63fb9e81d8664c878f152efb55a71145 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.891781 26038 tablet_replica.cc:333] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.892335 26038 raft_consensus.cc:2243] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.893055 26038 raft_consensus.cc:2272] T 4bdb3999028444bbb578ba2a94b39c83 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.895120 26038 tablet_replica.cc:333] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.895642 26038 raft_consensus.cc:2243] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.896126 26038 raft_consensus.cc:2272] T 31d47ea6164541779c7cd43f9b5d5d0b P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.898322 26038 tablet_replica.cc:333] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.898942 26038 raft_consensus.cc:2243] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.899497 26038 raft_consensus.cc:2272] T 280f007a6e9a48d8bb26cacd34bc6455 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:20.901218  4088 consensus_peers.cc:597] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.902101 26038 tablet_replica.cc:333] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.902755 26038 raft_consensus.cc:2243] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.903200 26038 raft_consensus.cc:2272] T 2a96b86b572a4b7b94a8afc282b1f572 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.905220 26038 tablet_replica.cc:333] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.905771 26038 raft_consensus.cc:2243] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.906629 26038 raft_consensus.cc:2272] T c1d46236e6f9429c88f10fe145aca950 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.909166 26038 tablet_replica.cc:333] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.909912 26038 raft_consensus.cc:2243] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.910418 26038 raft_consensus.cc:2272] T 52469fa168c8420ab3e845f56dbac083 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.913170 26038 tablet_replica.cc:333] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.913952 26038 raft_consensus.cc:2243] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.914559 26038 raft_consensus.cc:2272] T d15ba6c64bdb445b9046dc9c385bd635 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.917366 26038 tablet_replica.cc:333] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.918093 26038 raft_consensus.cc:2243] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.918494 26038 raft_consensus.cc:2272] T 7fccaf2806dc4b22b0eb9de839adc447 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.920495 26038 tablet_replica.cc:333] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.921001 26038 raft_consensus.cc:2243] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.921798 26038 raft_consensus.cc:2272] T a8d1c32f6a8f4bbaa00e62fef68729bf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.924443 26038 tablet_replica.cc:333] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.925143 26038 raft_consensus.cc:2243] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.925624 26038 raft_consensus.cc:2272] T 228e971277ae44eaa6e831fe3976cbbf P 1b15bb7c45f245d58b871b3c18efd0f0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:20.925896  4014 consensus_peers.cc:597] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:20.927784 26038 tablet_replica.cc:333] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.928520 26038 raft_consensus.cc:2243] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:20.929008 26038 raft_consensus.cc:2272] T 72433f25175d4b4bb0185709b4ca3912 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.931195 26038 tablet_replica.cc:333] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0: stopping tablet replica
I20260709 13:14:20.931730 26038 raft_consensus.cc:2243] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:20.932463 26038 raft_consensus.cc:2272] T fa54490e4f5e4c92870ec04d807486f7 P 1b15bb7c45f245d58b871b3c18efd0f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:20.971787 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
W20260709 13:14:21.003302  4014 consensus_peers.cc:597] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.012092 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:14:21.020033  4088 consensus_peers.cc:597] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:21.044387  4088 consensus_peers.cc:597] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:21.086484  4088 consensus_peers.cc:597] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.163184 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:21.165827  4014 consensus_peers.cc:597] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.166149 26038 tablet_replica.cc:333] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
W20260709 13:14:21.166406  4014 consensus_peers.cc:597] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.167179 26038 raft_consensus.cc:2243] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.167819 26038 raft_consensus.cc:2272] T e9655bf75d6a4ac7b72a308be220726f P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:21.169426  4088 consensus_peers.cc:597] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.170607 26038 tablet_replica.cc:333] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
W20260709 13:14:21.170727  4088 consensus_peers.cc:597] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:21.171345  4088 consensus_peers.cc:597] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.171695 26038 raft_consensus.cc:2243] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:21.171726  4088 consensus_peers.cc:597] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.172300 26038 raft_consensus.cc:2272] T 16a929a2879c456db879b17ec7d79a41 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.174623 26038 tablet_replica.cc:333] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.175294 26038 raft_consensus.cc:2243] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.175731 26038 raft_consensus.cc:2272] T 63fb9e81d8664c878f152efb55a71145 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.177667 26038 tablet_replica.cc:333] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.178280 26038 raft_consensus.cc:2243] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.178689 26038 raft_consensus.cc:2272] T 4bdb3999028444bbb578ba2a94b39c83 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.180550 26038 tablet_replica.cc:333] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.181082 26038 raft_consensus.cc:2243] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.181846 26038 raft_consensus.cc:2272] T f98fe1776e9b46f6a1d9b724a4275cdb P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.183787 26038 tablet_replica.cc:333] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.184351 26038 raft_consensus.cc:2243] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.184760 26038 raft_consensus.cc:2272] T 07b504be7c994e749542d9c7e1b722f3 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.186657 26038 tablet_replica.cc:333] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.187245 26038 raft_consensus.cc:2243] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.187637 26038 raft_consensus.cc:2272] T fa54490e4f5e4c92870ec04d807486f7 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.189589 26038 tablet_replica.cc:333] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.190171 26038 raft_consensus.cc:2243] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.190570 26038 raft_consensus.cc:2272] T c318fc62a90947a6a6c6a0c28973c300 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.192528 26038 tablet_replica.cc:333] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.193071 26038 raft_consensus.cc:2243] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.193868 26038 raft_consensus.cc:2272] T 280f007a6e9a48d8bb26cacd34bc6455 P f29b74c47bbe40f58154d9829aea26c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.195930 26038 tablet_replica.cc:333] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.196468 26038 raft_consensus.cc:2243] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.196878 26038 raft_consensus.cc:2272] T 52469fa168c8420ab3e845f56dbac083 P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.198825 26038 tablet_replica.cc:333] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.199399 26038 raft_consensus.cc:2243] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.200165 26038 raft_consensus.cc:2272] T 7fccaf2806dc4b22b0eb9de839adc447 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.201985 26038 tablet_replica.cc:333] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.202533 26038 raft_consensus.cc:2243] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.202936 26038 raft_consensus.cc:2272] T a8d1c32f6a8f4bbaa00e62fef68729bf P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.204936 26038 tablet_replica.cc:333] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.205422 26038 raft_consensus.cc:2243] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.206192 26038 raft_consensus.cc:2272] T d15ba6c64bdb445b9046dc9c385bd635 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.209121 26038 tablet_replica.cc:333] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.209931 26038 raft_consensus.cc:2243] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.211081 26038 raft_consensus.cc:2272] T 31d47ea6164541779c7cd43f9b5d5d0b P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:21.211792  4088 consensus_peers.cc:597] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.213395 26038 tablet_replica.cc:333] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.214018 26038 raft_consensus.cc:2243] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.214550 26038 raft_consensus.cc:2272] T 228e971277ae44eaa6e831fe3976cbbf P f29b74c47bbe40f58154d9829aea26c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.216538 26038 tablet_replica.cc:333] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.217036 26038 raft_consensus.cc:2243] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.217849 26038 raft_consensus.cc:2272] T 72433f25175d4b4bb0185709b4ca3912 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.220000 26038 tablet_replica.cc:333] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.220522 26038 raft_consensus.cc:2243] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:21.221253 26038 raft_consensus.cc:2272] T 2a96b86b572a4b7b94a8afc282b1f572 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.223135 26038 tablet_replica.cc:333] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5: stopping tablet replica
I20260709 13:14:21.223613 26038 raft_consensus.cc:2243] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.224048 26038 raft_consensus.cc:2272] T c1d46236e6f9429c88f10fe145aca950 P f29b74c47bbe40f58154d9829aea26c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:21.251463  4088 consensus_peers.cc:597] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:21.325232  4088 consensus_peers.cc:597] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:21.974566  4446 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:21.975116  4446 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:21.976845  4446 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:21.981113  4088 leader_election.cc:336] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:21.981653  4088 leader_election.cc:336] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:21.981956  4088 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:21.982586  4446 raft_consensus.cc:2749] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:22.014336  4449 raft_consensus.cc:493] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:22.014943  4449 raft_consensus.cc:515] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.017100  4449 leader_election.cc:290] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.020493  4088 leader_election.cc:336] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.021140  4088 leader_election.cc:336] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.021404  4088 leader_election.cc:304] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.021888  4449 raft_consensus.cc:2749] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:22.115418  4072 debug-util.cc:398] Leaking SignalData structure 0x7b080005cde0 after lost signal to thread 26041
W20260709 13:14:22.116488  4072 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9400 after lost signal to thread 3908
W20260709 13:14:22.117807  4072 debug-util.cc:398] Leaking SignalData structure 0x7b0800283a40 after lost signal to thread 4149
I20260709 13:14:22.212168  4449 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:22.212759  4449 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:22.214581  4449 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
W20260709 13:14:22.218577  4088 leader_election.cc:336] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
W20260709 13:14:22.219322  4088 leader_election.cc:336] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
I20260709 13:14:22.219744  4088 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.220420  4449 raft_consensus.cc:2749] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:22.245436  4449 raft_consensus.cc:493] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:22.245980  4449 raft_consensus.cc:515] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.247910  4449 leader_election.cc:290] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.253404  4088 leader_election.cc:336] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.254473  4088 leader_election.cc:336] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.254842  4088 leader_election.cc:304] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.255452  4446 raft_consensus.cc:2749] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:22.265005 26038 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4072)
I20260709 13:14:22.278973  4446 raft_consensus.cc:493] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:22.279575  4446 raft_consensus.cc:515] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.281538  4446 leader_election.cc:290] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.286010  4088 leader_election.cc:336] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.286806  4088 leader_election.cc:336] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.287039  4446 raft_consensus.cc:493] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:22.287262  4088 leader_election.cc:304] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.287616  4446 raft_consensus.cc:515] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.288604  4447 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.288070  4449 raft_consensus.cc:2749] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:22.289124  4447 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.289780  4446 leader_election.cc:290] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:22.291143  4447 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.293742  4088 leader_election.cc:336] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.296195  4088 leader_election.cc:336] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.296590  4088 leader_election.cc:304] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.297191  4447 raft_consensus.cc:2749] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:22.297353  4088 leader_election.cc:336] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
W20260709 13:14:22.298120  4088 leader_election.cc:336] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
I20260709 13:14:22.298434  4088 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.298961  4447 raft_consensus.cc:2749] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:22.310988  4447 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.311421  4447 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.313160  4447 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.316879  4088 leader_election.cc:336] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.317663  4088 leader_election.cc:336] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.318027  4088 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.318748  4447 raft_consensus.cc:2749] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:22.358031  4447 raft_consensus.cc:493] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.358681  4447 raft_consensus.cc:515] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.361092  4447 leader_election.cc:290] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.365303  4088 leader_election.cc:336] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.366125  4088 leader_election.cc:336] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.366436  4088 leader_election.cc:304] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.367036  4447 raft_consensus.cc:2749] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:22.493449  4447 raft_consensus.cc:493] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.494035  4447 raft_consensus.cc:515] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.496312  4447 leader_election.cc:290] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.500358  4088 leader_election.cc:336] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.500954  4088 leader_election.cc:336] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.501266  4088 leader_election.cc:304] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.501809  4447 raft_consensus.cc:2749] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:22.662720  4447 raft_consensus.cc:493] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.663268  4447 raft_consensus.cc:515] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.663695  4446 raft_consensus.cc:493] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:22.664328  4446 raft_consensus.cc:515] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:22.665313  4447 leader_election.cc:290] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:22.666429  4446 leader_election.cc:290] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:22.670352  4088 leader_election.cc:336] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.670837  4088 leader_election.cc:336] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:22.671372  4088 leader_election.cc:336] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.671665  4088 leader_election.cc:304] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
W20260709 13:14:22.672264  4088 leader_election.cc:336] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:22.672224  4446 raft_consensus.cc:2749] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:22.672749  4088 leader_election.cc:304] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:22.673420  4446 raft_consensus.cc:2749] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:23.265533 26038 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4072)
W20260709 13:14:23.339176  4088 consensus_peers.cc:597] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.393177  4088 consensus_peers.cc:597] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.437469  4088 consensus_peers.cc:597] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.449144  4088 consensus_peers.cc:597] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.481237  4088 consensus_peers.cc:597] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.556213  4088 consensus_peers.cc:597] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.558610  4088 consensus_peers.cc:597] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.591868  4088 consensus_peers.cc:597] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.726410  4088 consensus_peers.cc:597] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.728902  4088 consensus_peers.cc:597] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Couldn't send request to peer 1b15bb7c45f245d58b871b3c18efd0f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:23.811906  4088 consensus_peers.cc:597] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:23.822661  4446 raft_consensus.cc:493] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:23.823119  4446 raft_consensus.cc:515] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.826550  4446 leader_election.cc:290] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:23.831482  4088 leader_election.cc:336] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:23.832197  4088 leader_election.cc:336] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:23.832646  4088 leader_election.cc:304] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:23.833415  4451 raft_consensus.cc:2749] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:23.876513  4451 raft_consensus.cc:493] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:23.877043  4451 raft_consensus.cc:515] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } } peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } }
I20260709 13:14:23.878562  4446 raft_consensus.cc:493] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:23.879221  4446 raft_consensus.cc:515] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.879006  4451 leader_election.cc:290] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181), 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747)
I20260709 13:14:23.881426  4446 leader_election.cc:290] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:23.883339  4088 leader_election.cc:336] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:23.884263  4088 leader_election.cc:336] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:23.884668  4088 leader_election.cc:304] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:23.885249  4446 raft_consensus.cc:2749] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:23.887226  4088 leader_election.cc:336] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
I20260709 13:14:23.887473  4446 raft_consensus.cc:493] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
W20260709 13:14:23.887863  4088 leader_election.cc:336] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:23.888258  4088 leader_election.cc:304] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:23.888075  4446 raft_consensus.cc:515] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.888839  4451 raft_consensus.cc:2749] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:23.890388  4446 leader_election.cc:290] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:23.894021  4088 leader_election.cc:336] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:23.894688  4088 leader_election.cc:336] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:23.895004  4088 leader_election.cc:304] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:23.895542  4446 raft_consensus.cc:2749] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:23.926924  4446 raft_consensus.cc:493] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:23.927654  4446 raft_consensus.cc:515] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.929981  4446 leader_election.cc:290] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:23.934083  4088 leader_election.cc:336] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:23.934732  4088 leader_election.cc:336] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:23.935037  4088 leader_election.cc:304] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:23.935606  4446 raft_consensus.cc:2749] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:23.967796  4088 consensus_peers.cc:597] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 -> Peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Couldn't send request to peer f29b74c47bbe40f58154d9829aea26c5. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:23.991906  4446 raft_consensus.cc:493] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:23.992583  4446 raft_consensus.cc:515] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.994819  4446 leader_election.cc:290] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
I20260709 13:14:23.995385  4446 raft_consensus.cc:493] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:23.996606  4446 raft_consensus.cc:515] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:23.998605  4446 leader_election.cc:290] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.000447  4088 leader_election.cc:336] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.001366  4088 leader_election.cc:336] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.001763  4088 leader_election.cc:304] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.002455  4446 raft_consensus.cc:2749] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:24.004367  4088 leader_election.cc:336] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.005416  4088 leader_election.cc:336] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.005831  4088 leader_election.cc:304] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.006579  4446 raft_consensus.cc:2749] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:24.007102  4451 raft_consensus.cc:493] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:24.008270  4451 raft_consensus.cc:515] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:24.010074  4451 leader_election.cc:290] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.013613  4088 leader_election.cc:336] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.014303  4088 leader_election.cc:336] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.014699  4088 leader_election.cc:304] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.015381  4451 raft_consensus.cc:2749] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:24.164026  4451 raft_consensus.cc:493] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:24.164520  4451 raft_consensus.cc:515] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:24.166447  4451 leader_election.cc:290] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.171912  4088 leader_election.cc:336] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.172899  4088 leader_election.cc:336] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.173293  4088 leader_election.cc:304] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.174007  4451 raft_consensus.cc:2749] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:24.266023 26038 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4072)
I20260709 13:14:24.459226  4451 raft_consensus.cc:493] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1b15bb7c45f245d58b871b3c18efd0f0)
I20260709 13:14:24.459877  4451 raft_consensus.cc:515] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:24.461484  4451 leader_election.cc:290] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.465227  4088 leader_election.cc:336] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.465912  4088 leader_election.cc:336] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.466361  4088 leader_election.cc:304] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.467056  4451 raft_consensus.cc:2749] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:24.689002  4451 raft_consensus.cc:493] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:24.689581  4451 raft_consensus.cc:515] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:24.690759  4452 raft_consensus.cc:493] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f29b74c47bbe40f58154d9829aea26c5)
I20260709 13:14:24.691255  4452 raft_consensus.cc:515] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b15bb7c45f245d58b871b3c18efd0f0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 40747 } } peers { permanent_uuid: "f29b74c47bbe40f58154d9829aea26c5" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42181 } } peers { permanent_uuid: "034f0b95d3ba49eaa21942608f6e93d8" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 46085 } }
I20260709 13:14:24.693255  4452 leader_election.cc:290] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.697304  4088 leader_election.cc:336] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
I20260709 13:14:24.691931  4451 leader_election.cc:290] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747), f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181)
W20260709 13:14:24.697767  4088 leader_election.cc:336] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b15bb7c45f245d58b871b3c18efd0f0 (127.25.109.129:40747): Network error: Client connection negotiation failed: client connection to 127.25.109.129:40747: connect: Connection refused (error 111)
W20260709 13:14:24.698390  4088 leader_election.cc:336] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.698688  4088 leader_election.cc:304] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.699218  4451 raft_consensus.cc:2749] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:24.699393  4088 leader_election.cc:336] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f29b74c47bbe40f58154d9829aea26c5 (127.25.109.130:42181): Network error: Client connection negotiation failed: client connection to 127.25.109.130:42181: connect: Connection refused (error 111)
I20260709 13:14:24.699867  4088 leader_election.cc:304] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034f0b95d3ba49eaa21942608f6e93d8; no voters: 1b15bb7c45f245d58b871b3c18efd0f0, f29b74c47bbe40f58154d9829aea26c5
I20260709 13:14:24.700440  4451 raft_consensus.cc:2749] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:24.956441 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
I20260709 13:14:24.993289 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
I20260709 13:14:25.024788 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:25.025620 26038 tablet_replica.cc:333] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.026796 26038 raft_consensus.cc:2243] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.027815 26038 raft_consensus.cc:2272] T e9655bf75d6a4ac7b72a308be220726f P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.029922 26038 tablet_replica.cc:333] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.030530 26038 raft_consensus.cc:2243] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.031490 26038 raft_consensus.cc:2272] T 16a929a2879c456db879b17ec7d79a41 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.033703 26038 tablet_replica.cc:333] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.034289 26038 raft_consensus.cc:2243] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.034709 26038 raft_consensus.cc:2272] T 63fb9e81d8664c878f152efb55a71145 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.036438 26038 tablet_replica.cc:333] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.036882 26038 raft_consensus.cc:2243] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.037247 26038 raft_consensus.cc:2272] T 4bdb3999028444bbb578ba2a94b39c83 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.039038 26038 tablet_replica.cc:333] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.039517 26038 raft_consensus.cc:2243] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.039860 26038 raft_consensus.cc:2272] T f98fe1776e9b46f6a1d9b724a4275cdb P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.041549 26038 tablet_replica.cc:333] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.042008 26038 raft_consensus.cc:2243] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.042479 26038 raft_consensus.cc:2272] T 07b504be7c994e749542d9c7e1b722f3 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.044174 26038 tablet_replica.cc:333] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.044651 26038 raft_consensus.cc:2243] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.045001 26038 raft_consensus.cc:2272] T 280f007a6e9a48d8bb26cacd34bc6455 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.046923 26038 tablet_replica.cc:333] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.047437 26038 raft_consensus.cc:2243] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.047806 26038 raft_consensus.cc:2272] T 31d47ea6164541779c7cd43f9b5d5d0b P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.049685 26038 tablet_replica.cc:333] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.050204 26038 raft_consensus.cc:2243] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.050576 26038 raft_consensus.cc:2272] T fa54490e4f5e4c92870ec04d807486f7 P 034f0b95d3ba49eaa21942608f6e93d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.052592 26038 tablet_replica.cc:333] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.053081 26038 raft_consensus.cc:2243] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.053772 26038 raft_consensus.cc:2272] T 228e971277ae44eaa6e831fe3976cbbf P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.055667 26038 tablet_replica.cc:333] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.056116 26038 raft_consensus.cc:2243] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.056493 26038 raft_consensus.cc:2272] T 72433f25175d4b4bb0185709b4ca3912 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.058439 26038 tablet_replica.cc:333] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.058883 26038 raft_consensus.cc:2243] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.059552 26038 raft_consensus.cc:2272] T c318fc62a90947a6a6c6a0c28973c300 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.061511 26038 tablet_replica.cc:333] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.061965 26038 raft_consensus.cc:2243] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.062616 26038 raft_consensus.cc:2272] T 52469fa168c8420ab3e845f56dbac083 P 034f0b95d3ba49eaa21942608f6e93d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.064379 26038 tablet_replica.cc:333] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.064790 26038 raft_consensus.cc:2243] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.065495 26038 raft_consensus.cc:2272] T d15ba6c64bdb445b9046dc9c385bd635 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.067397 26038 tablet_replica.cc:333] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.067837 26038 raft_consensus.cc:2243] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.068190 26038 raft_consensus.cc:2272] T 7fccaf2806dc4b22b0eb9de839adc447 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.070155 26038 tablet_replica.cc:333] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.070621 26038 raft_consensus.cc:2243] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.070993 26038 raft_consensus.cc:2272] T a8d1c32f6a8f4bbaa00e62fef68729bf P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.072803 26038 tablet_replica.cc:333] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.073195 26038 raft_consensus.cc:2243] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.073542 26038 raft_consensus.cc:2272] T 2a96b86b572a4b7b94a8afc282b1f572 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.075443 26038 tablet_replica.cc:333] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8: stopping tablet replica
I20260709 13:14:25.075826 26038 raft_consensus.cc:2243] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.076190 26038 raft_consensus.cc:2272] T c1d46236e6f9429c88f10fe145aca950 P 034f0b95d3ba49eaa21942608f6e93d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.115794 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:14:25.148237 26038 master.cc:562] Master@127.25.109.190:36929 shutting down...
I20260709 13:14:25.169834 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:25.170429 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.170724 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6bd21b9850e744609812a75dddec70fb: stopping tablet replica
I20260709 13:14:25.190989 26038 master.cc:584] Master@127.25.109.190:36929 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (16557 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:14:25.241369 26038 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.109.190:45925
I20260709 13:14:25.242445 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:25.248157  4453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.248207  4454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.249051  4456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:25.250281 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:25.251322 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:25.251506 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:25.251693 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602865251661 us; error 0 us; skew 500 ppm
I20260709 13:14:25.252205 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:25.254555 26038 webserver.cc:533] Webserver started at http://127.25.109.190:33245/ using document root <none> and password file <none>
I20260709 13:14:25.255039 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:25.255213 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:25.255483 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:25.256503 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/master-0-root/instance:
uuid: "b08047cc327d48aa8977f284f27e1e45"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.260993 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:25.264160  4461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.264843 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:25.265133 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/master-0-root
uuid: "b08047cc327d48aa8977f284f27e1e45"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.265426 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:25.281827 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:25.283013 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:25.320948 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.190:45925
I20260709 13:14:25.321069  4512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.190:45925 every 8 connection(s)
I20260709 13:14:25.324822  4513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.335556  4513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: Bootstrap starting.
I20260709 13:14:25.340195  4513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.344285  4513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: No bootstrap required, opened a new log
I20260709 13:14:25.346374  4513 raft_consensus.cc:359] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER }
I20260709 13:14:25.346743  4513 raft_consensus.cc:385] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:25.346916  4513 raft_consensus.cc:740] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b08047cc327d48aa8977f284f27e1e45, State: Initialized, Role: FOLLOWER
I20260709 13:14:25.347411  4513 consensus_queue.cc:260] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER }
I20260709 13:14:25.347788  4513 raft_consensus.cc:399] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:25.347972  4513 raft_consensus.cc:493] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:25.348173  4513 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:25.352772  4513 raft_consensus.cc:515] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER }
I20260709 13:14:25.353216  4513 leader_election.cc:304] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b08047cc327d48aa8977f284f27e1e45; no voters: 
I20260709 13:14:25.354380  4513 leader_election.cc:290] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:25.354710  4516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:25.356051  4516 raft_consensus.cc:697] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 1 LEADER]: Becoming Leader. State: Replica: b08047cc327d48aa8977f284f27e1e45, State: Running, Role: LEADER
I20260709 13:14:25.356720  4516 consensus_queue.cc:237] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER }
I20260709 13:14:25.357347  4513 sys_catalog.cc:565] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:25.361392  4517 sys_catalog.cc:455] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b08047cc327d48aa8977f284f27e1e45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER } }
I20260709 13:14:25.361939  4518 sys_catalog.cc:455] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b08047cc327d48aa8977f284f27e1e45. Latest consensus state: current_term: 1 leader_uuid: "b08047cc327d48aa8977f284f27e1e45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b08047cc327d48aa8977f284f27e1e45" member_type: VOTER } }
I20260709 13:14:25.362294  4517 sys_catalog.cc:458] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:25.362762  4518 sys_catalog.cc:458] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:25.368386  4523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:25.376897  4523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:25.378129 26038 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:25.385517  4523 catalog_manager.cc:1383] Generated new cluster ID: 17c52e17e9b343f8b84485ed219eea8d
I20260709 13:14:25.385825  4523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:25.406791  4523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:25.408054  4523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:25.423698  4523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: Generated new TSK 0
I20260709 13:14:25.424299  4523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:25.444675 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:25.450578  4534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.451728  4535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.453117  4537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:25.454149 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:25.455037 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:25.455261 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:25.455431 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602865455409 us; error 0 us; skew 500 ppm
I20260709 13:14:25.455932 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:25.458120 26038 webserver.cc:533] Webserver started at http://127.25.109.129:32771/ using document root <none> and password file <none>
I20260709 13:14:25.458577 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:25.458772 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:25.459038 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:25.460130 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-0-root/instance:
uuid: "48d4eb2cd6774ac2968ff250380b99c0"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.464427 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:25.467636  4542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.468410 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:25.468720 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-0-root
uuid: "48d4eb2cd6774ac2968ff250380b99c0"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.469098 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:25.493007 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:25.494262 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:25.495752 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:25.497984 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:25.498217 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.498466 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:25.498668 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.539014 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.129:37037
I20260709 13:14:25.539139  4604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.129:37037 every 8 connection(s)
I20260709 13:14:25.544075 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:25.551116  4609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.552034  4610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.556905  4612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:25.556962 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:25.557699  4605 heartbeater.cc:344] Connected to a master server at 127.25.109.190:45925
I20260709 13:14:25.558176  4605 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:25.559141  4605 heartbeater.cc:507] Master 127.25.109.190:45925 requested a full tablet report, sending...
I20260709 13:14:25.559304 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:25.559620 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:25.559815 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602865559796 us; error 0 us; skew 500 ppm
I20260709 13:14:25.560597 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:25.561584  4478 ts_manager.cc:194] Registered new tserver with Master: 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037)
I20260709 13:14:25.563393 26038 webserver.cc:533] Webserver started at http://127.25.109.130:46697/ using document root <none> and password file <none>
I20260709 13:14:25.564060 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:25.564352 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:25.564273  4478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58624
I20260709 13:14:25.564841 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:25.566407 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-1-root/instance:
uuid: "88a71168b69a4586a29ac25e6f7eb43f"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.570905 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:25.574272  4617 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.575037 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:14:25.575366 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-1-root
uuid: "88a71168b69a4586a29ac25e6f7eb43f"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.575672 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:25.613983 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:25.615254 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:25.616681 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:25.618918 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:25.619146 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.619379 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:25.619544 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.659237 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.130:42709
I20260709 13:14:25.659417  4679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.130:42709 every 8 connection(s)
I20260709 13:14:25.664033 26038 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:25.671332  4683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.672860  4684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:25.675760  4686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:25.677273  4680 heartbeater.cc:344] Connected to a master server at 127.25.109.190:45925
I20260709 13:14:25.677747  4680 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:25.678514  4680 heartbeater.cc:507] Master 127.25.109.190:45925 requested a full tablet report, sending...
I20260709 13:14:25.680673  4478 ts_manager.cc:194] Registered new tserver with Master: 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:25.681068 26038 server_base.cc:1061] running on GCE node
I20260709 13:14:25.682256 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:25.682549 26038 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:25.682662  4478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58634
I20260709 13:14:25.682770 26038 hybrid_clock.cc:648] HybridClock initialized: now 1783602865682751 us; error 0 us; skew 500 ppm
I20260709 13:14:25.683677 26038 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:25.686290 26038 webserver.cc:533] Webserver started at http://127.25.109.131:37839/ using document root <none> and password file <none>
I20260709 13:14:25.686724 26038 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:25.686875 26038 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:25.687075 26038 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:25.688126 26038 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-2-root/instance:
uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.692391 26038 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:14:25.695685  4691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.696439 26038 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:25.696763 26038 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-2-root
uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
format_stamp: "Formatted at 2026-07-09 13:14:25 on dist-test-slave-zhdc"
I20260709 13:14:25.697052 26038 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyvKncg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602565988209-26038-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:25.710686 26038 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:25.711901 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:25.713313 26038 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:25.715507 26038 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:25.715734 26038 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.715965 26038 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:25.716132 26038 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:25.755147 26038 rpc_server.cc:307] RPC server started. Bound to: 127.25.109.131:35599
I20260709 13:14:25.755252  4753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.109.131:35599 every 8 connection(s)
I20260709 13:14:25.769316  4754 heartbeater.cc:344] Connected to a master server at 127.25.109.190:45925
I20260709 13:14:25.769856  4754 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:25.770665  4754 heartbeater.cc:507] Master 127.25.109.190:45925 requested a full tablet report, sending...
I20260709 13:14:25.772603  4478 ts_manager.cc:194] Registered new tserver with Master: c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:25.773006 26038 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014603446s
I20260709 13:14:25.774235  4478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58638
I20260709 13:14:25.797231  4478 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:25.799880  4478 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:25.864117  4719 tablet_service.cc:1511] Processing CreateTablet for tablet 1c935859d87347bab4bb7176514f8963 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:25.867094  4718 tablet_service.cc:1511] Processing CreateTablet for tablet 057b86ef297843e28616765bb31ffff0 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:25.870805  4717 tablet_service.cc:1511] Processing CreateTablet for tablet 952ae1bdcb8e4198af7f34a5c5a62195 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:25.873380  4645 tablet_service.cc:1511] Processing CreateTablet for tablet 1c935859d87347bab4bb7176514f8963 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:25.874014  4716 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0032508c44b319e3f094f36f2ccbe (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:25.874776  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c935859d87347bab4bb7176514f8963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.875476  4719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c935859d87347bab4bb7176514f8963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.877465  4644 tablet_service.cc:1511] Processing CreateTablet for tablet 057b86ef297843e28616765bb31ffff0 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:25.879724  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ae1bdcb8e4198af7f34a5c5a62195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.880503  4644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b86ef297843e28616765bb31ffff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.883046  4715 tablet_service.cc:1511] Processing CreateTablet for tablet 2070e07c74304c2e9539906d00439ab8 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:25.884321  4715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2070e07c74304c2e9539906d00439ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.887223  4714 tablet_service.cc:1511] Processing CreateTablet for tablet c35467d9e6c54285899096d61c4e1b4a (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:25.888581  4714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35467d9e6c54285899096d61c4e1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.890425  4718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b86ef297843e28616765bb31ffff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.890553  4643 tablet_service.cc:1511] Processing CreateTablet for tablet 952ae1bdcb8e4198af7f34a5c5a62195 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:25.891901  4643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ae1bdcb8e4198af7f34a5c5a62195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.893405  4713 tablet_service.cc:1511] Processing CreateTablet for tablet be25118dfd5f44e0a28773a45c3570f1 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:25.894699  4713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25118dfd5f44e0a28773a45c3570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.898509  4712 tablet_service.cc:1511] Processing CreateTablet for tablet 7b31502a6b9141b980a52edb2d4c5561 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:25.899216  4769 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:25.899837  4712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b31502a6b9141b980a52edb2d4c5561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.900602  4642 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0032508c44b319e3f094f36f2ccbe (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:25.901880  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0032508c44b319e3f094f36f2ccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.905671  4769 tablet_bootstrap.cc:654] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:25.906432  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0032508c44b319e3f094f36f2ccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.906610  4711 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5d522cb8524e4b8367b098e22de53b (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:25.907951  4711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5d522cb8524e4b8367b098e22de53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.916088  4645 tablet_service.cc:1511] Processing CreateTablet for tablet 2070e07c74304c2e9539906d00439ab8 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:25.917373  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2070e07c74304c2e9539906d00439ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.926769  4641 tablet_service.cc:1511] Processing CreateTablet for tablet c35467d9e6c54285899096d61c4e1b4a (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:25.928413  4641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35467d9e6c54285899096d61c4e1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.940433  4640 tablet_service.cc:1511] Processing CreateTablet for tablet be25118dfd5f44e0a28773a45c3570f1 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:25.941802  4640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25118dfd5f44e0a28773a45c3570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.950026  4769 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:25.953045  4769 ts_tablet_manager.cc:1403] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.003s
I20260709 13:14:25.956411  4639 tablet_service.cc:1511] Processing CreateTablet for tablet 7b31502a6b9141b980a52edb2d4c5561 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:25.959013  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b31502a6b9141b980a52edb2d4c5561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.959285  4638 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5d522cb8524e4b8367b098e22de53b (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:25.960582  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5d522cb8524e4b8367b098e22de53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.972481  4570 tablet_service.cc:1511] Processing CreateTablet for tablet 1c935859d87347bab4bb7176514f8963 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:25.975539  4569 tablet_service.cc:1511] Processing CreateTablet for tablet 057b86ef297843e28616765bb31ffff0 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:25.978425  4568 tablet_service.cc:1511] Processing CreateTablet for tablet 952ae1bdcb8e4198af7f34a5c5a62195 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:25.980183  4570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c935859d87347bab4bb7176514f8963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.981722  4568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952ae1bdcb8e4198af7f34a5c5a62195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:25.983147  4569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057b86ef297843e28616765bb31ffff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.031255  4566 tablet_service.cc:1511] Processing CreateTablet for tablet 2070e07c74304c2e9539906d00439ab8 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:26.032651  4566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2070e07c74304c2e9539906d00439ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.035290  4564 tablet_service.cc:1511] Processing CreateTablet for tablet be25118dfd5f44e0a28773a45c3570f1 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:26.035487  4565 tablet_service.cc:1511] Processing CreateTablet for tablet c35467d9e6c54285899096d61c4e1b4a (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:26.029884  4567 tablet_service.cc:1511] Processing CreateTablet for tablet e7e0032508c44b319e3f094f36f2ccbe (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:26.036795  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be25118dfd5f44e0a28773a45c3570f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.037580  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e0032508c44b319e3f094f36f2ccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.038257  4565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35467d9e6c54285899096d61c4e1b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.055781  4563 tablet_service.cc:1511] Processing CreateTablet for tablet 7b31502a6b9141b980a52edb2d4c5561 (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:26.063002  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b31502a6b9141b980a52edb2d4c5561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.028419  4769 raft_consensus.cc:359] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.072638  4769 raft_consensus.cc:385] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.073010  4769 raft_consensus.cc:740] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.077046  4769 consensus_queue.cc:260] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.087311  4771 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.088219  4680 heartbeater.cc:499] Master 127.25.109.190:45925 was elected leader, sending a full tablet report...
I20260709 13:14:26.088831  4769 ts_tablet_manager.cc:1434] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.119s	user 0.004s	sys 0.007s
I20260709 13:14:26.126042  4562 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5d522cb8524e4b8367b098e22de53b (DEFAULT_TABLE table=test-workload [id=5d14064ba4c342c2a0d21046a52e35c8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:26.130466  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5d522cb8524e4b8367b098e22de53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:26.176548  4769 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.211598  4771 tablet_bootstrap.cc:654] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.224861  4774 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.226590  4771 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.227427  4771 ts_tablet_manager.cc:1403] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.013s
I20260709 13:14:26.231112  4769 tablet_bootstrap.cc:654] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.231907  4771 raft_consensus.cc:359] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.233253  4771 raft_consensus.cc:385] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.233554  4771 raft_consensus.cc:740] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.234730  4771 consensus_queue.cc:260] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.244385  4771 ts_tablet_manager.cc:1434] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.015s
I20260709 13:14:26.245484  4774 tablet_bootstrap.cc:654] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.245548  4754 heartbeater.cc:499] Master 127.25.109.190:45925 was elected leader, sending a full tablet report...
I20260709 13:14:26.250008  4771 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.263496  4771 tablet_bootstrap.cc:654] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.266965  4769 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.267660  4769 ts_tablet_manager.cc:1403] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.016s
I20260709 13:14:26.268070  4774 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.268916  4774 ts_tablet_manager.cc:1403] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.000s
I20260709 13:14:26.272002  4774 raft_consensus.cc:359] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.272742  4769 raft_consensus.cc:359] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.272742  4774 raft_consensus.cc:385] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.273643  4769 raft_consensus.cc:385] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.273940  4774 raft_consensus.cc:740] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.274080  4769 raft_consensus.cc:740] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.275079  4769 consensus_queue.cc:260] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.275079  4774 consensus_queue.cc:260] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.277912  4769 ts_tablet_manager.cc:1434] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:14:26.279017  4769 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.288408  4769 tablet_bootstrap.cc:654] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.305503  4605 heartbeater.cc:499] Master 127.25.109.190:45925 was elected leader, sending a full tablet report...
I20260709 13:14:26.305863  4771 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.306519  4771 ts_tablet_manager.cc:1403] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.024s
I20260709 13:14:26.307147  4774 ts_tablet_manager.cc:1434] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.014s
I20260709 13:14:26.307679  4769 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.308272  4769 ts_tablet_manager.cc:1403] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:14:26.308405  4774 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.309746  4771 raft_consensus.cc:359] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.310622  4771 raft_consensus.cc:385] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.311013  4771 raft_consensus.cc:740] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.311576  4769 raft_consensus.cc:359] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.312412  4769 raft_consensus.cc:385] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.311981  4771 consensus_queue.cc:260] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.312772  4769 raft_consensus.cc:740] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.314465  4771 ts_tablet_manager.cc:1434] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:26.315905  4774 tablet_bootstrap.cc:654] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.315774  4769 consensus_queue.cc:260] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.316529  4771 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.318169  4769 ts_tablet_manager.cc:1434] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:14:26.319382  4769 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.326414  4769 tablet_bootstrap.cc:654] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.327360  4771 tablet_bootstrap.cc:654] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.338999  4773 raft_consensus.cc:493] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.339865  4773 raft_consensus.cc:515] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.355041  4773 leader_election.cc:290] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599), 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037)
W20260709 13:14:26.370819  4526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:26.410319  4773 raft_consensus.cc:493] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.411137  4773 raft_consensus.cc:515] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.414777  4773 leader_election.cc:290] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.434535  4769 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.435352  4769 ts_tablet_manager.cc:1403] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.116s	user 0.072s	sys 0.037s
I20260709 13:14:26.435814  4771 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.436453  4771 ts_tablet_manager.cc:1403] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.120s	user 0.045s	sys 0.062s
I20260709 13:14:26.438897  4769 raft_consensus.cc:359] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.436507  4774 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.439613  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:26.439890  4769 raft_consensus.cc:385] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.439934  4771 raft_consensus.cc:359] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.440547  4769 raft_consensus.cc:740] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.440835  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:26.440972  4771 raft_consensus.cc:385] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.441565  4771 raft_consensus.cc:740] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
W20260709 13:14:26.441712  4619 leader_election.cc:343] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.442440  4774 ts_tablet_manager.cc:1403] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.134s	user 0.064s	sys 0.055s
W20260709 13:14:26.442943  4619 leader_election.cc:343] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.441521  4769 consensus_queue.cc:260] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.442780  4771 consensus_queue.cc:260] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.445132  4771 ts_tablet_manager.cc:1434] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:14:26.445523  4774 raft_consensus.cc:359] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.446242  4771 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.446310  4774 raft_consensus.cc:385] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.446853  4774 raft_consensus.cc:740] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.447644  4774 consensus_queue.cc:260] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.449668  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.450892  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.445138  4769 ts_tablet_manager.cc:1434] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:26.452694  4769 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
W20260709 13:14:26.454169  4620 leader_election.cc:343] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.454660  4620 leader_election.cc:304] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f; no voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed
W20260709 13:14:26.455879  4620 leader_election.cc:343] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.456286  4774 ts_tablet_manager.cc:1434] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:14:26.456449  4773 raft_consensus.cc:2749] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:26.457437  4774 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.456311  4620 leader_election.cc:304] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f; no voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:26.461939  4773 raft_consensus.cc:2749] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:26.463320  4771 tablet_bootstrap.cc:654] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.465320  4774 tablet_bootstrap.cc:654] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.465502  4769 tablet_bootstrap.cc:654] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.470693  4771 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.470933  4769 tablet_bootstrap.cc:492] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.471179  4771 ts_tablet_manager.cc:1403] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.005s
I20260709 13:14:26.471383  4769 ts_tablet_manager.cc:1403] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:14:26.471726  4774 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.472273  4774 ts_tablet_manager.cc:1403] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:14:26.473738  4769 raft_consensus.cc:359] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.474458  4769 raft_consensus.cc:385] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.475019  4769 raft_consensus.cc:740] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.474407  4771 raft_consensus.cc:359] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.475457  4771 raft_consensus.cc:385] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.475265  4774 raft_consensus.cc:359] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.475802  4771 raft_consensus.cc:740] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.476063  4774 raft_consensus.cc:385] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.475847  4769 consensus_queue.cc:260] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.476711  4774 raft_consensus.cc:740] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.476801  4771 consensus_queue.cc:260] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.477643  4774 consensus_queue.cc:260] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.478868  4769 ts_tablet_manager.cc:1434] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:26.480120  4774 ts_tablet_manager.cc:1434] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:26.481335  4774 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.481601  4771 ts_tablet_manager.cc:1434] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:14:26.482779  4771 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.488451  4774 tablet_bootstrap.cc:654] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.489602  4771 tablet_bootstrap.cc:654] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.480202  4769 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.497174  4776 raft_consensus.cc:493] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.497766  4776 raft_consensus.cc:515] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.498844  4769 tablet_bootstrap.cc:654] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.499742  4771 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.500674  4776 leader_election.cc:290] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.508652  4769 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.509864  4773 raft_consensus.cc:493] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.515892  4773 raft_consensus.cc:515] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.519140  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.519522  4773 leader_election.cc:290] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.519989  4769 ts_tablet_manager.cc:1403] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.006s
W20260709 13:14:26.520655  4620 leader_election.cc:343] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.520699  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
W20260709 13:14:26.522434  4619 leader_election.cc:343] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.522799  4774 tablet_bootstrap.cc:492] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.522848  4619 leader_election.cc:304] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f; no voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:26.523710  4774 ts_tablet_manager.cc:1403] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.005s
I20260709 13:14:26.524459  4773 raft_consensus.cc:2749] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:26.510798  4771 ts_tablet_manager.cc:1403] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:14:26.526962  4774 raft_consensus.cc:359] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.527796  4774 raft_consensus.cc:385] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.528165  4774 raft_consensus.cc:740] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.527952  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.528879  4579 raft_consensus.cc:2468] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.528955  4771 raft_consensus.cc:359] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.529695  4771 raft_consensus.cc:385] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.529210  4774 consensus_queue.cc:260] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.530046  4771 raft_consensus.cc:740] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.530438  4694 leader_election.cc:304] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.531394  4776 raft_consensus.cc:2804] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.531828  4776 raft_consensus.cc:493] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.523293  4769 raft_consensus.cc:359] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.532166  4776 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.532253  4769 raft_consensus.cc:385] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.532626  4769 raft_consensus.cc:740] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.533417  4769 consensus_queue.cc:260] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.536119  4769 ts_tablet_manager.cc:1434] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:26.537086  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.537479  4769 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
W20260709 13:14:26.538793  4694 leader_election.cc:343] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.541942  4774 ts_tablet_manager.cc:1434] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:14:26.544642  4769 tablet_bootstrap.cc:654] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.548331  4776 raft_consensus.cc:515] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.549539  4774 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.551947  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:26.530963  4771 consensus_queue.cc:260] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.552614  4579 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.553802  4776 leader_election.cc:290] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.556830  4774 tablet_bootstrap.cc:654] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.558625  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.559713  4776 raft_consensus.cc:493] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:26.560624  4694 leader_election.cc:343] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.560947  4776 raft_consensus.cc:515] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.563191  4776 leader_election.cc:290] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.569031  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5d522cb8524e4b8367b098e22de53b" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.569763  4655 raft_consensus.cc:2468] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.570027  4774 tablet_bootstrap.cc:492] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.570605  4774 ts_tablet_manager.cc:1403] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:14:26.567957  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5d522cb8524e4b8367b098e22de53b" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.571760  4694 leader_election.cc:304] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
W20260709 13:14:26.573194  4694 leader_election.cc:343] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.574194  4776 raft_consensus.cc:2804] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.575248  4776 raft_consensus.cc:493] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.575701  4776 raft_consensus.cc:3060] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.575570  4774 raft_consensus.cc:359] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.574072  4579 raft_consensus.cc:2468] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.576432  4771 ts_tablet_manager.cc:1434] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.008s
I20260709 13:14:26.576558  4774 raft_consensus.cc:385] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.577078  4774 raft_consensus.cc:740] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.577386  4769 tablet_bootstrap.cc:492] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.577405  4694 leader_election.cc:304] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:26.578083  4769 ts_tablet_manager.cc:1403] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.014s
I20260709 13:14:26.578130  4774 consensus_queue.cc:260] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.579088  4797 raft_consensus.cc:2804] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.581344  4769 raft_consensus.cc:359] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.582165  4769 raft_consensus.cc:385] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.582515  4769 raft_consensus.cc:740] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.583173  4774 ts_tablet_manager.cc:1434] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:14:26.583454  4769 consensus_queue.cc:260] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.584292  4774 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.587296  4776 raft_consensus.cc:515] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.590137  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5d522cb8524e4b8367b098e22de53b" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:26.590728  4579 raft_consensus.cc:3060] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.591462  4771 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.593146  4769 ts_tablet_manager.cc:1434] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:14:26.596518  4769 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.592036  4774 tablet_bootstrap.cc:654] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.601466  4780 raft_consensus.cc:493] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.602208  4780 raft_consensus.cc:515] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.602828  4771 tablet_bootstrap.cc:654] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.606624  4579 raft_consensus.cc:2468] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.608184  4694 leader_election.cc:304] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.608356  4776 leader_election.cc:290] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.610167  4776 raft_consensus.cc:2804] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.612406  4776 raft_consensus.cc:697] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:26.613483  4780 leader_election.cc:290] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.613306  4776 consensus_queue.cc:237] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.621945  4797 raft_consensus.cc:697] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:26.627038  4797 consensus_queue.cc:237] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.626103  4769 tablet_bootstrap.cc:654] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.634130  4771 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.634610  4771 ts_tablet_manager.cc:1403] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.024s
I20260709 13:14:26.635188  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5d522cb8524e4b8367b098e22de53b" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.635841  4655 raft_consensus.cc:3060] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.637852  4771 raft_consensus.cc:359] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.638705  4771 raft_consensus.cc:385] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.639024  4771 raft_consensus.cc:740] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.641122  4774 tablet_bootstrap.cc:492] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.641757  4774 ts_tablet_manager.cc:1403] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.031s
I20260709 13:14:26.644876  4655 raft_consensus.cc:2468] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.645048  4774 raft_consensus.cc:359] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.645968  4774 raft_consensus.cc:385] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.646363  4774 raft_consensus.cc:740] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.647243  4774 consensus_queue.cc:260] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.647425  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.648343  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:26.648509  4654 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.649087  4728 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.649770  4774 ts_tablet_manager.cc:1434] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:26.650149  4545 leader_election.cc:304] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:26.650851  4774 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.651089  4780 raft_consensus.cc:2804] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.651466  4780 raft_consensus.cc:493] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.651799  4780 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.654004  4769 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.654600  4769 ts_tablet_manager.cc:1403] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.003s
I20260709 13:14:26.654434  4771 consensus_queue.cc:260] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.656797  4771 ts_tablet_manager.cc:1434] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:14:26.657439  4769 raft_consensus.cc:359] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.657960  4771 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.661204  4780 raft_consensus.cc:515] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.662662  4769 raft_consensus.cc:385] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.663091  4769 raft_consensus.cc:740] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.663664  4774 tablet_bootstrap.cc:654] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.663923  4769 consensus_queue.cc:260] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.665167  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.665786  4654 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.666713  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:26.667297  4728 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.669116  4478 catalog_manager.cc:5697] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.674278  4780 leader_election.cc:290] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.675609  4774 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.676234  4774 ts_tablet_manager.cc:1403] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:14:26.678642  4728 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.678929  4654 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.679821  4774 raft_consensus.cc:359] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.680671  4774 raft_consensus.cc:385] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.680474  4544 leader_election.cc:304] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.681486  4780 raft_consensus.cc:2804] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.681767  4769 ts_tablet_manager.cc:1434] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.003s
I20260709 13:14:26.683101  4769 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:26.689008  4769 tablet_bootstrap.cc:654] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.690174  4774 raft_consensus.cc:740] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.691274  4774 consensus_queue.cc:260] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.694181  4771 tablet_bootstrap.cc:654] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.694564  4780 raft_consensus.cc:697] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:26.695539  4780 consensus_queue.cc:237] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.713104  4774 ts_tablet_manager.cc:1434] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.012s
I20260709 13:14:26.714709  4774 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.722666  4771 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.723266  4771 ts_tablet_manager.cc:1403] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.003s
I20260709 13:14:26.724328  4774 tablet_bootstrap.cc:654] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.726359  4769 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:26.726989  4769 ts_tablet_manager.cc:1403] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.016s
I20260709 13:14:26.726495  4771 raft_consensus.cc:359] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.727270  4797 raft_consensus.cc:493] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.727448  4771 raft_consensus.cc:385] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.727932  4771 raft_consensus.cc:740] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.727890  4797 raft_consensus.cc:515] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.729857  4769 raft_consensus.cc:359] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.730597  4769 raft_consensus.cc:385] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.730859  4769 raft_consensus.cc:740] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.731302  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.731650  4769 consensus_queue.cc:260] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.731696  4771 consensus_queue.cc:260] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.734290  4769 ts_tablet_manager.cc:1434] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:26.735009  4797 leader_election.cc:290] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.736575  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.739990  4654 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.741544  4694 leader_election.cc:304] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.742627  4776 raft_consensus.cc:493] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.743223  4776 raft_consensus.cc:515] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.731990  4579 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.740829  4476 catalog_manager.cc:5697] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.755445  4776 leader_election.cc:290] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.756901  4771 ts_tablet_manager.cc:1434] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.007s
I20260709 13:14:26.758004  4771 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.755990  4797 raft_consensus.cc:2804] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.758585  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.759164  4797 raft_consensus.cc:493] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.759634  4797 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.760390  4774 tablet_bootstrap.cc:492] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.758158  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.760707  4776 raft_consensus.cc:493] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.761032  4774 ts_tablet_manager.cc:1403] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.020s
W20260709 13:14:26.760319  4694 leader_election.cc:343] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:26.761065  4654 raft_consensus.cc:2468] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.761204  4776 raft_consensus.cc:515] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.762638  4694 leader_election.cc:304] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:26.763630  4803 raft_consensus.cc:2804] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.764029  4803 raft_consensus.cc:493] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.763931  4774 raft_consensus.cc:359] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.764591  4803 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.734231  4478 catalog_manager.cc:5697] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.764793  4774 raft_consensus.cc:385] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.763860  4776 leader_election.cc:290] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.782404  4774 raft_consensus.cc:740] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.783342  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:26.783275  4774 consensus_queue.cc:260] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.784030  4579 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.783556  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.784672  4654 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:26.785521  4774 ts_tablet_manager.cc:1434] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:14:26.788642  4803 raft_consensus.cc:515] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.790961  4803 leader_election.cc:290] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.792563  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:26.792759  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.793252  4579 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.793402  4654 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.781209  4797 raft_consensus.cc:515] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.795789  4797 leader_election.cc:290] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.799283  4771 tablet_bootstrap.cc:654] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.800593  4579 raft_consensus.cc:2468] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.793394  4774 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:26.801131  4654 raft_consensus.cc:2468] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.802444  4694 leader_election.cc:304] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.803355  4694 leader_election.cc:304] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.806170  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:26.806203  4797 raft_consensus.cc:2804] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.806378  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.806921  4579 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.806926  4797 raft_consensus.cc:493] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.807152  4655 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.807581  4774 tablet_bootstrap.cc:654] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.807626  4797 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.810086  4803 raft_consensus.cc:2804] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.810664  4803 raft_consensus.cc:697] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:26.811730  4803 consensus_queue.cc:237] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.814917  4655 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.814917  4579 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.816365  4694 leader_election.cc:304] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.817058  4776 raft_consensus.cc:2804] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.817521  4776 raft_consensus.cc:697] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:26.818334  4776 consensus_queue.cc:237] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.825290  4774 tablet_bootstrap.cc:492] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:26.826085  4774 ts_tablet_manager.cc:1403] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.002s
I20260709 13:14:26.829093  4797 raft_consensus.cc:515] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.829846  4774 raft_consensus.cc:359] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.831123  4774 raft_consensus.cc:385] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.831435  4774 raft_consensus.cc:740] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.832304  4771 tablet_bootstrap.cc:492] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.832716  4797 leader_election.cc:290] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:26.832335  4774 consensus_queue.cc:260] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.833736  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:26.834354  4579 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.834256  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.834878  4774 ts_tablet_manager.cc:1434] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:26.835045  4655 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.833132  4771 ts_tablet_manager.cc:1403] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.017s
I20260709 13:14:26.831267  4478 catalog_manager.cc:5697] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.840804  4771 raft_consensus.cc:359] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.841444  4771 raft_consensus.cc:385] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.841708  4771 raft_consensus.cc:740] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.842589  4655 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.842505  4771 consensus_queue.cc:260] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.843787  4694 leader_election.cc:304] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:26.844601  4771 ts_tablet_manager.cc:1434] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:26.845597  4771 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:26.846613  4803 raft_consensus.cc:2804] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.847232  4803 raft_consensus.cc:697] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:26.848093  4803 consensus_queue.cc:237] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.850893  4579 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:26.852080  4771 tablet_bootstrap.cc:654] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:26.854763  4478 catalog_manager.cc:5697] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.856953  4771 tablet_bootstrap.cc:492] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:26.857425  4771 ts_tablet_manager.cc:1403] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:14:26.860075  4771 raft_consensus.cc:359] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.860661  4771 raft_consensus.cc:385] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:26.860931  4771 raft_consensus.cc:740] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:26.861548  4771 consensus_queue.cc:260] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:26.863452  4771 ts_tablet_manager.cc:1434] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:26.868618  4478 catalog_manager.cc:5697] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.884618  4780 raft_consensus.cc:493] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.885152  4780 raft_consensus.cc:515] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.886914  4780 leader_election.cc:290] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.887804  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.887943  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:26.888402  4655 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.888573  4728 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.889391  4545 leader_election.cc:304] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:26.890192  4780 raft_consensus.cc:2804] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.890509  4780 raft_consensus.cc:493] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.890775  4780 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.895807  4780 raft_consensus.cc:515] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.897326  4780 leader_election.cc:290] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.898276  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.898445  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:26.898926  4655 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.899082  4728 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.903950  4655 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.904002  4728 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.905086  4545 leader_election.cc:304] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:26.905798  4780 raft_consensus.cc:2804] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.906306  4780 raft_consensus.cc:697] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:26.906963  4780 consensus_queue.cc:237] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.914158  4478 catalog_manager.cc:5697] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.938910  4780 raft_consensus.cc:493] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.939419  4780 raft_consensus.cc:515] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.941231  4780 leader_election.cc:290] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.942008  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:26.942371  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:26.942646  4655 raft_consensus.cc:2468] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.942962  4728 raft_consensus.cc:2468] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:26.943693  4545 leader_election.cc:304] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:26.944362  4780 raft_consensus.cc:2804] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:26.944725  4780 raft_consensus.cc:493] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.945006  4780 raft_consensus.cc:3060] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.950181  4780 raft_consensus.cc:515] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.951831  4780 leader_election.cc:290] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:26.952548  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:26.952935  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "057b86ef297843e28616765bb31ffff0" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:26.953094  4655 raft_consensus.cc:3060] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.953498  4728 raft_consensus.cc:3060] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:26.958106  4655 raft_consensus.cc:2468] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.958145  4728 raft_consensus.cc:2468] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:26.959378  4545 leader_election.cc:304] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:26.959990  4780 raft_consensus.cc:2804] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:26.960474  4780 raft_consensus.cc:697] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:26.961236  4780 consensus_queue.cc:237] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:26.967886  4478 catalog_manager.cc:5697] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.004428  4773 raft_consensus.cc:493] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.005265  4773 raft_consensus.cc:515] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.007057  4773 leader_election.cc:290] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.007920  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:27.008069  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:27.008810  4579 raft_consensus.cc:2393] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88a71168b69a4586a29ac25e6f7eb43f in current term 1: Already voted for candidate c728aa7dc1fb442b98ebe0a2c325bfed in this term.
I20260709 13:14:27.009779  4620 leader_election.cc:304] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f; no voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:27.010392  4773 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.016084  4803 consensus_queue.cc:1048] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.016776  4773 raft_consensus.cc:2749] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:27.027323  4776 consensus_queue.cc:1048] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:27.078189  4776 consensus_queue.cc:1048] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.088164  4797 consensus_queue.cc:1048] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.098289  4780 consensus_queue.cc:1048] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.109936  4810 consensus_queue.cc:1048] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:27.130256  4810 raft_consensus.cc:493] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.130656  4810 raft_consensus.cc:515] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:27.132225  4810 leader_election.cc:290] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:27.132977  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:27.133461  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:27.133738  4728 raft_consensus.cc:2468] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:27.134162  4655 raft_consensus.cc:2468] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:27.134943  4544 leader_election.cc:304] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:27.135726  4810 raft_consensus.cc:2804] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:27.136013  4810 raft_consensus.cc:493] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.136299  4810 raft_consensus.cc:3060] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.142416  4810 raft_consensus.cc:515] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:27.143870  4810 leader_election.cc:290] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:27.144644  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.144773  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c935859d87347bab4bb7176514f8963" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:27.145205  4728 raft_consensus.cc:3060] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.145352  4655 raft_consensus.cc:3060] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:27.150364  4728 raft_consensus.cc:2468] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:27.150557  4655 raft_consensus.cc:2468] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:27.151384  4544 leader_election.cc:304] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:27.152163  4810 raft_consensus.cc:2804] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:27.152608  4810 raft_consensus.cc:697] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:27.153477  4810 consensus_queue.cc:237] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } }
I20260709 13:14:27.160642  4476 catalog_manager.cc:5697] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.239840  4797 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.249889  4803 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.313565  4803 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.323993  4803 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.345160  4803 consensus_queue.cc:1048] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.356490  4803 consensus_queue.cc:1048] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.358443  4810 consensus_queue.cc:1048] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:27.377477  4810 consensus_queue.cc:1048] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.410825  4810 consensus_queue.cc:1048] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.423882  4810 consensus_queue.cc:1048] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.439815  4728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:27.440444  4728 raft_consensus.cc:606] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:27.445657  4728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:27.446208  4728 raft_consensus.cc:606] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:27.459146  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:51982
I20260709 13:14:27.459678  4579 raft_consensus.cc:606] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:27.464447  4728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:27.464970  4728 raft_consensus.cc:606] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:27.469766  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:51982
I20260709 13:14:27.470309  4579 raft_consensus.cc:606] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:27.474879  4728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:27.475404  4728 raft_consensus.cc:606] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:27.564433  4813 consensus_queue.cc:1048] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.575635  4813 consensus_queue.cc:1048] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:27.620553  4780 raft_consensus.cc:993] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.621061  4813 raft_consensus.cc:1081] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.622607  4654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46542
I20260709 13:14:27.623199  4654 raft_consensus.cc:493] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.623500  4654 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.628415  4654 raft_consensus.cc:515] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.630026  4654 leader_election.cc:290] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.630803  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:27.631024  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2070e07c74304c2e9539906d00439ab8" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.631512  4579 raft_consensus.cc:3055] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.631639  4728 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.631831  4579 raft_consensus.cc:740] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:27.632649  4579 consensus_queue.cc:260] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.633586  4579 raft_consensus.cc:3060] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.636649  4728 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.637770  4619 leader_election.cc:304] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:27.638481  4773 raft_consensus.cc:2804] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.638496  4579 raft_consensus.cc:2468] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.640239  4773 raft_consensus.cc:697] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:27.641084  4773 consensus_queue.cc:237] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.643167  4803 raft_consensus.cc:993] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.643649  4803 raft_consensus.cc:1081] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.645246  4654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46538
I20260709 13:14:27.645924  4654 raft_consensus.cc:493] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.646387  4654 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.648043  4478 catalog_manager.cc:5697] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.651348  4654 raft_consensus.cc:515] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.653636  4654 leader_election.cc:290] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.654496  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:27.655143  4579 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.655267  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.655890  4728 raft_consensus.cc:3055] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.656247  4728 raft_consensus.cc:740] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:27.656960  4728 consensus_queue.cc:260] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.657886  4728 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.660507  4579 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.661473  4620 leader_election.cc:304] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:27.662163  4773 raft_consensus.cc:2804] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.662567  4773 raft_consensus.cc:697] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:27.663203  4728 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.663254  4773 consensus_queue.cc:237] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.669451  4478 catalog_manager.cc:5697] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.680716  4803 raft_consensus.cc:993] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:27.681149  4799 raft_consensus.cc:1081] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:27.682843  4579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:14:27.683341  4579 raft_consensus.cc:493] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.683660  4579 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.688995  4579 raft_consensus.cc:515] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.690636  4579 leader_election.cc:290] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.691359  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:27.691660  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952ae1bdcb8e4198af7f34a5c5a62195" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.691999  4654 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.692271  4728 raft_consensus.cc:3055] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.692608  4728 raft_consensus.cc:740] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:27.693320  4728 consensus_queue.cc:260] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.694321  4728 raft_consensus.cc:3060] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.697052  4654 raft_consensus.cc:2468] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:27.698176  4545 leader_election.cc:304] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:27.698938  4813 raft_consensus.cc:2804] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.699102  4728 raft_consensus.cc:2468] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:27.699363  4813 raft_consensus.cc:697] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:27.700261  4813 consensus_queue.cc:237] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.705919  4478 catalog_manager.cc:5697] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.734508  4797 raft_consensus.cc:993] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:27.735050  4799 raft_consensus.cc:1081] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:27.736390  4579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:14:27.736817  4579 raft_consensus.cc:493] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.737079  4579 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.742589  4579 raft_consensus.cc:515] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.744123  4579 leader_election.cc:290] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.745014  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:27.745258  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.745707  4654 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.745819  4728 raft_consensus.cc:3055] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.746268  4728 raft_consensus.cc:740] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:27.747094  4728 consensus_queue.cc:260] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.748445  4728 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.753232  4654 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:27.754535  4545 leader_election.cc:304] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:27.755363  4813 raft_consensus.cc:2804] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.755781  4813 raft_consensus.cc:697] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:27.755903  4728 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:27.756578  4813 consensus_queue.cc:237] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.762666  4478 catalog_manager.cc:5697] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.811208  4797 raft_consensus.cc:993] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.811730  4799 raft_consensus.cc:1081] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.813180  4654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46538
I20260709 13:14:27.813761  4654 raft_consensus.cc:493] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.814138  4654 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.818979  4654 raft_consensus.cc:515] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.820590  4654 leader_election.cc:290] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.821681  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:27.821708  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b31502a6b9141b980a52edb2d4c5561" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.822324  4579 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.822432  4728 raft_consensus.cc:3055] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.822881  4728 raft_consensus.cc:740] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:27.823525  4728 consensus_queue.cc:260] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.824476  4728 raft_consensus.cc:3060] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.827317  4579 raft_consensus.cc:2468] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.828365  4620 leader_election.cc:304] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:27.829133  4773 raft_consensus.cc:2804] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.829555  4728 raft_consensus.cc:2468] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.829566  4773 raft_consensus.cc:697] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:27.830751  4773 consensus_queue.cc:237] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.833500  4810 raft_consensus.cc:993] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.833936  4813 raft_consensus.cc:1081] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:27.835533  4654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46542
I20260709 13:14:27.836127  4654 raft_consensus.cc:493] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.836532  4654 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.838878  4478 catalog_manager.cc:5697] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:27.841965  4654 raft_consensus.cc:515] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.844038  4654 leader_election.cc:290] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:27.844784  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:27.845247  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be25118dfd5f44e0a28773a45c3570f1" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:27.845459  4579 raft_consensus.cc:3055] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:27.845893  4579 raft_consensus.cc:740] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:27.845927  4728 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.846799  4579 consensus_queue.cc:260] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.847733  4579 raft_consensus.cc:3060] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:27.851560  4728 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.852502  4619 leader_election.cc:304] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:27.852545  4579 raft_consensus.cc:2468] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:27.853335  4773 raft_consensus.cc:2804] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:27.853833  4773 raft_consensus.cc:697] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:27.854673  4773 consensus_queue.cc:237] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:27.860484  4478 catalog_manager.cc:5697] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.034304  4579 raft_consensus.cc:1275] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.035667  4773 consensus_queue.cc:1048] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.044898  4728 raft_consensus.cc:1275] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.046838  4853 consensus_queue.cc:1048] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.135139  4728 raft_consensus.cc:1275] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.136688  4853 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.144120  4579 raft_consensus.cc:1275] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.145373  4773 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.160930  4728 raft_consensus.cc:1275] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.162189  4780 consensus_queue.cc:1048] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.170202  4654 raft_consensus.cc:1275] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.172092  4810 consensus_queue.cc:1048] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.264066  4728 raft_consensus.cc:1275] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.265570  4729 raft_consensus.cc:1275] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.265514  4810 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.266953  4773 consensus_queue.cc:1048] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.273665  4654 raft_consensus.cc:1275] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.275606  4780 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.281266  4579 raft_consensus.cc:1275] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.282773  4851 consensus_queue.cc:1048] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.397619  4728 raft_consensus.cc:1275] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.399134  4851 consensus_queue.cc:1048] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:28.412760  4579 raft_consensus.cc:1275] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:28.414510  4851 consensus_queue.cc:1048] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:30.516108  4478 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36130:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:30.518633  4478 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:30.566946  4569 tablet_service.cc:1511] Processing CreateTablet for tablet c47c7732f0c14429ab702a72bcd1a46a (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:30.568368  4569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47c7732f0c14429ab702a72bcd1a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.568274  4639 tablet_service.cc:1511] Processing CreateTablet for tablet c47c7732f0c14429ab702a72bcd1a46a (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:30.569950  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47c7732f0c14429ab702a72bcd1a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.570205  4711 tablet_service.cc:1511] Processing CreateTablet for tablet c47c7732f0c14429ab702a72bcd1a46a (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:30.571497  4711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47c7732f0c14429ab702a72bcd1a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.571609  4570 tablet_service.cc:1511] Processing CreateTablet for tablet 393c2604125242598947039065b7abd3 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:30.574911  4714 tablet_service.cc:1511] Processing CreateTablet for tablet 393c2604125242598947039065b7abd3 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:30.575169  4640 tablet_service.cc:1511] Processing CreateTablet for tablet 393c2604125242598947039065b7abd3 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:30.576260  4714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c2604125242598947039065b7abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.576467  4640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c2604125242598947039065b7abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.578075  4570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393c2604125242598947039065b7abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.578521  4563 tablet_service.cc:1511] Processing CreateTablet for tablet f85a881448c6477ab7fc13367281ea9c (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:30.579744  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a881448c6477ab7fc13367281ea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.581844  4719 tablet_service.cc:1511] Processing CreateTablet for tablet f85a881448c6477ab7fc13367281ea9c (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:30.583118  4719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a881448c6477ab7fc13367281ea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.590162  4713 tablet_service.cc:1511] Processing CreateTablet for tablet a033ec9f51314e999d88b9d95517545d (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:30.591444  4713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a033ec9f51314e999d88b9d95517545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.595672  4716 tablet_service.cc:1511] Processing CreateTablet for tablet f36e4c6f5c3e4f358da36b89aaeb3f42 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:30.597091  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36e4c6f5c3e4f358da36b89aaeb3f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.597893  4718 tablet_service.cc:1511] Processing CreateTablet for tablet 134f97606e144646a809df92c1666cc4 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:30.599247  4718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134f97606e144646a809df92c1666cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.603897  4712 tablet_service.cc:1511] Processing CreateTablet for tablet f314587018054cd189c433ca87522c51 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:30.605378  4712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f314587018054cd189c433ca87522c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.608922  4717 tablet_service.cc:1511] Processing CreateTablet for tablet 92a8d6550493473fa20ddb635de9f9eb (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:30.610432  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a8d6550493473fa20ddb635de9f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.611964  4643 tablet_service.cc:1511] Processing CreateTablet for tablet f85a881448c6477ab7fc13367281ea9c (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:30.612761  4567 tablet_service.cc:1511] Processing CreateTablet for tablet a033ec9f51314e999d88b9d95517545d (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:30.613302  4643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85a881448c6477ab7fc13367281ea9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.614008  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a033ec9f51314e999d88b9d95517545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.619697  4715 tablet_service.cc:1511] Processing CreateTablet for tablet 026e2fb2a3244e209c17e41bfb14c3c6 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:30.621065  4715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026e2fb2a3244e209c17e41bfb14c3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.624678  4645 tablet_service.cc:1511] Processing CreateTablet for tablet a033ec9f51314e999d88b9d95517545d (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:30.630028  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a033ec9f51314e999d88b9d95517545d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.631153  4570 tablet_service.cc:1511] Processing CreateTablet for tablet f36e4c6f5c3e4f358da36b89aaeb3f42 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:30.632535  4570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36e4c6f5c3e4f358da36b89aaeb3f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.633556  4641 tablet_service.cc:1511] Processing CreateTablet for tablet f36e4c6f5c3e4f358da36b89aaeb3f42 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:30.634364  4566 tablet_service.cc:1511] Processing CreateTablet for tablet 134f97606e144646a809df92c1666cc4 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:30.634931  4641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36e4c6f5c3e4f358da36b89aaeb3f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.635638  4566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134f97606e144646a809df92c1666cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.649685  4870 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:30.653546  4562 tablet_service.cc:1511] Processing CreateTablet for tablet f314587018054cd189c433ca87522c51 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:30.655192  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f314587018054cd189c433ca87522c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.655329  4640 tablet_service.cc:1511] Processing CreateTablet for tablet 134f97606e144646a809df92c1666cc4 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:30.656702  4640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 134f97606e144646a809df92c1666cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.666326  4563 tablet_service.cc:1511] Processing CreateTablet for tablet 92a8d6550493473fa20ddb635de9f9eb (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:30.667023  4645 tablet_service.cc:1511] Processing CreateTablet for tablet f314587018054cd189c433ca87522c51 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:30.667120  4638 tablet_service.cc:1511] Processing CreateTablet for tablet 92a8d6550493473fa20ddb635de9f9eb (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:30.667754  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a8d6550493473fa20ddb635de9f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.668502  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a8d6550493473fa20ddb635de9f9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.669719  4565 tablet_service.cc:1511] Processing CreateTablet for tablet 026e2fb2a3244e209c17e41bfb14c3c6 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:30.666225  4642 tablet_service.cc:1511] Processing CreateTablet for tablet 026e2fb2a3244e209c17e41bfb14c3c6 (DEFAULT_TABLE table=soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:30.672614  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026e2fb2a3244e209c17e41bfb14c3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.675264  4565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026e2fb2a3244e209c17e41bfb14c3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.677783  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f314587018054cd189c433ca87522c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:30.714823  4869 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:30.723605  4871 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:30.729043  4870 tablet_bootstrap.cc:654] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.753674  4869 tablet_bootstrap.cc:654] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.769363  4871 tablet_bootstrap.cc:654] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.786872  4870 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:30.787400  4870 ts_tablet_manager.cc:1403] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.016s
I20260709 13:14:30.789117  4869 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:30.789768  4869 ts_tablet_manager.cc:1403] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.008s
I20260709 13:14:30.790467  4870 raft_consensus.cc:359] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.791258  4870 raft_consensus.cc:385] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.791549  4870 raft_consensus.cc:740] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.792243  4870 consensus_queue.cc:260] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.795863  4869 raft_consensus.cc:359] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.800978  4869 raft_consensus.cc:385] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.801167  4869 raft_consensus.cc:740] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.801680  4869 consensus_queue.cc:260] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.798760  4870 ts_tablet_manager.cc:1434] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:30.803233  4870 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:30.803898  4869 ts_tablet_manager.cc:1434] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:14:30.804921  4869 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:30.809729  4870 tablet_bootstrap.cc:654] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.812754  4871 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:30.813346  4871 ts_tablet_manager.cc:1403] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.014s
I20260709 13:14:30.815816  4869 tablet_bootstrap.cc:654] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.816715  4871 raft_consensus.cc:359] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.817750  4871 raft_consensus.cc:385] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.818106  4871 raft_consensus.cc:740] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.819044  4871 consensus_queue.cc:260] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.821353  4871 ts_tablet_manager.cc:1434] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:30.822350  4871 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:30.829319  4871 tablet_bootstrap.cc:654] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.833104  4870 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:30.833739  4870 ts_tablet_manager.cc:1403] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
W20260709 13:14:30.837244  4755 tablet.cc:2406] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:30.847687  4870 raft_consensus.cc:359] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.848799  4870 raft_consensus.cc:385] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.849172  4870 raft_consensus.cc:740] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.851341  4870 consensus_queue.cc:260] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.852618  4869 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:30.853041  4870 ts_tablet_manager.cc:1434] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:14:30.853193  4869 ts_tablet_manager.cc:1403] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.018s
I20260709 13:14:30.854601  4870 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:30.856344  4869 raft_consensus.cc:359] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.857134  4869 raft_consensus.cc:385] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.857429  4869 raft_consensus.cc:740] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.858402  4869 consensus_queue.cc:260] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.860731  4869 ts_tablet_manager.cc:1434] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:30.861616  4871 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:30.861655  4869 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:30.862459  4870 tablet_bootstrap.cc:654] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.862675  4871 ts_tablet_manager.cc:1403] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.013s
I20260709 13:14:30.865841  4871 raft_consensus.cc:359] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.866544  4871 raft_consensus.cc:385] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.866817  4871 raft_consensus.cc:740] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.867935  4871 consensus_queue.cc:260] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.870383  4871 ts_tablet_manager.cc:1434] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:14:30.870604  4869 tablet_bootstrap.cc:654] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.871616  4871 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:30.878707  4871 tablet_bootstrap.cc:654] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.882417  4799 raft_consensus.cc:493] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.883096  4799 raft_consensus.cc:515] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.886794  4799 leader_election.cc:290] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:30.887676  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:30.888144  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:30.888983  4579 raft_consensus.cc:2468] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:30.889130  4799 raft_consensus.cc:493] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.889611  4799 raft_consensus.cc:515] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
W20260709 13:14:30.889696  4694 leader_election.cc:343] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:30.890920  4694 leader_election.cc:304] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:30.891603  4799 leader_election.cc:290] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:30.892148  4799 raft_consensus.cc:2804] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:30.892499  4799 raft_consensus.cc:493] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.892813  4799 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:30.901774  4799 raft_consensus.cc:515] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.903695  4799 leader_election.cc:290] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:30.905920  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:30.907578  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:30.908288  4654 raft_consensus.cc:2468] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:30.908651  4870 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:30.909157  4870 ts_tablet_manager.cc:1403] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.026s
I20260709 13:14:30.909343  4694 leader_election.cc:304] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:30.910955  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:30.911197  4881 raft_consensus.cc:2804] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:30.911734  4881 raft_consensus.cc:493] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.910255  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:30.912123  4881 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:30.912464  4871 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:30.912350  4579 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:30.912292  4870 raft_consensus.cc:359] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.913241  4871 ts_tablet_manager.cc:1403] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.007s
I20260709 13:14:30.913439  4870 raft_consensus.cc:385] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.913762  4870 raft_consensus.cc:740] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.914505  4870 consensus_queue.cc:260] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.919406  4579 raft_consensus.cc:2468] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:30.910037  4869 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:30.919744  4881 raft_consensus.cc:515] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.920516  4869 ts_tablet_manager.cc:1403] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.012s
I20260709 13:14:30.922359  4870 ts_tablet_manager.cc:1434] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.004s
W20260709 13:14:30.920125  4694 leader_election.cc:343] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:30.923590  4870 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:30.924417  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:30.925537  4869 raft_consensus.cc:359] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.926313  4869 raft_consensus.cc:385] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:30.925845  4694 leader_election.cc:343] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:30.926627  4869 raft_consensus.cc:740] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.927134  4694 leader_election.cc:304] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:30.927435  4869 consensus_queue.cc:260] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.928082  4799 raft_consensus.cc:2804] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:30.930531  4870 tablet_bootstrap.cc:654] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.930600  4881 leader_election.cc:290] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
W20260709 13:14:30.932126  4694 leader_election.cc:343] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:30.935858  4869 ts_tablet_manager.cc:1434] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:14:30.936913  4869 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:30.938333  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:30.938943  4654 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:30.940184  4780 raft_consensus.cc:493] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.940843  4780 raft_consensus.cc:515] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.943605  4780 leader_election.cc:290] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:30.944105  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:30.944764  4655 raft_consensus.cc:2468] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:30.945091  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:30.945840  4869 tablet_bootstrap.cc:654] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.946033  4545 leader_election.cc:304] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
W20260709 13:14:30.946885  4544 leader_election.cc:343] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:30.947119  4780 raft_consensus.cc:2804] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:30.947700  4780 raft_consensus.cc:493] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.948119  4780 raft_consensus.cc:3060] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:30.961388  4799 raft_consensus.cc:697] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:30.962846  4799 consensus_queue.cc:237] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.960835  4654 raft_consensus.cc:2468] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:30.968051  4694 leader_election.cc:304] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:30.968731  4871 raft_consensus.cc:359] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.969756  4883 raft_consensus.cc:2804] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:30.969911  4871 raft_consensus.cc:385] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:30.970510  4883 raft_consensus.cc:697] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:30.971509  4883 consensus_queue.cc:237] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.972728  4871 raft_consensus.cc:740] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:30.973867  4871 consensus_queue.cc:260] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.976876  4871 ts_tablet_manager.cc:1434] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.004s
I20260709 13:14:30.979178  4871 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:30.991566  4871 tablet_bootstrap.cc:654] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:30.999087  4780 raft_consensus.cc:515] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:30.999372  4476 catalog_manager.cc:5697] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.005692  4871 tablet_bootstrap.cc:492] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.005972  4869 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.006450  4871 ts_tablet_manager.cc:1403] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 13:14:31.005705  4870 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.006481  4869 ts_tablet_manager.cc:1403] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.070s	user 0.035s	sys 0.026s
I20260709 13:14:31.007301  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.008109  4654 raft_consensus.cc:3060] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.007341  4870 ts_tablet_manager.cc:1403] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.046s
I20260709 13:14:31.009567  4780 leader_election.cc:290] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.012166  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
W20260709 13:14:31.016217  4544 leader_election.cc:343] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.018567  4869 raft_consensus.cc:359] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.019412  4869 raft_consensus.cc:385] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.019784  4869 raft_consensus.cc:740] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.020643  4869 consensus_queue.cc:260] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.021162  4870 raft_consensus.cc:359] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.022241  4870 raft_consensus.cc:385] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.022517  4870 raft_consensus.cc:740] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.022867  4869 ts_tablet_manager.cc:1434] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:14:31.023904  4869 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:31.023329  4870 consensus_queue.cc:260] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.025630  4882 raft_consensus.cc:493] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.026080  4882 raft_consensus.cc:515] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.028167  4882 leader_election.cc:290] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.030498  4870 ts_tablet_manager.cc:1434] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:14:31.030733  4869 tablet_bootstrap.cc:654] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.031574  4870 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:31.033643  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
W20260709 13:14:31.035348  4544 leader_election.cc:343] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.023855  4871 raft_consensus.cc:359] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.036309  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.036366  4871 raft_consensus.cc:385] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.037026  4655 raft_consensus.cc:2468] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:31.039490  4870 tablet_bootstrap.cc:654] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.039386  4545 leader_election.cc:304] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.041868  4780 raft_consensus.cc:2804] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.045090  4780 raft_consensus.cc:493] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.045676  4780 raft_consensus.cc:3060] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.028172  4476 catalog_manager.cc:5697] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.037734  4871 raft_consensus.cc:740] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.049911  4871 consensus_queue.cc:260] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.036562  4654 raft_consensus.cc:2468] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.051692  4870 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.051767  4545 leader_election.cc:304] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.052762  4882 raft_consensus.cc:2804] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.055593  4869 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.056347  4869 ts_tablet_manager.cc:1403] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.017s
I20260709 13:14:31.057049  4780 raft_consensus.cc:515] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.052429  4870 ts_tablet_manager.cc:1403] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:14:31.060051  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.060654  4654 raft_consensus.cc:3060] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.060817  4869 raft_consensus.cc:359] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.061585  4869 raft_consensus.cc:385] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.061904  4869 raft_consensus.cc:740] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.062108  4870 raft_consensus.cc:359] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.062860  4870 raft_consensus.cc:385] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.062714  4869 consensus_queue.cc:260] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.065945  4871 ts_tablet_manager.cc:1434] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 13:14:31.065956  4869 ts_tablet_manager.cc:1434] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.008s
I20260709 13:14:31.063166  4870 raft_consensus.cc:740] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.067718  4869 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:31.068465  4870 consensus_queue.cc:260] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.069810  4871 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:31.077031  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.077591  4869 tablet_bootstrap.cc:654] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:31.078920  4544 leader_election.cc:343] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.083992  4882 raft_consensus.cc:697] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.084971  4871 tablet_bootstrap.cc:654] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.086447  4869 tablet_bootstrap.cc:492] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.087200  4869 ts_tablet_manager.cc:1403] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:14:31.085000  4882 consensus_queue.cc:237] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.090273  4870 ts_tablet_manager.cc:1434] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.004s
I20260709 13:14:31.090538  4869 raft_consensus.cc:359] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.091327  4870 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:31.091387  4869 raft_consensus.cc:385] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.091867  4869 raft_consensus.cc:740] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.092319  4780 leader_election.cc:290] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.092741  4869 consensus_queue.cc:260] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.096834  4871 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.097909  4871 ts_tablet_manager.cc:1403] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.009s
I20260709 13:14:31.099308  4869 ts_tablet_manager.cc:1434] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:14:31.100351  4869 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:31.104233  4870 tablet_bootstrap.cc:654] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.100910  4871 raft_consensus.cc:359] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.105279  4871 raft_consensus.cc:385] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.105544  4871 raft_consensus.cc:740] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.106279  4871 consensus_queue.cc:260] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.109628  4871 ts_tablet_manager.cc:1434] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:31.110680  4871 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:31.111940  4869 tablet_bootstrap.cc:654] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.113821  4476 catalog_manager.cc:5697] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.121619  4799 raft_consensus.cc:493] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.122385  4799 raft_consensus.cc:515] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.125259  4799 leader_election.cc:290] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:31.128221  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.129165  4579 raft_consensus.cc:2468] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 0.
I20260709 13:14:31.130461  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.132318  4871 tablet_bootstrap.cc:654] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.132879  4694 leader_election.cc:304] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
W20260709 13:14:31.134198  4694 leader_election.cc:343] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.135999  4799 raft_consensus.cc:2804] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.136557  4799 raft_consensus.cc:493] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.137013  4799 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.139797  4869 tablet_bootstrap.cc:492] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.140363  4869 ts_tablet_manager.cc:1403] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 13:14:31.143428  4883 raft_consensus.cc:493] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.143383  4869 raft_consensus.cc:359] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.144445  4869 raft_consensus.cc:385] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.144212  4883 raft_consensus.cc:515] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.144898  4869 raft_consensus.cc:740] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.145936  4869 consensus_queue.cc:260] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.146835  4883 leader_election.cc:290] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:31.148700  4869 ts_tablet_manager.cc:1434] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:31.149699  4869 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:31.149880  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.151033  4655 raft_consensus.cc:2393] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c728aa7dc1fb442b98ebe0a2c325bfed in current term 1: Already voted for candidate 48d4eb2cd6774ac2968ff250380b99c0 in this term.
I20260709 13:14:31.152601  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a033ec9f51314e999d88b9d95517545d" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.157387  4694 leader_election.cc:304] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:31.159001  4883 raft_consensus.cc:3060] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.160846  4869 tablet_bootstrap.cc:654] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.169476  4654 raft_consensus.cc:2468] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.180260  4545 leader_election.cc:304] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.181595  4882 raft_consensus.cc:2804] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.182088  4882 raft_consensus.cc:697] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.182224  4869 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.182741  4869 ts_tablet_manager.cc:1403] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.008s
I20260709 13:14:31.182940  4882 consensus_queue.cc:237] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.185554  4869 raft_consensus.cc:359] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.186311  4869 raft_consensus.cc:385] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.186555  4869 raft_consensus.cc:740] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.187211  4869 consensus_queue.cc:260] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.189409  4869 ts_tablet_manager.cc:1434] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:31.192654  4869 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: Bootstrap starting.
I20260709 13:14:31.200305  4869 tablet_bootstrap.cc:654] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.206954  4478 catalog_manager.cc:5697] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.213318  4869 tablet_bootstrap.cc:492] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: No bootstrap required, opened a new log
I20260709 13:14:31.214105  4869 ts_tablet_manager.cc:1403] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 13:14:31.218849  4883 raft_consensus.cc:2749] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:31.221799  4799 raft_consensus.cc:515] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.222510  4869 raft_consensus.cc:359] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.227631  4869 raft_consensus.cc:385] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.227923  4869 raft_consensus.cc:740] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.228703  4858 raft_consensus.cc:493] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.228578  4869 consensus_queue.cc:260] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.222755  4870 tablet_bootstrap.cc:492] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.229238  4858 raft_consensus.cc:515] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.229879  4870 ts_tablet_manager.cc:1403] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.139s	user 0.056s	sys 0.068s
I20260709 13:14:31.230122  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:31.230692  4579 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.230820  4869 ts_tablet_manager.cc:1434] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:31.232986  4870 raft_consensus.cc:359] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.233727  4870 raft_consensus.cc:385] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.234005  4870 raft_consensus.cc:740] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.234429  4858 leader_election.cc:290] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.234701  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.234902  4870 consensus_queue.cc:260] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.236716  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.237020  4871 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.237322  4870 ts_tablet_manager.cc:1434] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:31.237581  4871 ts_tablet_manager.cc:1403] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.045s
W20260709 13:14:31.238032  4619 leader_election.cc:343] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.238770  4870 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:31.241010  4871 raft_consensus.cc:359] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.241696  4871 raft_consensus.cc:385] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.241999  4871 raft_consensus.cc:740] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.242774  4871 consensus_queue.cc:260] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.245292  4871 ts_tablet_manager.cc:1434] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:31.246315  4871 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:31.246356  4870 tablet_bootstrap.cc:654] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.246393  4579 raft_consensus.cc:2468] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
W20260709 13:14:31.250388  4620 leader_election.cc:343] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.250516  4694 leader_election.cc:304] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.250923  4620 leader_election.cc:304] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f; no voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.251405  4883 raft_consensus.cc:2804] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.251860  4883 raft_consensus.cc:697] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:31.252060  4858 raft_consensus.cc:2749] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:31.252710  4883 consensus_queue.cc:237] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.254173  4871 tablet_bootstrap.cc:654] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.257030  4858 raft_consensus.cc:493] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.257637  4858 raft_consensus.cc:515] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.259934  4858 leader_election.cc:290] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.261124  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.261744  4654 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.266752  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134f97606e144646a809df92c1666cc4" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.267421  4728 raft_consensus.cc:2468] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 0.
I20260709 13:14:31.268674  4619 leader_election.cc:304] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.269536  4858 raft_consensus.cc:2804] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.269881  4858 raft_consensus.cc:493] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.270228  4858 raft_consensus.cc:3060] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.274466  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134f97606e144646a809df92c1666cc4" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.274863  4870 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.275658  4799 leader_election.cc:290] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:31.275942  4870 ts_tablet_manager.cc:1403] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.020s
I20260709 13:14:31.276835  4654 raft_consensus.cc:2468] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 1.
I20260709 13:14:31.276269  4579 raft_consensus.cc:2468] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 0.
I20260709 13:14:31.281313  4882 raft_consensus.cc:493] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.281383  4870 raft_consensus.cc:359] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.282644  4870 raft_consensus.cc:385] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.283032  4870 raft_consensus.cc:740] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.281828  4882 raft_consensus.cc:515] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.283975  4870 consensus_queue.cc:260] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.285575  4882 leader_election.cc:290] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.285287  4858 raft_consensus.cc:515] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.287236  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.287663  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.287946  4870 ts_tablet_manager.cc:1434] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:14:31.289187  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134f97606e144646a809df92c1666cc4" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:31.289738  4580 raft_consensus.cc:3060] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.293233  4870 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:31.302428  4870 tablet_bootstrap.cc:654] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.301719  4892 raft_consensus.cc:493] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.303951  4892 raft_consensus.cc:515] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.304468  4871 tablet_bootstrap.cc:492] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.304994  4871 ts_tablet_manager.cc:1403] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.059s	user 0.027s	sys 0.027s
I20260709 13:14:31.304942  4580 raft_consensus.cc:2468] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 1.
I20260709 13:14:31.287981  4654 raft_consensus.cc:2393] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48d4eb2cd6774ac2968ff250380b99c0 in current term 1: Already voted for candidate c728aa7dc1fb442b98ebe0a2c325bfed in this term.
I20260709 13:14:31.307255  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a8d6550493473fa20ddb635de9f9eb" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.307876  4728 raft_consensus.cc:2468] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 0.
I20260709 13:14:31.307572  4545 leader_election.cc:304] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0; no voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.308754  4882 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.309139  4619 leader_election.cc:304] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.309784  4858 leader_election.cc:290] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.310371  4892 leader_election.cc:290] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.310906  4892 raft_consensus.cc:2804] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.311220  4892 raft_consensus.cc:493] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.311901  4892 raft_consensus.cc:3060] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.308326  4871 raft_consensus.cc:359] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.316534  4882 raft_consensus.cc:2749] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:31.319275  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "134f97606e144646a809df92c1666cc4" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.319837  4728 raft_consensus.cc:3060] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.316810  4871 raft_consensus.cc:385] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.322069  4871 raft_consensus.cc:740] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.323128  4871 consensus_queue.cc:260] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.324569  4892 raft_consensus.cc:515] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.327872  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a8d6550493473fa20ddb635de9f9eb" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.328291  4728 raft_consensus.cc:2468] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 1.
I20260709 13:14:31.328457  4729 raft_consensus.cc:3060] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.329561  4619 leader_election.cc:304] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.330188  4871 ts_tablet_manager.cc:1434] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:14:31.331633  4871 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:31.334390  4908 raft_consensus.cc:2804] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.334969  4908 raft_consensus.cc:697] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:31.336125  4729 raft_consensus.cc:2468] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 1.
I20260709 13:14:31.335806  4908 consensus_queue.cc:237] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.337241  4892 leader_election.cc:290] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.333217  4476 catalog_manager.cc:5697] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 0 to 1, leader changed from <none> to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 1 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.337504  4870 tablet_bootstrap.cc:492] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.337316  4619 leader_election.cc:304] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.338534  4870 ts_tablet_manager.cc:1403] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.027s
I20260709 13:14:31.342242  4870 raft_consensus.cc:359] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.343379  4892 raft_consensus.cc:2804] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.344094  4892 raft_consensus.cc:697] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 1 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:31.344867  4871 tablet_bootstrap.cc:654] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.344969  4892 consensus_queue.cc:237] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.345707  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a8d6550493473fa20ddb635de9f9eb" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.343489  4870 raft_consensus.cc:385] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.347054  4870 raft_consensus.cc:740] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.348374  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a8d6550493473fa20ddb635de9f9eb" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:31.349438  4870 consensus_queue.cc:260] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.350566  4579 raft_consensus.cc:2468] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 0.
I20260709 13:14:31.351886  4870 ts_tablet_manager.cc:1434] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:31.352890  4870 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: Bootstrap starting.
I20260709 13:14:31.360632  4870 tablet_bootstrap.cc:654] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.379703  4882 raft_consensus.cc:493] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.380465  4870 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: No bootstrap required, opened a new log
I20260709 13:14:31.380292  4882 raft_consensus.cc:515] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.380478  4871 tablet_bootstrap.cc:492] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.381109  4870 ts_tablet_manager.cc:1403] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 13:14:31.381383  4871 ts_tablet_manager.cc:1403] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.001s
I20260709 13:14:31.382477  4882 leader_election.cc:290] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.381736  4476 catalog_manager.cc:5697] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 1 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.384017  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.384092  4870 raft_consensus.cc:359] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.384821  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.384831  4870 raft_consensus.cc:385] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.385465  4870 raft_consensus.cc:740] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.385520  4654 raft_consensus.cc:2468] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
W20260709 13:14:31.385771  4544 leader_election.cc:343] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:31.386212  4870 consensus_queue.cc:260] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.387260  4871 raft_consensus.cc:359] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.387792  4870 ts_tablet_manager.cc:1434] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:31.388778  4871 raft_consensus.cc:385] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.390344  4871 raft_consensus.cc:740] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.391108  4871 consensus_queue.cc:260] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.391513  4545 leader_election.cc:304] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.392879  4780 raft_consensus.cc:2804] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.393182  4780 raft_consensus.cc:493] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.393455  4780 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.393520  4871 ts_tablet_manager.cc:1434] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:14:31.394564  4871 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: Bootstrap starting.
I20260709 13:14:31.400537  4871 tablet_bootstrap.cc:654] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:31.404914  4780 raft_consensus.cc:515] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.407640  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.408216  4654 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.408454  4477 catalog_manager.cc:5697] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 1 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.415319  4654 raft_consensus.cc:2468] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.417018  4545 leader_election.cc:304] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:31.417868  4882 raft_consensus.cc:2804] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.418345  4882 raft_consensus.cc:697] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.419134  4882 consensus_queue.cc:237] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.425133  4780 leader_election.cc:290] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.427815  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.428498  4729 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:31.432936  4526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:31.434298  4871 tablet_bootstrap.cc:492] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: No bootstrap required, opened a new log
I20260709 13:14:31.434787  4871 ts_tablet_manager.cc:1403] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.010s
I20260709 13:14:31.436034  4729 raft_consensus.cc:2468] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.437347  4871 raft_consensus.cc:359] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.437947  4871 raft_consensus.cc:385] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:31.438222  4871 raft_consensus.cc:740] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Initialized, Role: FOLLOWER
I20260709 13:14:31.438958  4871 consensus_queue.cc:260] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.440833  4871 ts_tablet_manager.cc:1434] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:31.440855  4477 catalog_manager.cc:5697] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.442845  4655 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.450243  4883 consensus_queue.cc:1048] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.466293  4883 consensus_queue.cc:1048] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.487500  4882 raft_consensus.cc:493] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.487964  4882 raft_consensus.cc:515] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.489673  4882 leader_election.cc:290] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.490470  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.490808  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" is_pre_election: true
I20260709 13:14:31.491210  4655 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:31.491504  4729 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 0.
I20260709 13:14:31.492462  4545 leader_election.cc:304] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:31.493283  4882 raft_consensus.cc:2804] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:31.493641  4882 raft_consensus.cc:493] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.493956  4882 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.500703  4882 raft_consensus.cc:515] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.502408  4882 leader_election.cc:290] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.503176  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.503350  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.503770  4655 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.504136  4729 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.509958  4655 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.510284  4729 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 1.
I20260709 13:14:31.511305  4545 leader_election.cc:304] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:31.511996  4882 raft_consensus.cc:2804] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:31.512494  4882 raft_consensus.cc:697] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.513250  4882 consensus_queue.cc:237] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.520437  4476 catalog_manager.cc:5697] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 1 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.554908  4883 consensus_queue.cc:1048] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.565704  4881 consensus_queue.cc:1048] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.598345  4729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:31.598914  4729 raft_consensus.cc:606] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:31.606153  4729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:31.606676  4729 raft_consensus.cc:606] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 48d4eb2cd6774ac2968ff250380b99c0
I20260709 13:14:31.613564  4729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:37594
I20260709 13:14:31.614136  4729 raft_consensus.cc:606] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:31.621389  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f314587018054cd189c433ca87522c51"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
mode: GRACEFUL
new_leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:51982
I20260709 13:14:31.621861  4579 raft_consensus.cc:606] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Received request to transfer leadership to TS 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:31.628933  4579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
mode: GRACEFUL
new_leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:51982
I20260709 13:14:31.629388  4579 raft_consensus.cc:606] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Received request to transfer leadership to TS c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:31.630669  4881 raft_consensus.cc:493] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.631148  4881 raft_consensus.cc:515] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.632604  4881 leader_election.cc:290] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:31.633381  4579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0" is_pre_election: true
I20260709 13:14:31.633646  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393c2604125242598947039065b7abd3" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f" is_pre_election: true
I20260709 13:14:31.635317  4655 raft_consensus.cc:2393] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c728aa7dc1fb442b98ebe0a2c325bfed in current term 1: Already voted for candidate 48d4eb2cd6774ac2968ff250380b99c0 in this term.
I20260709 13:14:31.636242  4694 leader_election.cc:304] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f
I20260709 13:14:31.636888  4881 raft_consensus.cc:3060] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.642000  4881 raft_consensus.cc:2749] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:31.669346  4882 consensus_queue.cc:1048] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.680987  4924 consensus_queue.cc:1048] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:31.736421  4924 consensus_queue.cc:1048] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.746208  4893 consensus_queue.cc:1048] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.770566  4881 consensus_queue.cc:1048] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.776584  4883 raft_consensus.cc:993] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:31.777040  4883 raft_consensus.cc:1081] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:31.778787  4654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46538
I20260709 13:14:31.781100  4654 raft_consensus.cc:493] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.781446  4654 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.782303  4881 consensus_queue.cc:1048] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.787966  4654 raft_consensus.cc:515] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.791821  4654 leader_election.cc:290] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.793665  4729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.794257  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f36e4c6f5c3e4f358da36b89aaeb3f42" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:31.794252  4729 raft_consensus.cc:3055] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.794875  4580 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.794844  4729 raft_consensus.cc:740] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:31.795898  4729 consensus_queue.cc:260] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
W20260709 13:14:31.796838  4883 consensus_queue.cc:1175] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "48d4eb2cd6774ac2968ff250380b99c0" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:14:31.797037  4729 raft_consensus.cc:3060] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.802423  4580 raft_consensus.cc:2468] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:31.803666  4620 leader_election.cc:304] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:31.803884  4729 raft_consensus.cc:2468] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:31.804508  4908 raft_consensus.cc:2804] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.804975  4908 raft_consensus.cc:697] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:31.805739  4908 consensus_queue.cc:237] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.812273  4477 catalog_manager.cc:5697] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.888690  4883 raft_consensus.cc:993] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:31.889201  4881 raft_consensus.cc:1081] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:31.891098  4580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:14:31.891654  4580 raft_consensus.cc:493] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.892041  4580 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.897157  4580 raft_consensus.cc:515] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.899298  4580 leader_election.cc:290] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.899629  4654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:31.900173  4728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85a881448c6477ab7fc13367281ea9c" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.900238  4654 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.900799  4728 raft_consensus.cc:3055] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.901165  4728 raft_consensus.cc:740] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:31.901636  4580 raft_consensus.cc:3060] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:31.901875  4728 consensus_queue.cc:260] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.902545  4858 consensus_queue.cc:1048] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.903131  4728 raft_consensus.cc:3060] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.910791  4858 consensus_queue.cc:1048] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.911118  4728 raft_consensus.cc:2468] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:31.912708  4544 leader_election.cc:304] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.913640  4893 raft_consensus.cc:2804] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.914829  4893 raft_consensus.cc:697] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.915840  4893 consensus_queue.cc:237] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.917435  4858 consensus_queue.cc:1048] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.914846  4654 raft_consensus.cc:2468] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:31.930085  4908 consensus_queue.cc:1048] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.933274  4477 catalog_manager.cc:5697] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.950580  4893 consensus_queue.cc:1048] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.959836  4893 raft_consensus.cc:993] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: : Instructing follower 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:31.960299  4893 raft_consensus.cc:1081] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Signalling peer 88a71168b69a4586a29ac25e6f7eb43f to start an election
I20260709 13:14:31.965718  4655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f314587018054cd189c433ca87522c51"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
 from {username='slave'} at 127.0.0.1:46542
I20260709 13:14:31.966316  4655 raft_consensus.cc:493] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.966689  4655 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.968143  4924 consensus_queue.cc:1048] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:31.978252  4655 raft_consensus.cc:515] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.982102  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:31.982724  4580 raft_consensus.cc:3055] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.982602  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f314587018054cd189c433ca87522c51" candidate_uuid: "88a71168b69a4586a29ac25e6f7eb43f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:31.983196  4580 raft_consensus.cc:740] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:31.983603  4726 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.983810  4655 leader_election.cc:290] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:31.984061  4580 consensus_queue.cc:260] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:31.987960  4580 raft_consensus.cc:3060] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.992076  4726 raft_consensus.cc:2468] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:31.993345  4619 leader_election.cc:304] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:31.994177  4934 raft_consensus.cc:2804] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.994632  4934 raft_consensus.cc:697] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Leader. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:31.995532  4580 raft_consensus.cc:2468] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88a71168b69a4586a29ac25e6f7eb43f in term 2.
I20260709 13:14:31.995435  4934 consensus_queue.cc:237] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.002449  4477 catalog_manager.cc:5697] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f reported cstate change: term changed from 1 to 2, leader changed from 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129) to 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130). New cstate: current_term: 2 leader_uuid: "88a71168b69a4586a29ac25e6f7eb43f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.011631  4924 consensus_queue.cc:1048] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:32.017875  4893 raft_consensus.cc:993] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: : Instructing follower c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:32.018395  4780 raft_consensus.cc:1081] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Signalling peer c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:32.020130  4727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:32.021513  4727 raft_consensus.cc:493] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.021903  4727 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.024425  4893 consensus_queue.cc:1048] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:32.029403  4727 raft_consensus.cc:515] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.032243  4580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:32.032846  4580 raft_consensus.cc:3055] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.033097  4727 leader_election.cc:290] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 2 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:32.033172  4580 raft_consensus.cc:740] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:32.033430  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026e2fb2a3244e209c17e41bfb14c3c6" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:32.034180  4655 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.034431  4580 consensus_queue.cc:260] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.036141  4580 raft_consensus.cc:3060] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.040649  4655 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 2.
I20260709 13:14:32.041893  4694 leader_election.cc:304] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88a71168b69a4586a29ac25e6f7eb43f, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:32.042747  4881 raft_consensus.cc:2804] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.043241  4881 raft_consensus.cc:697] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:32.043315  4580 raft_consensus.cc:2468] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 2.
I20260709 13:14:32.044131  4881 consensus_queue.cc:237] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.050755  4477 catalog_manager.cc:5697] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 1 to 2, leader changed from 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129) to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 2 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:32.074489  4881 raft_consensus.cc:993] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: : Instructing follower 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:32.075031  4799 raft_consensus.cc:1081] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Signalling peer 48d4eb2cd6774ac2968ff250380b99c0 to start an election
I20260709 13:14:32.076486  4580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
 from {username='slave'} at 127.0.0.1:51972
I20260709 13:14:32.077282  4580 raft_consensus.cc:493] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.077669  4580 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.082842  4580 raft_consensus.cc:515] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.084415  4580 leader_election.cc:290] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Requested vote from peers 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709), c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131:35599)
I20260709 13:14:32.085223  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:32.085485  4727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47c7732f0c14429ab702a72bcd1a46a" candidate_uuid: "48d4eb2cd6774ac2968ff250380b99c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
I20260709 13:14:32.085857  4655 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.086045  4727 raft_consensus.cc:3055] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:32.086403  4727 raft_consensus.cc:740] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:32.087226  4727 consensus_queue.cc:260] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.088456  4727 raft_consensus.cc:3060] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:32.092408  4655 raft_consensus.cc:2468] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:32.093600  4545 leader_election.cc:304] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, 88a71168b69a4586a29ac25e6f7eb43f; no voters: 
I20260709 13:14:32.094398  4893 raft_consensus.cc:2804] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:32.094811  4893 raft_consensus.cc:697] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Becoming Leader. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:32.095336  4727 raft_consensus.cc:2468] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d4eb2cd6774ac2968ff250380b99c0 in term 2.
I20260709 13:14:32.095551  4893 consensus_queue.cc:237] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:32.102001  4477 catalog_manager.cc:5697] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 reported cstate change: term changed from 1 to 2, leader changed from c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131) to 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129). New cstate: current_term: 2 leader_uuid: "48d4eb2cd6774ac2968ff250380b99c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.319283  4727 raft_consensus.cc:1275] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.320544  4934 consensus_queue.cc:1048] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.322990  4726 raft_consensus.cc:1275] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.324277  4924 consensus_queue.cc:1048] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.329435  4579 raft_consensus.cc:1275] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.331979  4933 consensus_queue.cc:1048] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:32.335919  4655 raft_consensus.cc:1275] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.337746  4924 consensus_queue.cc:1048] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.453316  4579 raft_consensus.cc:1275] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.454586  4934 consensus_queue.cc:1048] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.464653  4726 raft_consensus.cc:1275] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 88a71168b69a4586a29ac25e6f7eb43f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.466327  4858 consensus_queue.cc:1048] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.474408  4579 raft_consensus.cc:1275] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.475682  4799 consensus_queue.cc:1048] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.484062  4655 raft_consensus.cc:1275] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.485795  4881 consensus_queue.cc:1048] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.586114  4655 raft_consensus.cc:1275] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.587563  4924 consensus_queue.cc:1048] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.596868  4726 raft_consensus.cc:1275] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Refusing update from remote peer 48d4eb2cd6774ac2968ff250380b99c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.598680  4924 consensus_queue.cc:1048] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:34.632310  4476 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36130:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:34.650555  4476 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36130:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:34.709024 26038 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:34.836057  4620 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:37037, user_credentials={real_user=slave}} blocked reactor thread for 111613us
I20260709 13:14:34.855507  4651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a"
dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
mode: GRACEFUL
new_leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:35762
I20260709 13:14:34.860991  4651 raft_consensus.cc:606] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Received request to transfer leadership to TS c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:34.884828  4994 tablet.cc:1724] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:34.845501  4985 tablet.cc:1724] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:34.899641  4981 log.cc:927] Time spent T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:14:34.927592  4992 tablet.cc:1724] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:34.944373  4619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:35599, user_credentials={real_user=slave}} blocked reactor thread for 58713.1us
W20260709 13:14:34.963975  4544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.131:35599, user_credentials={real_user=slave}} blocked reactor thread for 97079.2us
I20260709 13:14:34.970096  5005 tablet.cc:1724] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:34.881217  4986 tablet.cc:1724] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:34.996219  5004 tablet.cc:1724] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:34.996565  4998 tablet.cc:1724] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.077057  4985 tablet.cc:1724] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.102020  5010 tablet.cc:1724] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.106033  5004 tablet.cc:1724] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.111568  4578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe"
dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
mode: GRACEFUL
new_leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:42572
I20260709 13:14:35.112210  4578 raft_consensus.cc:606] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Received request to transfer leadership to TS c728aa7dc1fb442b98ebe0a2c325bfed
I20260709 13:14:35.094708  5012 tablet.cc:1724] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.113744 26038 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:35.114418 26038 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:35.118245  5009 tablet.cc:1724] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.121328  4998 tablet.cc:1724] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.121423  5013 tablet.cc:1724] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.126072  4992 tablet.cc:1724] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.127395  4994 tablet.cc:1724] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.127498  4986 tablet.cc:1724] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.130779  4893 raft_consensus.cc:993] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: : Instructing follower c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:35.132784  4893 raft_consensus.cc:1081] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Signalling peer c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:35.136818  5002 raft_consensus.cc:993] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: : Instructing follower c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:35.137277  5002 raft_consensus.cc:1081] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Signalling peer c728aa7dc1fb442b98ebe0a2c325bfed to start an election
I20260709 13:14:35.145902  4729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:37564
I20260709 13:14:35.146634  4729 raft_consensus.cc:493] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.147055  4729 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.152913  4728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe"
dest_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed"
 from {username='slave'} at 127.0.0.1:37578
I20260709 13:14:35.152597  4998 tablet.cc:1724] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.153491  4728 raft_consensus.cc:493] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.153926  4728 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.137481  5004 tablet.cc:1724] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.161424  4728 raft_consensus.cc:515] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:35.159011  4729 raft_consensus.cc:515] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
W20260709 13:14:35.099665  4694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.109.129:37037, user_credentials={real_user=slave}} blocked reactor thread for 106906us
I20260709 13:14:35.167446  5010 tablet.cc:1724] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.175576  4728 leader_election.cc:290] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 3 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:35.179502  4729 leader_election.cc:290] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 3 election: Requested vote from peers 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037), 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709)
I20260709 13:14:35.182643  4578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:35.183247  4578 raft_consensus.cc:3055] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:35.183537  4578 raft_consensus.cc:740] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48d4eb2cd6774ac2968ff250380b99c0, State: Running, Role: LEADER
I20260709 13:14:35.184268  4578 consensus_queue.cc:260] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:35.185550  4578 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.167847  5005 tablet.cc:1724] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.186019  4985 tablet.cc:1724] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.193287  4994 tablet.cc:1724] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.195492  4653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e0032508c44b319e3f094f36f2ccbe" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:35.196236  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48d4eb2cd6774ac2968ff250380b99c0"
I20260709 13:14:35.196815  4578 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 3.
I20260709 13:14:35.196925  4576 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.196280  4653 raft_consensus.cc:3060] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.200325  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c35467d9e6c54285899096d61c4e1b4a" candidate_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88a71168b69a4586a29ac25e6f7eb43f"
I20260709 13:14:35.200896  4655 raft_consensus.cc:3055] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:35.201164  4655 raft_consensus.cc:740] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88a71168b69a4586a29ac25e6f7eb43f, State: Running, Role: LEADER
I20260709 13:14:35.201895  4655 consensus_queue.cc:260] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:35.203261  4655 raft_consensus.cc:3060] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:35.205727  4576 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 3.
I20260709 13:14:35.208344  4694 leader_election.cc:304] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:35.209254  4881 raft_consensus.cc:2804] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:35.209733  4881 raft_consensus.cc:697] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:35.209779  4998 tablet.cc:1724] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.210601  4881 consensus_queue.cc:237] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:35.212471  4653 raft_consensus.cc:2468] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 3.
I20260709 13:14:35.214193  4694 leader_election.cc:304] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d4eb2cd6774ac2968ff250380b99c0, c728aa7dc1fb442b98ebe0a2c325bfed; no voters: 
I20260709 13:14:35.215170  5011 raft_consensus.cc:2804] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:35.216243  4655 raft_consensus.cc:2468] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728aa7dc1fb442b98ebe0a2c325bfed in term 3.
I20260709 13:14:35.223804  5014 tablet.cc:1724] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.234696  4994 tablet.cc:1724] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.157671  5012 tablet.cc:1724] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:35.260711  5011 raft_consensus.cc:697] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 LEADER]: Becoming Leader. State: Replica: c728aa7dc1fb442b98ebe0a2c325bfed, State: Running, Role: LEADER
I20260709 13:14:35.261833  5011 consensus_queue.cc:237] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } }
I20260709 13:14:35.272150  4477 catalog_manager.cc:5697] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 2 to 3, leader changed from 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130) to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 3 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.276764  4478 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: soft_deleted_table [id=0ecf10a5034048a1893bacd10e73327f] alter complete (version 1)
I20260709 13:14:35.288798  4477 catalog_manager.cc:5697] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed reported cstate change: term changed from 2 to 3, leader changed from 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129) to c728aa7dc1fb442b98ebe0a2c325bfed (127.25.109.131). New cstate: current_term: 3 leader_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728aa7dc1fb442b98ebe0a2c325bfed" member_type: VOTER last_known_addr { host: "127.25.109.131" port: 35599 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.685400  4655 raft_consensus.cc:1275] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:35.686547  5011 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:35.697389  4576 raft_consensus.cc:1275] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:35.698661  5011 consensus_queue.cc:1048] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:35.790500  4576 raft_consensus.cc:1275] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:35.791720  5011 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d4eb2cd6774ac2968ff250380b99c0" member_type: VOTER last_known_addr { host: "127.25.109.129" port: 37037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:35.800758  4655 raft_consensus.cc:1275] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Refusing update from remote peer c728aa7dc1fb442b98ebe0a2c325bfed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:35.802793  5017 consensus_queue.cc:1048] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [LEADER]: Connected to new peer: Peer: permanent_uuid: "88a71168b69a4586a29ac25e6f7eb43f" member_type: VOTER last_known_addr { host: "127.25.109.130" port: 42709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.172351 26038 tablet_server.cc:179] TabletServer@127.25.109.129:0 shutting down...
W20260709 13:14:36.191071  4620 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 152 similar messages]
W20260709 13:14:36.202936  4620 consensus_peers.cc:597] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:36.271507  4620 consensus_peers.cc:597] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:36.274646  4620 consensus_peers.cc:597] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.286439 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:36.287452 26038 tablet_replica.cc:333] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.288488 26038 raft_consensus.cc:2243] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.290331 26038 raft_consensus.cc:2272] T c47c7732f0c14429ab702a72bcd1a46a P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.293371 26038 tablet_replica.cc:333] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.294196 26038 raft_consensus.cc:2243] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.295053 26038 raft_consensus.cc:2272] T 134f97606e144646a809df92c1666cc4 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.300393 26038 tablet_replica.cc:333] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.303638 26038 raft_consensus.cc:2243] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.305439 26038 raft_consensus.cc:2272] T f314587018054cd189c433ca87522c51 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:36.306526  4694 consensus_peers.cc:597] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:36.308480  4694 consensus_peers.cc:597] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.309944 26038 tablet_replica.cc:333] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.310810 26038 raft_consensus.cc:2243] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.311444 26038 raft_consensus.cc:2272] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.313997 26038 tablet_replica.cc:333] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.314821 26038 raft_consensus.cc:2243] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.316160 26038 raft_consensus.cc:2272] T a033ec9f51314e999d88b9d95517545d P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.318856 26038 tablet_replica.cc:333] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.319536 26038 raft_consensus.cc:2243] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.320955 26038 raft_consensus.cc:2272] T 393c2604125242598947039065b7abd3 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.323639 26038 tablet_replica.cc:333] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.324256 26038 raft_consensus.cc:2243] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.324795 26038 raft_consensus.cc:2272] T e7e0032508c44b319e3f094f36f2ccbe P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.329082 26038 tablet_replica.cc:333] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.330013 26038 raft_consensus.cc:2243] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.331440 26038 raft_consensus.cc:2272] T 057b86ef297843e28616765bb31ffff0 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.334012 26038 tablet_replica.cc:333] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.334697 26038 raft_consensus.cc:2243] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.335283 26038 raft_consensus.cc:2272] T 92a8d6550493473fa20ddb635de9f9eb P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.337769 26038 tablet_replica.cc:333] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.338472 26038 raft_consensus.cc:2243] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.339026 26038 raft_consensus.cc:2272] T 7b31502a6b9141b980a52edb2d4c5561 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.341566 26038 tablet_replica.cc:333] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.342132 26038 raft_consensus.cc:2243] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.343295 26038 raft_consensus.cc:2272] T 1c935859d87347bab4bb7176514f8963 P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.345700 26038 tablet_replica.cc:333] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.346271 26038 raft_consensus.cc:2243] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.346880 26038 raft_consensus.cc:2272] T 026e2fb2a3244e209c17e41bfb14c3c6 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.349395 26038 tablet_replica.cc:333] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.349887 26038 raft_consensus.cc:2243] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.350471 26038 raft_consensus.cc:2272] T be25118dfd5f44e0a28773a45c3570f1 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.353026 26038 tablet_replica.cc:333] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.353645 26038 raft_consensus.cc:2243] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.354437 26038 raft_consensus.cc:2272] T 2070e07c74304c2e9539906d00439ab8 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:36.356969  4620 consensus_peers.cc:597] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.357764 26038 tablet_replica.cc:333] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.358408 26038 raft_consensus.cc:2243] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.359025 26038 raft_consensus.cc:2272] T 6a5d522cb8524e4b8367b098e22de53b P 48d4eb2cd6774ac2968ff250380b99c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.361518 26038 tablet_replica.cc:333] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.362035 26038 raft_consensus.cc:2243] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.362640 26038 raft_consensus.cc:2272] T c35467d9e6c54285899096d61c4e1b4a P 48d4eb2cd6774ac2968ff250380b99c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.365682 26038 tablet_replica.cc:333] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.366245 26038 raft_consensus.cc:2243] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.367439 26038 raft_consensus.cc:2272] T f85a881448c6477ab7fc13367281ea9c P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.370239 26038 tablet_replica.cc:333] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0: stopping tablet replica
I20260709 13:14:36.370841 26038 raft_consensus.cc:2243] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.372236 26038 raft_consensus.cc:2272] T 952ae1bdcb8e4198af7f34a5c5a62195 P 48d4eb2cd6774ac2968ff250380b99c0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:36.408113  4543 connection.cc:466] server connection from 127.0.0.1:51958 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51958 (request call id 130) could send its response
W20260709 13:14:36.414952  4620 consensus_peers.cc:597] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.420938 26038 tablet_server.cc:196] TabletServer@127.25.109.129:0 shutdown complete.
W20260709 13:14:36.421473  4620 consensus_peers.cc:597] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:36.436571  4694 consensus_peers.cc:597] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.468509 26038 tablet_server.cc:179] TabletServer@127.25.109.130:0 shutting down...
W20260709 13:14:36.480206  4694 consensus_peers.cc:597] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Couldn't send request to peer 88a71168b69a4586a29ac25e6f7eb43f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:36.481663  4694 consensus_peers.cc:597] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 48d4eb2cd6774ac2968ff250380b99c0 (127.25.109.129:37037): Couldn't send request to peer 48d4eb2cd6774ac2968ff250380b99c0. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.129:37037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.499290 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:36.500545 26038 tablet_replica.cc:333] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.501436 26038 raft_consensus.cc:2243] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.502607 26038 raft_consensus.cc:2272] T 134f97606e144646a809df92c1666cc4 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.505292 26038 tablet_replica.cc:333] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.505940 26038 raft_consensus.cc:2243] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.507225 26038 raft_consensus.cc:2272] T f36e4c6f5c3e4f358da36b89aaeb3f42 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.510229 26038 tablet_replica.cc:333] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.510913 26038 raft_consensus.cc:2243] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.512466 26038 raft_consensus.cc:2272] T f314587018054cd189c433ca87522c51 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.515416 26038 tablet_replica.cc:333] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.516117 26038 raft_consensus.cc:2243] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.516922 26038 raft_consensus.cc:2272] T a033ec9f51314e999d88b9d95517545d P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.519788 26038 tablet_replica.cc:333] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.520438 26038 raft_consensus.cc:2243] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.521116 26038 raft_consensus.cc:2272] T 393c2604125242598947039065b7abd3 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.524560 26038 tablet_replica.cc:333] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.525503 26038 raft_consensus.cc:2243] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.526891 26038 raft_consensus.cc:2272] T 92a8d6550493473fa20ddb635de9f9eb P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.529830 26038 tablet_replica.cc:333] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.530383 26038 raft_consensus.cc:2243] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.531237 26038 raft_consensus.cc:2272] T 7b31502a6b9141b980a52edb2d4c5561 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.533222 26038 tablet_replica.cc:333] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.533682 26038 raft_consensus.cc:2243] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.534183 26038 raft_consensus.cc:2272] T c35467d9e6c54285899096d61c4e1b4a P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.537060 26038 tablet_replica.cc:333] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.537562 26038 raft_consensus.cc:2243] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.538136 26038 raft_consensus.cc:2272] T c47c7732f0c14429ab702a72bcd1a46a P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.540216 26038 tablet_replica.cc:333] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.540760 26038 raft_consensus.cc:2243] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.541554 26038 raft_consensus.cc:2272] T f85a881448c6477ab7fc13367281ea9c P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.544574 26038 tablet_replica.cc:333] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.545161 26038 raft_consensus.cc:2243] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.545707 26038 raft_consensus.cc:2272] T 952ae1bdcb8e4198af7f34a5c5a62195 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.547930 26038 tablet_replica.cc:333] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.548429 26038 raft_consensus.cc:2243] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.548923 26038 raft_consensus.cc:2272] T 6a5d522cb8524e4b8367b098e22de53b P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.551162 26038 tablet_replica.cc:333] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.551661 26038 raft_consensus.cc:2243] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.552587 26038 raft_consensus.cc:2272] T 2070e07c74304c2e9539906d00439ab8 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.554607 26038 tablet_replica.cc:333] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.555155 26038 raft_consensus.cc:2243] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.555665 26038 raft_consensus.cc:2272] T 026e2fb2a3244e209c17e41bfb14c3c6 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.557909 26038 tablet_replica.cc:333] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.558429 26038 raft_consensus.cc:2243] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.559514 26038 raft_consensus.cc:2272] T be25118dfd5f44e0a28773a45c3570f1 P 88a71168b69a4586a29ac25e6f7eb43f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.561766 26038 tablet_replica.cc:333] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.562350 26038 raft_consensus.cc:2243] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.562932 26038 raft_consensus.cc:2272] T e7e0032508c44b319e3f094f36f2ccbe P 88a71168b69a4586a29ac25e6f7eb43f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.566586 26038 tablet_replica.cc:333] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.567224 26038 raft_consensus.cc:2243] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.567793 26038 raft_consensus.cc:2272] T 057b86ef297843e28616765bb31ffff0 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.570145 26038 tablet_replica.cc:333] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f: stopping tablet replica
I20260709 13:14:36.570648 26038 raft_consensus.cc:2243] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.571139 26038 raft_consensus.cc:2272] T 1c935859d87347bab4bb7176514f8963 P 88a71168b69a4586a29ac25e6f7eb43f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.614156 26038 tablet_server.cc:196] TabletServer@127.25.109.130:0 shutdown complete.
W20260709 13:14:36.647210  4694 consensus_peers.cc:597] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Couldn't send request to peer 88a71168b69a4586a29ac25e6f7eb43f. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42709: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.653726 26038 tablet_server.cc:179] TabletServer@127.25.109.131:0 shutting down...
W20260709 13:14:36.673092  4694 consensus_peers.cc:597] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed -> Peer 88a71168b69a4586a29ac25e6f7eb43f (127.25.109.130:42709): Couldn't send request to peer 88a71168b69a4586a29ac25e6f7eb43f. Status: Network error: Client connection negotiation failed: client connection to 127.25.109.130:42709: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.691916 26038 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:36.692781 26038 tablet_replica.cc:333] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.693732 26038 raft_consensus.cc:2243] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.694382 26038 raft_consensus.cc:2272] T 393c2604125242598947039065b7abd3 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.697471 26038 tablet_replica.cc:333] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.698042 26038 raft_consensus.cc:2243] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.698591 26038 raft_consensus.cc:2272] T f314587018054cd189c433ca87522c51 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.700775 26038 tablet_replica.cc:333] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.701301 26038 raft_consensus.cc:2243] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.701771 26038 raft_consensus.cc:2272] T f36e4c6f5c3e4f358da36b89aaeb3f42 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.703848 26038 tablet_replica.cc:333] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.704315 26038 raft_consensus.cc:2243] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.704761 26038 raft_consensus.cc:2272] T a033ec9f51314e999d88b9d95517545d P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.706822 26038 tablet_replica.cc:333] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.707329 26038 raft_consensus.cc:2243] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.708052 26038 raft_consensus.cc:2272] T 134f97606e144646a809df92c1666cc4 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.710355 26038 tablet_replica.cc:333] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.710815 26038 raft_consensus.cc:2243] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.711208 26038 raft_consensus.cc:2272] T 1c935859d87347bab4bb7176514f8963 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.713176 26038 tablet_replica.cc:333] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.713660 26038 raft_consensus.cc:2243] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.714643 26038 raft_consensus.cc:2272] T e7e0032508c44b319e3f094f36f2ccbe P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.717257 26038 tablet_replica.cc:333] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.717756 26038 raft_consensus.cc:2243] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.718274 26038 raft_consensus.cc:2272] T 057b86ef297843e28616765bb31ffff0 P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.720263 26038 tablet_replica.cc:333] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.720745 26038 raft_consensus.cc:2243] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.721165 26038 raft_consensus.cc:2272] T 92a8d6550493473fa20ddb635de9f9eb P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.723050 26038 tablet_replica.cc:333] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.723492 26038 raft_consensus.cc:2243] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.723906 26038 raft_consensus.cc:2272] T 7b31502a6b9141b980a52edb2d4c5561 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.725972 26038 tablet_replica.cc:333] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.726475 26038 raft_consensus.cc:2243] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.726927 26038 raft_consensus.cc:2272] T 952ae1bdcb8e4198af7f34a5c5a62195 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.728931 26038 tablet_replica.cc:333] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.729389 26038 raft_consensus.cc:2243] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.729882 26038 raft_consensus.cc:2272] T f85a881448c6477ab7fc13367281ea9c P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.731945 26038 tablet_replica.cc:333] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.732406 26038 raft_consensus.cc:2243] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.732921 26038 raft_consensus.cc:2272] T c47c7732f0c14429ab702a72bcd1a46a P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.735110 26038 tablet_replica.cc:333] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.735584 26038 raft_consensus.cc:2243] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.736418 26038 raft_consensus.cc:2272] T 6a5d522cb8524e4b8367b098e22de53b P c728aa7dc1fb442b98ebe0a2c325bfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.738540 26038 tablet_replica.cc:333] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.738998 26038 raft_consensus.cc:2243] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.739404 26038 raft_consensus.cc:2272] T 2070e07c74304c2e9539906d00439ab8 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.741339 26038 tablet_replica.cc:333] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.741775 26038 raft_consensus.cc:2243] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.742571 26038 raft_consensus.cc:2272] T c35467d9e6c54285899096d61c4e1b4a P c728aa7dc1fb442b98ebe0a2c325bfed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.744650 26038 tablet_replica.cc:333] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.745122 26038 raft_consensus.cc:2243] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.745893 26038 raft_consensus.cc:2272] T 026e2fb2a3244e209c17e41bfb14c3c6 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.747855 26038 tablet_replica.cc:333] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed: stopping tablet replica
I20260709 13:14:36.748224 26038 raft_consensus.cc:2243] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:36.748631 26038 raft_consensus.cc:2272] T be25118dfd5f44e0a28773a45c3570f1 P c728aa7dc1fb442b98ebe0a2c325bfed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.793035 26038 tablet_server.cc:196] TabletServer@127.25.109.131:0 shutdown complete.
I20260709 13:14:36.827565 26038 master.cc:562] Master@127.25.109.190:45925 shutting down...
I20260709 13:14:36.849009 26038 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:36.849664 26038 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:36.850019 26038 tablet_replica.cc:333] T 00000000000000000000000000000000 P b08047cc327d48aa8977f284f27e1e45: stopping tablet replica
I20260709 13:14:36.869724 26038 master.cc:584] Master@127.25.109.190:45925 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11680 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28238 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (310751 ms total)
[  PASSED  ] 8 tests.
I20260709 13:14:36.924717 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 544 messages since previous log ~18 seconds ago
I20260709 13:14:36.924921 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 544 messages since previous log ~18 seconds ago
I20260709 13:14:36.925056 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 542 messages since previous log ~18 seconds ago
I20260709 13:14:36.925205 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:36.925347 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:36.925513 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~97 seconds ago
I20260709 13:14:36.925729 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 13:14:36.925962 26038 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
